7,873 questions
0
votes
0
answers
25
views
ECS Task Generates Invalid S3 Presigned URL
I'm encountering an issue where my ECS task generates presigned URLs for objects in S3, but the generated URLs are invalid. I consistently receive an "InvalidToken" error when attempting to ...
- 127
-5
votes
0
answers
39
views
Is there a sandbox/dev environment for AWS marketplace? [closed]
So, my client has a product on AWS marketplace, and I need to test the aws marketplace APIs, like batch meter usage. However, I want something like a sandbox environment to test with dummy customer ...
- 1
0
votes
1
answer
27
views
AuthFailure: AWS was not able to validate the provided access credentials
I'm performing assume-role operation using the us-east-1 regional STS endpoint. This returns a V2 token, which I'm using to perform actions in my account. While this works in some regions, it fails in ...
0
votes
0
answers
21
views
aws list_findings parameters changed in request
I am currently using boto3 list findings to return all findings for various aws accounts.
I am getting the following error sporadically
(Service: MandoFindings, Status Code: 400,) Pagination token ...
- 443
1
vote
1
answer
78
views
Image upload corruption with SeaweedFS S3 API
Problem Description
I'm experiencing an issue where images uploaded through Django (using boto3) to SeaweedFS's S3 API are corrupted, while uploads through S3 Browser desktop app work correctly. The ...
- 318
0
votes
0
answers
25
views
Why does one S3-to-Redshift COPY operation take 50+ seconds while seven identical operations take 2-3 seconds?
A lambda that DELETEs and COPYs 8 parquet files from S3 into 8 Redshift tables (using boto3).
Each table is created from a single file, each with less than 3K rows.
7 of the queries take 2-3 seconds ...
- 71
1
vote
0
answers
14
views
My boto3 code gives Success response despite of no successful updates on console
I have the following code to sign up a user on AWS cognito.
async def _sign_up(self, preferred_username: str, username: str, password: str):
'''
Sign up a user with Cognito
:...
- 11
0
votes
1
answer
40
views
AWS Batch: Running ECSProperties Job with AWS Stepfunction
I have AWS Stepfunction that starts with a Lambda function to prepare the execution of an AWS Batch Job, of which the Job Definition specifies to use Fargate (ecsProperties Job). This stepfunction ...
- 11
0
votes
0
answers
18
views
Can I get different boto3 instances to share their connection pool to the same host?
I have code that creates few S3 objects but for many access keys. It does so in parallel, but within the same python process.
Each of the boto3 instances has its own connection pool, which can linger ...
- 53.6k
1
vote
0
answers
33
views
Move files from one S3 to another using Boto3 in Python from multiple sub bucket levels
I have below code to move the file from one S3 bucket to another which works perfectly.
The catch here is while copying the files it copies the S3 bucket as well, instead I wanted to copy only the ...
- 5,197
0
votes
2
answers
62
views
Sub Folders of S3 bucket - Bucket name must match the regex "^[a-zA-Z0-9.\-_]
I have below code to get the list of objects in the bucket, but it does not work for the sub folders of the S3.
import boto3
bucket_from = "BucketSource"
s3 = boto3.resource('s3')
src = s3....
- 5,197
0
votes
0
answers
36
views
AWS credentials to a Docker container via volume mount unable to read the credentials?
i did some research on stackoverflow, based on that . i have created a docker compose file as such
version: '3'
services:
app:
image: your_image
volumes:
- .:/app
with this , if i run ...
0
votes
0
answers
15
views
How to ensure the correct formatting of progress bars while downloading using boto3 and tqdm?
I am using the following function to download files from S3 using boto3 and tqdm:
def download_data(*, folder_path, Bucket, Prefix):
"""
Download the data into a folder from S3 ...
- 205
0
votes
0
answers
9
views
How can I filter for a specific parameter name using boto3 get_parameters_by_path?
I have GitHub token parameters stored in a hierarchy, such as "GHA/mytoken". I can get all parameters stored in the hierarchy with boto3 ssm get_parameters_by_path, but I can see no way to ...
- 1
0
votes
1
answer
50
views
Python Unittests failing in CI job, but not locally
I have made a small non-code update to a Python project. Existing unit tests are passing locally, but one of the tests fail when pushing my branch and triggering a CI job.
The actual error indicates ...
- 11