awslabs

awslabs/amazon-dynamodb-tools

Tools to make effective use of DynamoDB easier.

175 stars 45 forks 175 watchers Python Apache License 2.0

39 Open Issues Need Help Last updated: Jun 26, 2026

Open Issues Need Help

View All on GitHub

[bulk] A denied or throttled batch write aborts the job with a raw Spark traceback, and leaves items behind silently 5 days ago

bug help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

"diff" should probably rate limit reads per table instead of overall 6 days ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `size-histogram` to learn item size distribution about 2 months ago

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] Client prints a urllib3 traceback after stopping a job about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Consider a shorter Glue `IdleTimeout` for cost optimization about 2 months ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] Low priority: let diff's lookahead grow until memory actually runs out, and diagnose it when it does about 2 months ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] A malformed line in an export escapes a Spark worker instead of being reported about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] The watchdog kills a run on the first OutOfMemoryError, even where Spark could have recovered about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] Remove the Glue 6.0 SyntaxWarning suppression once AWS fixes runscript.py about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[bulk] Optionally let users choose the S3 output location for large-output commands (find/sql/diff) about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Print time to complete estimates about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Let each command define its own Glue `requirements.txt` about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Wrap native "import from S3" and "export to S3" as commands about 2 months ago

help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Create a convention for structured output across commands (i.e. JSON) about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Should be able to round trip a "find" writing to S3 and a "load" loading from S3 about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Limit what can end up in python_modules.zip about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Add a max cost parameter about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Consider revamping to a command-oriented folder structure about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Consider breaking `load` command into `load-*` versions about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[Optima] - Enhancement - Add `list-recommendations` to the CLI about 2 months ago

help wanted

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Allow bootstrap to specify an existing S3 bucket about 2 months ago

help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `copy` - to copy from one table to another with a hook to transform 3 months ago

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `scanfind` - does parallel scans with a push-down predicate instead of using the connector 3 months ago

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Expand warnings if requested read/write rate is too high or too low 4 months ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Have `scancount` able to output item counts per segment to measure possible task execution skew 4 months ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Remove unneeded job parameters XRegion and XRole 10 months ago

enhancement good first issue help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Allow capacity reservation amounts as input in reco tool about 1 year ago

enhancement help wanted

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Have `update` do a scan phase then update phase to spread writes about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Feature - Metrics Collector - Create a custom datatype/validator for start time about 1 year ago

enhancement good first issue help wanted

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

The toDF() call to convert a DynamicFrame to DataFrame can trigger an additional scan about 1 year ago

help wanted needs-triage bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `signature` - for comparing tables across regions or time about 1 year ago

AI Summary: The issue proposes a new `signature` verb to generate a deterministic hash of a table or its parts, enabling efficient comparison of tables across regions or time without transferring large datasets. This would be useful for verifying data consistency or successful restores. A suggested implementation involves segmented scans, hashing each segment, and then hashing those hashes to pinpoint differences, requiring a robust, deterministic streaming hash algorithm.

Complexity: 4/5

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `run` - execute a python function against every item in a table about 1 year ago

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

[verb] `export-replay` and `export-unplay` for processing incremental exports about 1 year ago

enhancement help wanted bulk_executor bulk-verb

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Enable `faker` only for `fill` to speed up startup about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Employ shuffle scans to diffuse the read/write traffic of each task about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Have `diff` command output a copy to S3 always about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Force built-in role refresh on version mismatch about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Check any passed-in custom role has required minimum permissions about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python

Quicker exit on non-recoverable systemic errors about 1 year ago

enhancement help wanted bulk_executor

awslabs/amazon-dynamodb-tools

175

Tools to make effective use of DynamoDB easier.

Python