Questions tagged [amazon-dynamodb]
The amazon-dynamodb tag has no usage guidance.
33
questions
0
votes
0
answers
32
views
DynamoDB Auto-Scaling, Application Auto-Scaling
I'm trying to setup a set of boto3 python AWS scripts which can create new users and dynamoDB tables, so that the web app I'm working on can add new users with properly scoped permissions.
I'm having ...
- 1,478
0
votes
0
answers
27
views
DynamoDB user segmentation
Is there an industry standard way to segment data by company / user / client in DynamoDB? If I was using a relational database, I think i'd have a different database for the level I'm thinking of here....
- 1,478
2
votes
2
answers
171
views
Using file system (AWS EFS) as cheap database for Lambda function
I am designing a database that could easily be represented as a large collection of files containing fixed size records, with sequence numbers 0,1,... This could fit nicely in DynamoDB with the ...
- 131
0
votes
0
answers
90
views
SHA512-CRYPT MariaDB passwords migration to DynamoDB
I used to run my mail server's DB in MariaDB (10.5.16) on-prem on Debian 10. I've now migrated this to RDS, however I would also like to try and migrate to DynamoDB.
Most of the data is plaintext, ...
0
votes
1
answer
638
views
What is the HeavyUsage charge on AWS DynamoDB?
What are below cost charges in AWS Cost Explorer
<region-code>-HeavyUsage:dynamodb.write
<region-code>-HeavyUsage:dynamodb.read
Didnot find any documentation about Dynamodb bill/cost ...
- 101
0
votes
0
answers
319
views
How to connect Dynamodb from Docker?
I am running a DynamoDB as docker container on a linux virtual machine.
The url for DnyamoDB docker image: link
But in the description, no where they mentioned about access key and private key.
If it ...
- 362
1
vote
1
answer
2k
views
How to automate the generation of the table schema json for aws dynamodb create-table?
Currently if I run aws dynamodb create-table --generate-cli-skeleton, it will generate a template for me to fill in column definitions etc to create a new dynamodb table.
I want to be able to dump ...
- 3,358
1
vote
0
answers
411
views
What is the correct way to visualise AWS DynamoDB data in AWS Quicksight
In a nutshell how to connect DynamoDB to AWS Quicksight, considering these criteria?
In my existing solution, data arrives at AWS IoT, invokes a rule which sends it to Lambda. Lambda decodes it and ...
- 111
2
votes
1
answer
921
views
Is DynamoDB latency almost the same as RDS latency?
I am exploring using AWS Lambda through Laravel Vapor. Avoiding the use of Redis can save us ~$56/mo (t2.small at ~$24, NAT Gateway at ~$32).
Instead of Redis, I plan to use DynamoDB which is much ...
- 121
1
vote
2
answers
241
views
AWS monthly billing for dynamoDB
I am going to set up a DynamoDB on aws, and their pricing is about .3$/GB a month. If i store 500 GB for an hour, do some work on it, then remove 200GB after an hour. Do i have to pay for the 500 GB ...
- 13
0
votes
1
answer
44
views
DynamoDB Cost in 2019
I am currently trying to line out the stack for a social-media-like application (users, follows, likes etc.). My initial plan was to do this with the Serverless Framework using AWS Lambda and most ...
- 121
1
vote
2
answers
692
views
Running AWS Lambda in same VPC as DocumentDB or DynamoDB
We are currently running our AWS Lambda's in a VPC due to an earlier architectural decision.
We are also using MongoDB Atlas and a peering connection setup between the VPC and Atlas. This obviously ...
- 113
1
vote
0
answers
70
views
How do you decouple storage and compute resources without losing the benefits of locally attached storage?
Services like DynamoDB (not specifically, but it was the first that came to mind) provide dynamic scaling on write/read capacity (i.e. compute) as well as storage capacity.
This means that you can ...
- 111
5
votes
1
answer
4k
views
Migrating from DynamoDB to RDS
I'm considering the different options available for migrating a DynamoDB Database to RDS. The data structure makes much more sense in a relational format.
There are 8 tables with around 1 million ...
- 163
3
votes
1
answer
1k
views
Is it possible to use the Free Tier of AWS DynamoDB On Demand?
The DynamoDB On Demand Free Tier documentation describes the free tier as including
25 GB of data storage
2.5 million stream read requests from DynamoDB Streams
1 GB of data transfer out, ...
- 533
0
votes
0
answers
176
views
AWS serverless setup for recurring tasks?
I have a database consisting of many items. At least one time per day I want to loop through all items in this database and for each item, call an external API to fetch current data about this item ...
- 1
2
votes
1
answer
2k
views
When happens when I reach max concurrent Lambda functions
I have 200 jsonl (json-lines) files in an s3 bucket. Each file contains 100,000 JSONs to be written into a DynamoDB.
I want to use Lambda to download the file from S3, and batch-write it into the ...
- 146
1
vote
1
answer
1k
views
Tradeoffs for naming DynamoDB tables with CloudFormation
I’m creating some dynamodb tables via CloudFormation, which will be accessed by Python lambdas. It looks like I have two choices in naming the tables — let CF do it, and therefore put a whole bunch ...
- 2,301
0
votes
1
answer
606
views
To implement persistent queue, should I go for RDS or DynamoDB on aws?
This is my use case:
I have a decoupled application system.
One application is accepting requests, validating, and queuing in SQS.
Other application is mounted on a cluster of EC2 workers that will ...
- 101
-1
votes
1
answer
96
views
AWS Lowest latency infrastructure
I'd like to setup the most correct and lowest latency infrastructure for AWS.
I would like to serve static Javascript files over CloudFront, and on top of that - a call to a dynamic server that will ...
1
vote
0
answers
224
views
Convert case of DynamoDB data types in stream or dump
When I dump data from DynamoDB using a data pipeline, it looks like this, with lowercase data types:
{"id":{"n":"2918466"},"time":{"n":"1404783111.4180515"},"user":{"s":"...
- 111
1
vote
1
answer
1k
views
DynamoDB Streams with Lambda, how to process related messages in order?
I want to use DynamoDB Streams + AWS Lambda to process chat messages. Messages regarding the same conversation user_idX:user_idY (a room) must be processed in order. Global ordering is not important.
...
- 111
1
vote
0
answers
999
views
object mapping for [doc.awsRegion] tried to parse field [awsRegion] as object, but found a concrete value
I am using Logstash Dynamodb PLugin to index data to be able to query it. Everything was running pretty smoothly, until one of my teammates started messing with the schema, and broke it. We can still ...
- 265
0
votes
1
answer
414
views
Does AWS support DBF files or Samba Shares?
We have DBF files running in our local network. It's on an Ubuntu Server running Samba shares. The DBF files are used by our in-house system running on xBase.
Now we're moving everything to Amazon ...
- 2,006
9
votes
2
answers
4k
views
AWS DynamoDB Cost efficiency
I have to move a business application into the cloud, therefore cost is one of my biggest concerns.
DynamoDB seems to be a good option, while a big part of our data is able to migrate from ...
19
votes
3
answers
15k
views
AWS ElastiCache/SimpleQueue vs DynamoDB
I'm wondering about the rationale for using ElastiCache/SimpleQueue vs just having "Cache" and "Queue" tables inside of DynamoDB respectively.
It seems that the network latency to the Cache/Queue ...
- 589
0
votes
2
answers
747
views
See how many times the provisioned throughput was decreased within the same day in a DynamoDB table
Is there anyway to see how many times the provisioned throughput was decreased within the same day (UTC) in a DynamoDB table?
When increasing the provisioned throughput I am always afraid not to be ...
- 1,052
3
votes
1
answer
9k
views
Drop/Truncate DynamoDB table with AWS Data Pipeline
I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example.
I want to truncate the table (or drop and create a new one) every time the ...
- 738
6
votes
1
answer
6k
views
Using DynamoDB for logging user activity
I am developing a freelancing platform for certain professionals. I was thinking of utilizing the AWS DynamoDB for logging user activity (like posting a job, editing a job etc).
Fields would be
...
- 355
5
votes
2
answers
7k
views
Timeouts while trying to connect to DynamoDB endpoint
We were performing a test deployment of an application, that utilizes DynamoDB for persistency. A number of tables was created in the us-east region. Then we ran some tests against the application, ...
- 812
2
votes
3
answers
2k
views
amazon dynamoDB or MySQL for storing large arrays inside each row
I am trying to decide which database I should use for an application I'm making. I was leaning toward dynamoDB because of its scalability, but then I read in the documentation which said:
there is a ...
- 145
1
vote
2
answers
11k
views
How to set up AWS EC2 with apache
I am new to AWS and I have some basic set up questions that I can't find answers to.
1) I have created an EC2 instance using the default Amazon Linux AMI. How can I install apache? Then how can I ...
- 11
0
votes
1
answer
869
views
Is it possible to run Joomla in DynamoDB?
I'm trying to find a scalable way to run my Joomla installation with Amazon Web Services. I was very excited with the announcement of DynamoDB, but I'm not sure about the challenges to run Joomla on a ...
