Click here to Skip to main content
15,888,461 members
Please Sign up or sign in to vote.
1.00/5 (1 vote)
See more:
Reaching out to the community to pressure test our internal thinking.

We are building a simplified business intelligence platform that will aggregate metrics (i.e. traffic, backlinks) and text list (i.e search keywords, used technologies) from several data providers.

The data will be somewhat loosely structured and may change over time with vendors potentially changing their response formats.

Data volume may be long term 100,000 rows x 25 input vectors.

Data would be updated and read continuously but not at massive concurrent volume.

We'd expect to need to do some ETL transformations on the gathered data from partners along the way to the UI (e.g show trending information over the past five captured data points).

We'd want to archive every single data snapshot (i.e. version it) vs just storing the most current data point.

The persistence technology should be readily available through AWS.

Our assumption is our requirements lend themselves best towards DynamoDB (vs Amazon Neptune or Redshift or Aurora).

Is that fair to assume? Are there any other questions / information I can provide to elicit input from this community?

What I have tried:

Evaluated the4 market; so far assuming DynamoDB is the way to go.
Posted
Updated 28-Nov-18 7:27am
Comments
Patrice T 28-Nov-18 5:34am    
and you have a programming question ?
Member 14070096 28-Nov-18 5:37am    
Does this not qualify? Platform selection is as much of a critical part of the programming exercise as writing the actual code, no?
CHill60 28-Nov-18 6:02am    
This is the Quick Questions forum so this question is somewhat off-topic. As this is more of discussion piece you might get better responses (plural hopefully) on this forum instead - Database Discussion Boards[^]
Member 14070096 28-Nov-18 7:54am    
thank you done.
CHill60 28-Nov-18 8:05am    
Glad to help. Hope you get some responses now!

1 solution

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900