How to do basic aggregation with DynamoDB?

前端 未结 2 918
北恋
北恋 2020-12-29 03:25

How is aggregation achieved with dynamodb? Mongodb and couchbase have map reduce support.

Lets say we are building a tech blog where users can post articles. And say

2条回答
  •  孤独总比滥情好
    2020-12-29 03:49

    Dynamodb is pure key/value storage and does not support aggregation out of the box.

    If you really want to do aggregation using DynamoDB here some hints.

    For you particular case lets have table named articles. To do aggregation we need an extra table user-stats holding userId and tag_starts.

    1. Enabled DynamoDB streams on table articles
    2. Create a new lambda function user-stats-aggregate which is subscribed to articles DynamoDB stream and received OLD_NEW_IMAGES on every create/update/delete operation over articles table.
    3. Lambda will perform following logic
    • If there is no old image, get current tags and increase by 1 every occurrence in the db for this user. (Keep in mind there could be the case there is no initial record in user-stats this user)
    • If there is old image see if tag was added or removed and apply change +1 or -1 depending on the case for each affected tag for received user.
    1. Stand an API service retrieving these user stats.

    Usually aggregation in DynamoDB could be done using DynamoDB streams , lambdas for doing aggregation and extra tables keeping aggregated results with different granularity.(minutes, hours, days, years ...)

    This brings near realtime aggregation without need to do it on the fly per every request, you query on aggregated data.

提交回复
热议问题