Design a Data Pipeline for Time Series Data (Temperature Sensor Data)
Ғылым және технология
Scenario to design the System:
------------------------------------------------------
The requirement is to collect and store temperature readings from potentially thousands of sensors.
We also need to be able to quickly retrieve a reading for a given sensor and timestamp.
We need to keep these for 30 days, after which they can be deleted.
Architecture:
----------------------------
github.com/SatadruMukherjee/D...
You can refer these videos for practical implementation of different components of the architecture discussed in this video--
Change Data Capture for DynamoDB Streams using Amazon Kinesis in-depth intuition
• Change Data Capture fo...
What is DynamoDB TTL (Time To Live?) | Overview and Demo | Part 1
• What is DynamoDB TTL (...
What is DynamoDB TTL (Time To Live?) | Overview and Demo | Part 2
• What is DynamoDB TTL (...
Learn System Design with AWS:
-------------------------------------------------------------
• Data Architect 101 for...
Пікірлер: 7
Amazing explaination brother 🙌🙌
@KnowledgeAmplifier1
Жыл бұрын
Thank you Syed Babji! Happy Learning
Ur always good content creator and tutor
@KnowledgeAmplifier1
Жыл бұрын
Glad you think so Vijay Kumar Naramalli! Happy Learning
good content, but what about open source tools? I see all of them are AWS
@himalayasaikia5762
22 күн бұрын
You can try kafka+cassandra, cassandra supports TTL as well
i think this is not a good HLD we need more concepts that tools like load balance, database and even queues etc