(Meta System Design)
Design News Aggregator
Your client is a trading firm that needs a real-time monitoring service for global news.
The system must ingest unstructured data from a "firehose" of third-party sources(Twitter/X, Google News, popular news websites …) and aggregate them into a single, unified stream.
The goal is to transform this raw "firehose" of text into a structured API that allows traders to query and receive the most recent news for any specific company.
The Ingestion Pipeline
- Pull vs Push?
- How to define a universal news schema that works for both a tweet and a long-form news article?
- How does your infrastructure handle sudden "breaking news" events where the volume of incoming data triples in seconds?
- Infrastructure: What tools will you use to buffer and process the raw stream?
Storage & Indexing
- What type of database will you use? Which specific database? Why?
- How long should news be stored? What's the primary concerns?
- How do you prevent system bottlenecks when everyone is querying a "trending" company at the same time?
- How to distribute data?
- The ranking logic?
...
Design News Aggregator
Your client is a trading firm that needs a real-time monitoring service for global news.
The system must ingest unstructured data from a "firehose" of third-party sources(Twitter/X, Google News, popular news websites …) and aggregate them into a single, unified stream.
The goal is to transform this raw "firehose" of text into a structured API that allows traders to query and receive the most recent news for any specific company.
The Ingestion Pipeline
- Pull vs Push?
- How to define a universal news schema that works for both a tweet and a long-form news article?
- How does your infrastructure handle sudden "breaking news" events where the volume of incoming data triples in seconds?
- Infrastructure: What tools will you use to buffer and process the raw stream?
Storage & Indexing
- What type of database will you use? Which specific database? Why?
- How long should news be stored? What's the primary concerns?
- How do you prevent system bottlenecks when everyone is querying a "trending" company at the same time?
- How to distribute data?
- The ranking logic?
...
Get one-to-one training from Google Facebook engineers
Top-notch Professionals
Learn from Facebook and Google senior engineers interviewed 100+ candidates.
Most recent interview questions and system design topics gathered from aonecode alumnus.
One-to-one online classes. Get feedbacks from real interviewers.
Customized Private Class
Already a coding expert? - Advance straight to hard interview topics of your interest.
New to the ground? - Develop basic coding skills with your own designated mentor.
Days before interview? - Focus on most important problems in target company question bank.