Stream and Go: News feeds for 300M users, built on RocksDB and Raft

By Thierry Schellenbach, CEO, Stream.

Stream is an API that enables developers to build news feeds and activity streams (try the API). We are used by over 500 companies and power the feeds of more than 300 million end users. Companies such as Product Hunt, Under Armour, Powerschool, Bandsintown, Dubsmash, Compass and Fabric (Google) rely on Stream to power their news feeds. In addition to the API, the founders of Stream also wrote the most widely used open source solution for building scalable feeds.

Here’s what Stream looks like today:

Number of servers: 180
Feed updates per month: 34 billion
Average API response time: 12ms
Average real-time response time: 2ms
Regions: 4 (US-East, EU-West, Tokyo and Singapore)
1B API requests per month (~20k/minute)
Given that most of our customers are engineers, we often talk about our stack. Here’s a high level overview:

Go is our primary programming language.
We use a custom solution built on top of RocksDB + Raft for


Original URL: http://feedproxy.google.com/~r/feedsapi/BwPx/~3/8mHLqOlAXv4/stream-and-go-news-feeds-for-over-300-million-end-users

Original article

Comments are closed.

Proudly powered by WordPress | Theme: Baskerville 2 by Anders Noren.

Up ↑

%d bloggers like this: