Synchronous replication across data center for messaging system at Uber

Cloud, Containers & Infrastructure
Room 4	Wednesday from 12:20 PM til 12:35 PM
Most storage systems replicate data across data center asynchronously, which introduces eventual consistency in the system. This is not acceptable for high-value data which requires strongly consistency across data center. At Uber, we build a messaging system that can synchronously replicate data to another data centers such that data will be available even after single data center failure. In this talk, we will discuss how we leverage Apache Zookeeper, Apache Kafka and cloud to build this system. messaging Cloud. storage streaming

Mingmin Chen
Mingmin Chen is the tech lead and senior software engineer with streaming data team at Uber, primarily focusing on building Apache Kafka pipeline and scaling Uber's real-time infrastructure. Prior to that he was a software engineer with Twitter and Oracle, working on big data infrastructure, storage server and database technologies. He got his PhD in computer science from UC Davis.
Hongliang Xu
Hongliang Xu is a software engineer with streaming data team at Uber, primarily focusing on developing and maintaining Uber’s s streaming data infrastructure built using Apache Kafka, which is a critical component of Uber’s data pipeline handling billions of messages and hundreds of terabytes of data per day.