POSTED ON AUGUST 18, 2021 TO CORE DATA
RAMP-TAO: Layering atomic transactions on Facebook’s online graph store
By Audrey Cheng
What the research is: 
RAMP-TAO is a new protocol that improves the developer experience on TAO, Facebook’s online social graph store, by providing stronger transactional guarantees. It is the first protocol to provide transactional semantics over an eventually consistent massive-scale data store while still preserving the system’s overall reliability and performance. RAMP-TAO enables an intuitive read transaction API, so developers do not have to investigate and handle rare anomalies.
Our research has demonstrated that RAMP-TAO can be feasibly deployed in production with 0.42 percent memory overhead and enables the vast majority (over 99.9 percent) of reads to complete in one round-trip to the local cache with tail latency on par with existing TAO reads.
How it works:  
RAMP-TAO draws inspiration from the Read Atomic Multi-Partition (RAMP) protocols, which prevent fractured reads but impose unacceptably high performance and storage overheads for TAO.
The RAMP-TAO protocol provides stronger guarantees by layering them on top of TAO and is similar in spirit to the “bolt-on” approach. Since TAO, like most systems, ensures that all data is eventually consistent, we only need to guard against fractured reads for recent, transactionally updated data. We leverage this knowledge to minimize performance and storage overheads, especially for the existing TAO workloads that are not transactional.
Why it matters: 
TAO serves billions of reads and millions of writes per second and supports many of Facebook’s applications. It has traditionally prioritized availability and scalability to serve its large, read-dominant workloads. By layering stronger transactional guarantees on top of the existing system, we can provide more intuitive system behavior while retaining its reliability and efficiency. This strategy also enables RAMP-TAO to be cache-friendly, hotspot tolerant, and extensible to different data stores. Moreover, we incur overhead only for applications that opt in, rather than causing every application to take a performance hit.
Although we focus on TAO in this work, these properties are crucial to large-scale, read-optimized systems. Our layered approach can be a practical solution for other systems, many of which have sought to strengthen their guarantees. 
Read the full paper:
RAMP-TAO: Layering atomic transactions on Facebook’s online TAO data store
TAGS:      RESEARCH IN BRIEF
Prev
Apricot subsea cable will boost internet capacity, speeds in the Asia-Pacific region
Next
CacheLib, Facebook’s open source caching engine for web-scale services
Read More in Core DataView All
SEP 13, 2021
Superpack: Pushing the limits of compression in Facebook’s mobile apps
AUG 6, 2021
How we built a general purpose key value store for Facebook with ZippyDB
JUL 22, 2021
Migrating Facebook to MySQL 8.0
JUL 9, 2021
Ribbon filter: Practically smaller than Bloom and Xor
JAN 26, 2021
How machine learning powers Facebook’s News Feed ranking algorithm
APR 21, 2020
Turbine: Facebook’s service management platform for stream processing
Related Posts
Jun 25, 2013
TAO: The power of the graph
Oct 09, 2020
Nemo: Data discovery at Facebook
Aug 12, 2020
DELF: Safeguarding deletion correctness in online social networks
Related Positions
Marketing Decision Scientist, WhatsApp Marketing
MENLO PARK, US
Marketing Decision Scientist, WhatsApp Marketing
REMOTE, US
Data Engineer, Analytics (University Graduate)
LONDON, UNITED KINGDOM
Applied Research Science Manager, Auction & Delivery
MENLO PARK, US
Applied Research Science Manager, Auction & Delivery
NEW YORK, US
See All Jobs
Facebook © 2021
About​Careers​Privacy​Cookies​Terms​Help
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy
Facebook EngineeringOpen SourceFacebook Open SourceAndroidiOSWebCore DataData InfrastructureDevInfraProduction EngineeringSecurityConnectivityData Center EngineeringNetworking & TrafficVideo EngineeringVirtual RealityResearch PublicationsML ApplicationsAI ResearchResearch PublicationsWatch Videos