Conveyor: one-tool-fits-all continuous software deployment at Meta
File(s)osdi23-grubic.pdf (928.18 KB)
Published version
Author(s)
Type
Conference Paper
Abstract
We present Conveyor, Meta’s software deployment tool,
along with the valuable data obtained from managing over
30,000 deployment pipelines that deploy all kinds of services
at Meta across millions of machines. We describe a wide
range of deployment scenarios that Conveyor supports to
achieve universal coverage. At Meta, out of all the deploy ment pipelines for services deployed via containers, 97% of
them employ fully automated deployments without manual
intervention: 55% utilize continuous deployment, instantly
deploying every code change to production after passing au tomated tests, and the remaining 42% are automatically de ployed on a fixed schedule (mostly daily or weekly) without
manual validation. We highlight several distinguishing fea tures of Conveyor, including safe in-place updates to reduce
hardware costs, analysis of code dependencies to prevent
faulty releases, and the capability to deploy complex ML
models at scale.
along with the valuable data obtained from managing over
30,000 deployment pipelines that deploy all kinds of services
at Meta across millions of machines. We describe a wide
range of deployment scenarios that Conveyor supports to
achieve universal coverage. At Meta, out of all the deploy ment pipelines for services deployed via containers, 97% of
them employ fully automated deployments without manual
intervention: 55% utilize continuous deployment, instantly
deploying every code change to production after passing au tomated tests, and the remaining 42% are automatically de ployed on a fixed schedule (mostly daily or weekly) without
manual validation. We highlight several distinguishing fea tures of Conveyor, including safe in-place updates to reduce
hardware costs, analysis of code dependencies to prevent
faulty releases, and the capability to deploy complex ML
models at scale.
Date Issued
2023-07-10
Date Acceptance
2023-07-10
Citation
Proceedings of the 17th USENIX Symposium on Operating Systems design and implementation, OSDI 2023, 2023, pp.325-342
Publisher
USENIX
Start Page
325
End Page
342
Journal / Book Title
Proceedings of the 17th USENIX Symposium on Operating Systems design and implementation, OSDI 2023
Copyright Statement
© 2023. The Author(s). The USENIX Association. Rights to individual papers remain with the author or the author’s employer. Permission is granted for the noncommercial reproduction of the complete work for educational or research purposes. Permission is granted to print, primarily for one person’s exclusive use, a single copy of these Proceedings.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:001066453900019&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI)
Subjects
CONTINUOUS DELIVERY
Publication Status
Published
Start Date
2023-07-10
Finish Date
2023-07-12
Coverage Spatial
MA, Boston