Wednesday, April 17 • 1:50pm - 2:30pm
Scaling the Boot Barrier: Identifying & Eliminating Contention in Openstack

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

On a beefy machine (24 cores, 96 GB RAM, SSD), booting a single instance (from "nova boot" to ACTIVE) takes seconds. However, when you try booting 20 instances in parallel, the last instance might not be ACTIVE for minutes! While you're waiting, you notice that the host's CPUs and disk are mostly idle and there's plenty of free RAM. While your instances are BUILDING, you wonder what's going on -- why's this taking so long?

It turns out that lengthy portions of the boot process are serialized by contention for software resources, like iptables, database connections, libvirt, and the python interpreter! In this talk, we show how tools like strace and Tracelytics can be used to identify bottlenecks in Openstack. We present techniques for eliminating these bottlenecks, such as coalescing updates to iptables and avoiding greethreads pitfalls, and demonstrate how boot can scale! 



Wednesday April 17, 2013 1:50pm - 2:30pm
A106 (Portland Convention Center) 777 NE Martin Luther King Jr Blvd Portland, OR 97232

Attendees (0)