Sparkler: A KVM-based Virtual Machine Manager

[Join the discussion on Hacker News here.] Serverless computing is quite the rage these days and AWS Lambda is on the forefront of this. A while ago, they released Firecracker, the engine behind Lambda. Unsurprisingly, it was based on Linux’s KVM (Kernel-based Virtual Machine) technology, but what was surprising was how it gave up the… Continue reading Sparkler: A KVM-based Virtual Machine Manager

How AWS Firecracker works: a deep dive

Anything that powers technology like AWS Lambda needs to be really fast. And it needs to be secure. While AWS could have gone with existing technology, to satisfy both these main requirements, they went with building something new, Firecracker, that is both really fast – it can boot Linux and start executing user space processes… Continue reading How AWS Firecracker works: a deep dive

Linux Pressure Stall Information (PSI) by Example

[Discuss this article and read other’s comments on the subject on this thread on Hacker News.] The three fundamental building blocks of computers, CPU, I/O and RAM can come under pressure due to contention and this is not uncommon. To both accurately size workloads and to increase hardware utilization, having information on how much pressure… Continue reading Linux Pressure Stall Information (PSI) by Example

A Manager’s Guide to Kubernetes Adoption

Discussion on Hacker News This article and its topic were the subject of fairly detailed discussion on this thread here on Hacker News. Perusing through the comments should be well worth your time, albeit you might emerge completely confused by the experience. And no–tech guys do not hate each other, we just have a wide-ranging… Continue reading A Manager’s Guide to Kubernetes Adoption

Linux Applications Performance: Part VII: epoll Servers

This chapter is part of a series of articles on Linux application performance. If you came here without reading the poll()-based implementation description All the explanation of how exactly we move from a process or thread-based model to an event based model is there in the poll()-based article. Without going through it, this article might… Continue reading Linux Applications Performance: Part VII: epoll Servers

Linux Applications Performance: Part IV: Threaded Servers

This chapter is part of a series of articles on Linux application performance. Threads were all the rage in the 90s. They allowed the cool guys to give jaw-dropping demos to their friends and colleagues. Like so many cool things from the 90s, today, it is yet another tool in the arsenal for any programmer.… Continue reading Linux Applications Performance: Part IV: Threaded Servers

Linux Applications Performance: Part V: Pre-threaded Servers

This chapter is part of a series of articles on Linux application performance. The design discussed in this article is more popularly known as “thread pool”. Essentially, there is a pre-created pool of threads that are ready to serve any incoming requests. This is comparable to the pre-forked server design. Whereas there was a process… Continue reading Linux Applications Performance: Part V: Pre-threaded Servers

Linux Applications Performance: Part VI: Polling Servers

This chapter is part of a series of articles on Linux application performance. When things happen sequentially, we get them. All our flowcharts, algorithms or workflows are sequential in nature. It’s easy for our brains to understand sequential happenings. Moving to a multi-process or a threaded model is also a simple extension of that model.… Continue reading Linux Applications Performance: Part VI: Polling Servers

Linux Applications Performance: Part III: Preforked Servers

This chapter is part of a series of articles on Linux application performance. While the iterative server has trouble serving clients in parallel, the forking server incurs a lot of overhead forking a child process every time a client request is received. We saw from the performance numbers that in our test setup, it has… Continue reading Linux Applications Performance: Part III: Preforked Servers

Linux Applications Performance: Part II: Forking Servers

This chapter is part of a series of articles on Linux application performance. In Part I: Iterative servers, we took a look at a server which deals with one client request at a time. This server called accept() whenever it was done serving one client so that it could accept more client connections and process… Continue reading Linux Applications Performance: Part II: Forking Servers