Scalable Multi-Input–Multi-Output Queues With Application to Variation-Tolerant Architectures

A queue typically connects a producer and a consumer and improves the overall performance by smoothening irregular production and consumption over time. In this paper, we introduce so-called multiple-input-multiple-output (MIMO) queues, connecting NP producers with NC consumers, that are symmetric, scalable, and have a high throughput. MIMO queues can be used to perform fine-grained load balancing and are proposed as key building blocks for variation-tolerant architectures. We present and analyze a family of asynchronous MIMO queues.