The Impact of Concurrency Gains on the Analysis and Control of Multi-threaded Internet Services

, and
IEEE INFOCOM
Hong Kong, China,
Abstract. With the proliferation of Internet services, many solutions have emerged to provide Quality-of-Service (QoS) guarantees when the demands for the hosted services exceed the server’s capacity. In this paper, we take an analytical approach to answering key questions in the design and performance of application-level QoS techniques, especially those that are based on the multi-threading or multi-processing abstraction. Key to our analysis is the integration of the effects of concurrency into the interactions between multi-threaded services. To this end, we extend traditional time-sharing models to develop the multithreaded round-robin (MTRR) servers, a more accurate model of operation of typical multi-threaded Internet services. For this model, we first develop powerful, yet computationally-efficient, mathematical relationships that describe the performance (in terms of throughput and response time) of multi-threaded services. We then apply optimization techniques to derive the optimal allocation of threads given specific QoS objective functions. Using realistic workloads on a typical web server, we show the efficacy and accuracy of the proposed new methodology.
Keywords. Queueing theory, system design
Bibtex. 
@inproceedings{jamjoom-infocom-04,
author = {Hani and Jamjoom and Chun-Ting and Chou and Kang G. and Shin},
title = {{The Impact of Concurrency Gains on the Analysis and Control of Multi-threaded Internet Services}},
booktitle = {IEEE INFOCOM},
address = {Hong Kong, China},
month = {March},
year = {2004}
}