December 1, 2003
Journal Article

Evaluating the Sustained Performance of COTS-based Messaging Systems

Abstract

Messaging systems, which include message brokers built on top of message-oriented middleware, have been used as middleware components in many enterprise application integration projects. There are many COTS-based messaging systems on the market, but there is little concrete understanding in the software industry on the performance of these different technologies. The authors have carried out a scenario-based evaluation of three leading messaging systems to provide insight into performance issues. The evaluation process includes a study of the sustained performance of the system under load. The result of this study is used to derive a generic metric for quantifying a messaging system’s performance. The paper describes a synthetic transactional scenario, which is used for load tests and performance measurement. The results from executing this test scenario with three messaging systems are then presented and explained.

Revised: April 2, 2004 | Published: December 1, 2003

Citation

Tran P., J. Gosper, and I. Gorton. 2003. Evaluating the Sustained Performance of COTS-based Messaging Systems. Software Testing Verification & Reliability 13, no. 4:229-240. PNNL-SA-40235.