Title :
Kafka and Its Using in High-throughput and Reliable Message Distribution
Author :
Zhenghe Wang;Wei Dai;Feng Wang;Hui Deng;Shoulin Wei;Xiaoli Zhang;Bo Liang
Author_Institution :
Yunnan Key Lab. of Comput. Technol. Applic., Kunming Univ. of Sci. &
Abstract :
Nowadays, with the rapid development of distributed computing, message distribution has been more and more important to distributed systems. Kafka was developed to collect and distribute massive messages for distributed systems. It is a high-throughput distributed messaging system. Kafka can always keep stable performance even if it processes millions of messages per second. Messages are persistent in Kafka, and Kafka is able to scale out easily. Besides, it is suitable for both online and offline processing simultaneously. Existing messaging systems all have some disadvantages. In comparison with these messaging systems, Kafka has superior performance. Therefore, Kafka has already been successfully used in production by some companies for a certain time. Though Kafka is still able to be improved in some aspects, it´s expected to have broad development prospects.
Keywords :
"Reliability","Servers","Throughput","Real-time systems","Computers","Distributed databases","Data processing"
Conference_Titel :
Intelligent Networks and Intelligent Systems (ICINIS), 2015 8th International Conference on
DOI :
10.1109/ICINIS.2015.53