Next Article in Journal
A Survey on M2M Service Networks
Previous Article in Journal
An ECMA-55 Minimal BASIC Compiler for x86-64 Linux®
Article Menu

Export Article

Open AccessReview
Computers 2014, 3(4), 117-129;

Beyond Batch Processing: Towards Real-Time and Streaming Big Data

Department of Computer Engineering, Tarbiat Modares Univeristy, Tehran 14115-194, Iran
Received: 24 June 2014 / Revised: 26 September 2014 / Accepted: 9 October 2014 / Published: 17 October 2014
Full-Text   |   PDF [514 KB, uploaded 17 October 2014]   |  


Today, big data are generated from many sources, and there is a huge demand for storing, managing, processing, and querying on big data. The MapReduce model and its counterpart open source implementation Hadoop, has proven itself as the de facto solution to big data processing, and is inherently designed for batch and high throughput processing jobs. Although Hadoop is very suitable for batch jobs, there is an increasing demand for non-batch requirements like: interactive jobs, real-time queries, and big data streams. Since Hadoop is not suitable for these non-batch workloads, new solutions are proposed to these new challenges. In this article, we discussed two categories of these solutions: real-time processing, and stream processing of big data. For each category, we discussed paradigms, strengths and differences to Hadoop. We also introduced some practical systems and frameworks for each category. Finally, some simple experiments were performed to approve effectiveness of new solutions compared to available Hadoop-based solutions. View Full-Text
Keywords: big data; MapReduce; real-time processing; stream processing big data; MapReduce; real-time processing; stream processing

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Shahrivari, S. Beyond Batch Processing: Towards Real-Time and Streaming Big Data. Computers 2014, 3, 117-129.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Computers EISSN 2073-431X Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top