Skip to Content

2,994 Results Found

  • Feature Paper
  • Article
  • Open Access
2 Citations
3,708 Views
26 Pages

Analyzing Performance of Data Preprocessing Techniques on CPUs vs. GPUs with and Without the MapReduce Environment

  • Sikha S. Bagui,
  • Colin Eller,
  • Rianna Armour,
  • Shivani Singh and ,
  • Subhash C. Bagui and
  • Dustin Mink
  • + 1 author+ 0 author

10 September 2025

Data preprocessing is usually necessary before running most machine learning classifiers. This work compares three different preprocessing techniques, minimal preprocessing, Principal Components Analysis (PCA), and Linear Discriminant Analysis (LDA)....

(This article belongs to the Special Issue Hardware Acceleration for Machine Learning)
  • Article
  • Open Access
46 Citations
7,612 Views
20 Pages

The Cellular Automata Markov model combines the cellular automata (CA) model’s ability to simulate the spatial variation of complex systems and the long-term prediction of the Markov model. In this research, we designed a parallel CA-Markov mod...

(This article belongs to the Special Issue Big Data Computing for Geospatial Applications)
  • Article
  • Open Access
12 Citations
3,888 Views
8 Pages

3 June 2019

User-based collaborative filtering is one of the most-used methods for the recommender systems. However, it takes time to perform the method because it requires a full scan of the entire data to find the neighboring users of each active user, who hav...

  • Article
  • Open Access
1 Citations
5,600 Views
32 Pages

28 November 2018

The Map-Reduce (MR) framework has become a popular framework for developing new parallel algorithms for Big Data. Efficient algorithms for data mining of big data and distributed databases has become an important problem. In this paper we focus on al...

  • Article
  • Open Access
14 Citations
5,465 Views
15 Pages

18 May 2021

Microwave imaging systems are currently being investigated for breast cancer, brain stroke and neurodegenerative disease detection due to their low cost, portable and wearable nature. At present, commonly used radar-based algorithms for microwave ima...

  • Article
  • Open Access
5 Citations
3,109 Views
20 Pages

10 August 2023

The ItemCF algorithm is currently the most widely used recommendation algorithm in commercial applications. In the early days of recommender systems, most recommendation algorithms were run on a single machine rather than in parallel. This approach,...

(This article belongs to the Special Issue Application of Machine Learning in Big Data)
  • Article
  • Open Access
13 Citations
6,702 Views
16 Pages

Investigating the Adoption of Big Data Management in Healthcare in Jordan

  • Hani Bani-Salameh,
  • Mona Al-Qawaqneh and
  • Salah Taamneh

6 February 2021

Software developers and data scientists use and deal with big data to easily discover useful knowledge and find better solutions to improve healthcare services and patient safety. Big data analytics (BDA) is getting attention due to its role in decis...

(This article belongs to the Section Information Systems and Data Management)
  • Article
  • Open Access
4 Citations
4,433 Views
21 Pages

Mr4Soil: A MapReduce-Based Framework Integrated with GIS for Soil Erosion Modelling

  • Zhigang Han,
  • Fen Qin,
  • Caihui Cui,
  • Yannan Liu and ,
  • Lingling Wang and
  • Pinde Fu
  • + 1 author+ 0 author

A soil erosion model is used to evaluate the conditions of soil erosion and guide agricultural production. Recently, high spatial resolution data have been collected in new ways, such as three-dimensional laser scanning, providing the foundation for...

(This article belongs to the Special Issue Distributed and Parallel Architectures for Spatial Data)
  • Article
  • Open Access
13 Citations
4,648 Views
15 Pages

The conventional extracting–transforming–loading (ETL) system is typically operated on a single machine not capable of handling huge volumes of geospatial big data. To deal with the considerable amount of big data in the ETL process, we p...

(This article belongs to the Special Issue Big Data Computing for Geospatial Applications)
  • Article
  • Open Access
9 Citations
2,938 Views
16 Pages

IMapC: Inner MAPping Combiner to Enhance the Performance of MapReduce in Hadoop

  • C. Kavitha,
  • S. R. Srividhya,
  • Wen-Cheng Lai and
  • Vinodhini Mani

Hadoop is a framework for storing and processing huge amounts of data. With HDFS, large data sets can be managed on commodity hardware. MapReduce is a programming model for processing vast amounts of data in parallel. Mapping and reducing can be perf...

(This article belongs to the Special Issue Big Data Technologies: Explorations and Analytics)
  • Review
  • Open Access
7 Citations
7,259 Views
37 Pages

A Comprehensive Survey of MapReduce Models for Processing Big Data

  • Hemn Barzan Abdalla,
  • Yulia Kumar,
  • Yue Zhao and
  • Davide Tosi

With the rapid increase in the amount of big data, traditional software tools are facing complexity in tackling big data, which is a huge concern in the research industry. In addition, the management and processing of big data have become more diffic...

  • Article
  • Open Access
6 Citations
5,457 Views
34 Pages

17 December 2018

The Hammer prototype is a query engine for corpora of Open Data that provides users with the concept of blind querying. Since data sets published on Open Data portals are heterogeneous, users wishing to find out interesting data sets are blind: queri...

  • Article
  • Open Access
1 Citations
3,429 Views
29 Pages

SHIYF: A Secured and High-Integrity YARN Framework

  • Junyi Deng,
  • Yanheng Liu,
  • Jian Wang and
  • Shujing Li

Cloud computing is becoming a powerful parallel data processing method, and it can be adopted by many network service providers to build a service framework. Although cloud computing is able to efficiently process a large amount of data, it can be at...

(This article belongs to the Special Issue Cloud Computing and Applications)
  • Article
  • Open Access
4 Citations
9,603 Views
20 Pages

11 January 2016

Nowadays, a leading instance of big data is represented by Web data that lead to the definition of so-called big Web data. Indeed, extending beyond to a large number of critical applications (e.g., Web advertisement), these data expose several charac...

(This article belongs to the Special Issue Algorithms for Managing, Querying and Processing Big Data in Cloud Environments)
  • Article
  • Open Access
26 Citations
6,855 Views
18 Pages

With the rapid development of Internet of Things (IoT) technologies, the increasing volume and diversity of sources of geospatial big data have created challenges in storing, managing, and processing data. In addition to the general characteristics o...

(This article belongs to the Special Issue Distributed and Parallel Architectures for Spatial Data)
  • Article
  • Open Access
29 Citations
8,062 Views
19 Pages

Large Scale Product Recommendation of Supermarket Ware Based on Customer Behaviour Analysis

  • Andreas Kanavos,
  • Stavros Anastasios Iakovou,
  • Spyros Sioutas and
  • Vassilis Tampakas

In this manuscript, we present a prediction model based on the behaviour of each customer using data mining techniques. The proposed model utilizes a supermarket database and an additional database from Amazon, both containing information about custo...

  • Article
  • Open Access
2 Citations
3,136 Views
17 Pages

Accurate, reliable and infrastructure-free indoor positioning using a smartphone is considered an essential topic for applications such as indoor emergency response and indoor path planning. While the inertial measurement units (IMU) offer continuous...

(This article belongs to the Special Issue Indoor Mobile Mapping and Location-Based Knowledge Services)
  • Article
  • Open Access
5 Citations
6,059 Views
26 Pages

In the past twenty years, we have witnessed an unprecedented production of data worldwide that has generated a growing demand for computing resources and has stimulated the design of computing paradigms and software tools to efficiently and quickly o...

  • Feature Paper
  • Article
  • Open Access
2 Citations
4,339 Views
16 Pages

Sampling Based Histogram PCA and Its Mapreduce Parallel Implementation on Multicore

  • Cheng Wang,
  • Huiwen Wang,
  • Siyang Wang,
  • Edwin Diday and
  • Richard Emilion

15 May 2018

In existing principle component analysis (PCA) methods for histogram-valued symbolic data, projection results are approximated based on Moore’s algebra and fail to reflect the data’s true structure, mainly because there is no precise, unified calcula...

  • Article
  • Open Access
11 Citations
7,506 Views
18 Pages

Experimental Analysis in Hadoop MapReduce: A Closer Look at Fault Detection and Recovery Techniques

  • Muntadher Saadoon,
  • Siti Hafizah Ab Hamid,
  • Hazrina Sofian,
  • Hamza Altarturi and ,
  • Nur Nasuha,
  • Zati Hakim Azizul,
  • Asmiza Abdul Sani and
  • Adeleh Asemi
  • + 3 authors+ 0 author

31 May 2021

Hadoop MapReduce reactively detects and recovers faults after they occur based on the static heartbeat detection and the re-execution from scratch techniques. However, these techniques lead to excessive response time penalties and inefficient resourc...

(This article belongs to the Collection Sensors for Fault Diagnosis, Fault Tolerance and Resilient Control)
  • Article
  • Open Access
6 Citations
10,213 Views
17 Pages

Hadoop Performance Analysis Model with Deep Data Locality

  • Sungchul Lee,
  • Ju-Yeon Jo and
  • Yoohwan Kim

27 June 2019

Background: Hadoop has become the base framework on the big data system via the simple concept that moving computation is cheaper than moving data. Hadoop increases a data locality in the Hadoop Distributed File System (HDFS) to improve the performan...

(This article belongs to the Special Issue Big Data Research, Development, and Applications––Big Data 2018)
  • Article
  • Open Access
389 Views
28 Pages

3 September 2026

Organic Rankine Cycles (ORCs) have become one of the most promising technologies for converting low- and medium-grade waste heat into useful power. However, conventional ORC analyses are typically performed using dimensional variables and application...

(This article belongs to the Special Issue Advanced Fluid Machinery and Integrated Energy Systems: Design, Optimization, and Applications)
  • Article
  • Open Access
1 Citations
2,079 Views
20 Pages

A Novel Data Management Scheme in Cloud for Micromachines

  • Gurwinder Singh,
  • Rathinaraja Jeyaraj,
  • Anil Sharma and
  • Anand Paul

8 September 2023

In cyber-physical systems (CPS), micromachines are typically deployed across a wide range of applications, including smart industry, smart healthcare, and smart cities. Providing on-premises resources for the storage and processing of huge data colle...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
10 Citations
3,194 Views
10 Pages

11 September 2019

In the study of the mid-long-term early warning of landslide, the computational efficiency of the prediction model is critical to the timeliness of landslide prevention and control. Accordingly, enhancing the computational efficiency of the predictio...

(This article belongs to the Special Issue Mapping and Monitoring of Geohazards)
  • Article
  • Open Access
29 Citations
5,983 Views
24 Pages

17 March 2019

Increasing the combustion efficiency of power plant boilers and reducing pollutant emissions are important for energy conservation and environmental protection. The power plant boiler combustion process is a complex multi-input/multi-output system, w...

  • Article
  • Open Access
1 Citations
1,294 Views
29 Pages

24 April 2025

In the context of big data and artificial intelligence, analyzing and extracting actionable insights from extensive datasets to enhance decision-making processes presents both intriguing opportunities and formidable challenges. Existing multiple crit...

(This article belongs to the Special Issue Decision Making in Uncertain Environments via Advanced Analytical Methods)
  • Article
  • Open Access
1 Citations
1,119 Views
14 Pages

Burrows Wheeler Transform on a Large Scale: Algorithms Implemented in Apache Spark

  • Ylenia Galluzzo,
  • Raffaele Giancarlo,
  • Mario Randazzo and
  • Simona E. Rombo

2 March 2026

With the rapid growth of Next Generation Sequencing (NGS) technologies, large amounts of “omics” data are daily collected and need to be processed. Indexing and compressing large sequences datasets are some of the most important tasks in...

  • Article
  • Open Access
3 Citations
4,851 Views
14 Pages

MapReduce Algorithm for Variants of Skyline Queries: Skyband and Dominating Queries

  • Md. Anisuzzaman Siddique,
  • Hao Tian,
  • Mahboob Qaosar and
  • Yasuhiko Morimoto

13 August 2019

The skyline query and its variant queries are useful functions in the early stages of a knowledge-discovery processes. The skyline query and its variant queries select a set of important objects, which are better than other common objects in the data...

  • Article
  • Open Access
11 Citations
3,635 Views
11 Pages

Performance Evaluation of Query Plan Recommendation with Apache Hadoop and Apache Spark

  • Elham Azhir,
  • Mehdi Hosseinzadeh,
  • Faheem Khan and
  • Amir Mosavi

26 September 2022

Access plan recommendation is a query optimization approach that executes new queries using prior created query execution plans (QEPs). The query optimizer divides the query space into clusters in the mentioned method. However, traditional clustering...

  • Article
  • Open Access
21 Citations
9,364 Views
25 Pages

Within a digital map service environment, the rapid growth of Spatial Big-Data is driving new requirements for effective mechanisms for massive online vector map tile processing. The emergence of Not Only SQL (NoSQL) databases has resulted in a new d...

(This article belongs to the Special Issue Web/Cloud Based Mapping and Geoinformation)
  • Article
  • Open Access
8 Citations
7,574 Views
15 Pages

Cloud Computing-Based TagSNP Selection Algorithm for Human Genome Data

  • Che-Lun Hung,
  • Wen-Pei Chen,
  • Guan-Jie Hua,
  • Huiru Zheng and ,
  • Suh-Jen Jane Tsai and
  • Yaw-Ling Lin
  • + 1 author+ 0 author

5 January 2015

Single nucleotide polymorphisms (SNPs) play a fundamental role in human genetic variation and are used in medical diagnostics, phylogeny construction, and drug design. They provide the highest-resolution genetic fingerprint for identifying disease as...

(This article belongs to the Special Issue Human Single Nucleotide Polymorphisms and Disease Diagnostics)
  • Article
  • Open Access
5 Citations
4,728 Views
17 Pages

Real-Time Massive Vector Field Data Processing in Edge Computing

  • Kun Zheng,
  • Kang Zheng,
  • Falin Fang,
  • Hong Yao and ,
  • Yunlei Yi and
  • Deze Zeng
  • + 1 author+ 0 author

7 June 2019

The spread of the sensors and industrial systems has fostered widespread real-time data processing applications. Massive vector field data (MVFD) are generated by vast distributed sensors and are characterized by high distribution, high velocity, and...

(This article belongs to the Collection Fog/Edge Computing based Smart Sensing System)
  • Article
  • Open Access
8 Citations
4,607 Views
18 Pages

Two-Level Fault Diagnosis of SF6 Electrical Equipment Based on Big Data Analysis

  • Hongxia Miao,
  • Heng Zhang,
  • Minghua Chen,
  • Bensheng Qi and
  • Jiyong Li

With the increase of the operating time of sulphur hexafluoride (SF6) electrical equipment, the different degrees of discharge may occur inside the equipment. It makes the insulation performance of the equipment decline and will cause serious damage...

  • Article
  • Open Access
43 Citations
7,918 Views
15 Pages

Network Intrusion Detection with a Hashing Based Apriori Algorithm Using Hadoop MapReduce

  • Nureni Ayofe Azeez,
  • Tolulope Jide Ayemobola,
  • Sanjay Misra,
  • Rytis Maskeliūnas and
  • Robertas Damaševičius

2 December 2019

Ubiquitous nature of Internet services across the globe has undoubtedly expanded the strategies and operational mode being used by cybercriminals to perpetrate their unlawful activities through intrusion on various networks. Network intrusion has led...

  • Review
  • Open Access
30 Citations
11,712 Views
25 Pages

22 November 2021

The emergence of social media, the worldwide web, electronic transactions, and next-generation sequencing not only opens new horizons of opportunities but also leads to the accumulation of a massive amount of data. The rapid growth of digital data ge...

(This article belongs to the Special Issue Computational Methods for Medical and Cyber Security)
  • Article
  • Open Access
2 Citations
3,490 Views
20 Pages

JQPro:Join Query Processing in a Distributed System for Big RDF Data Using the Hash-Merge Join Technique

  • Nahla Mohammed Elzein,
  • Mazlina Abdul Majid,
  • Ibrahim Abaker Targio Hashem,
  • Ashraf Osman Ibrahim and ,
  • Anas W. Abulfaraj and
  • Faisal Binzagr
  • + 1 author+ 0 author

6 March 2023

In the last decade, the volume of semantic data has increased exponentially, with the number of Resource Description Framework (RDF) datasets exceeding trillions of triples in RDF repositories. Hence, the size of RDF datasets continues to grow. Howev...

(This article belongs to the Special Issue Machine Learning, Statistics and Big Data)
  • Article
  • Open Access
9 Citations
3,832 Views
34 Pages

EverAnalyzer: A Self-Adjustable Big Data Management Platform Exploiting the Hadoop Ecosystem

  • Panagiotis Karamolegkos,
  • Argyro Mavrogiorgou,
  • Athanasios Kiourtis and
  • Dimosthenis Kyriazis

3 February 2023

Big Data is a phenomenon that affects today’s world, with new data being generated every second. Today’s enterprises face major challenges from the increasingly diverse data, as well as from indexing, searching, and analyzing such enormou...

(This article belongs to the Special Issue Information for Business and Management–Software Development for Data Processing and Management)
  • Review
  • Open Access
100 Citations
24,085 Views
13 Pages

17 October 2014

Today, big data are generated from many sources, and there is a huge demand for storing, managing, processing, and querying on big data. The MapReduce model and its counterpart open source implementation Hadoop, has proven itself as the de facto solu...

  • Article
  • Open Access
4 Citations
2,895 Views
22 Pages

Optimization Algorithms for Scalable Stream Batch Clustering with k Estimation

  • Paulo Gustavo Lopes Cândido,
  • Jonathan Andrade Silva,
  • Elaine Ribeiro Faria and
  • Murilo Coelho Naldi

25 June 2022

The increasing volume and velocity of the continuously generated data (data stream) challenge machine learning algorithms, which must evolve to fit real-world problems. The data stream clustering algorithms face issues such as the rapidly increasing...

(This article belongs to the Special Issue Data Clustering: Algorithms and Applications)
  • Article
  • Open Access
37 Citations
7,065 Views
18 Pages

Large Scale Community Detection Using a Small World Model

  • Ranjan Kumar Behera,
  • Santanu Kumar Rath,
  • Sanjay Misra,
  • Robertas Damaševičius and
  • Rytis Maskeliūnas

15 November 2017

In a social network, small or large communities within the network play a major role in deciding the functionalities of the network. Despite of diverse definitions, communities in the network may be defined as the group of nodes that are more densely...

(This article belongs to the Special Issue Socio-Cognitive and Affective Computing)
  • Article
  • Open Access
15 Citations
4,748 Views
13 Pages

20 May 2019

In practice, single item support cannot comprehensively address the complexity of items in large datasets. In this study, we propose a big data analytics framework (named Multiple Item Support Frequent Patterns, MISFP-growth algorithm) that uses Hado...

(This article belongs to the Special Issue Actionable Pattern-Driven Analytics and Prediction)
  • Article
  • Open Access
1 Citations
4,265 Views
19 Pages

Privacy-Aware MapReduce Based Multi-Party Secure Skyline Computation

  • Saleh Ahmed,
  • Mahboob Qaosar,
  • Asif Zaman,
  • Md. Anisuzzaman Siddique and ,
  • Chen Li,
  • Kazi Md. Rokibul Alam and
  • Yasuhiko Morimoto
  • + 2 authors+ 0 author

Selecting representative objects from a large-scale dataset is an important task for understanding the dataset. Skyline is a popular technique for selecting representative objects from a large dataset. It is obvious that the skyline computation from...

  • Article
  • Open Access
5 Citations
2,103 Views
29 Pages

DIAFM: An Improved and Novel Approach for Incremental Frequent Itemset Mining

  • Mohsin Shaikh,
  • Sabina Akram,
  • Jawad Khan,
  • Shah Khalid and
  • Youngmoon Lee

13 December 2024

Traditional approaches to data mining are generally designed for small, centralized, and static datasets. However, when a dataset grows at an enormous rate, the algorithms become infeasible in terms of huge consumption of computational and I/O resour...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
1 Citations
5,986 Views
26 Pages

22 November 2018

Considering the recent exponential growth in the amount of information processed in Big Data, the high energy consumed by data processing engines in datacenters has become a major issue, underlining the need for efficient resource allocation for more...

  • Article
  • Open Access
16 Citations
10,040 Views
15 Pages

1 December 2018

We study big-data hybrid-data-processing lambda architecture, which consolidates low-latency real-time frameworks with high-throughput Hadoop-batch frameworks over a massively distributed setup. In particular, real-time and batch-processing engines a...

(This article belongs to the Special Issue Data Stream Mining and Processing)
  • Article
  • Open Access
377 Views
41 Pages

Federated Learning (FL) enables collaborative model training across decentralized organizations without direct data sharing, yet communicating raw gradient updates remains susceptible to reconstruction and membership inference attacks. Fully Homomorp...

(This article belongs to the Section Big Data)
  • Article
  • Open Access
19 Citations
3,602 Views
25 Pages

Blockchain-Enabled Secure Data Sharing with Honey Encryption and DSNN-Based Key Generation

  • Reshma Siyal,
  • Jun Long,
  • Muhammad Asim,
  • Naveed Ahmad and ,
  • Hanaa Fathi and
  • Mohammad Alshinwan
  • + 1 author+ 0 author

24 June 2024

Ensuring data confidentiality is a critical requirement for modern security systems globally. Despite the implementation of various access-control policies to enhance system security, significant threats persist due to insecure and inadequate access...

(This article belongs to the Special Issue New Advances in Cryptographic Theory and Application)
  • Article
  • Open Access
4 Citations
5,540 Views
36 Pages

15 January 2019

Declarative process management has emerged as an alternative solution for describing flexible workflows. In turn, the modelling opportunities with languages such as Declare are less intuitive and hard to implement. The area of process discovery cover...

(This article belongs to the Special Issue Selected Papers from ICEIS 2018: Advances in Enterprise Information Systems)
  • Feature Paper
  • Article
  • Open Access
18 Citations
7,310 Views
23 Pages

17 August 2020

Situated in the main tracks of typhoons in the Northwestern Pacific Ocean, Taiwan frequently encounters disasters from heavy rainfall during typhoons. Accurate and timely typhoon rainfall prediction is an imperative topic that must be addressed. The...

(This article belongs to the Section Meteorology)
  • Article
  • Open Access
27 Citations
10,096 Views
22 Pages

An Efficient Spark-Based Hybrid Frequent Itemset Mining Algorithm for Big Data

  • Mohamed Reda Al-Bana,
  • Marwa Salah Farhan and
  • Nermin Abdelhakim Othman

14 January 2022

Frequent itemset mining (FIM) is a common approach for discovering hidden frequent patterns from transactional databases used in prediction, association rules, classification, etc. Apriori is an FIM elementary algorithm with iterative nature used to...

(This article belongs to the Special Issue Knowledge Extraction from Data Using Machine Learning)

of 60