| Title | Urban data management system: Towards Big Data analytics for Internet of Things based smart urban environment using customized Hadoop |
|---|---|
| ID_Doc | 43979 |
| Authors | Babar, M; Arif, F; Jan, MA; Tan, ZY; Khan, F |
| Title | Urban data management system: Towards Big Data analytics for Internet of Things based smart urban environment using customized Hadoop |
| Year | 2019 |
| Published | |
| Abstract | The unbroken amplification of a versatile urban setup is challenged by huge Big Data processing. Understanding the voluminous data generated in a smart urban environment for decision making is a challenging task. Big Data analytics is performed to obtain useful insights about the massive data. The existing conventional techniques are not suitable to get a useful insight due to the huge volume of data. Big Data analytics has attracted significant attention in the context of large-scale data computation and processing. This paper presents a Hadoop-based architecture to deal with Big Data loading and processing. The proposed architecture is composed of two different modules, i.e., Big Data loading and Big Data processing. The performance and efficiency of data loading is tested to propose a customized methodology for loading Big Data to a distributed and processing platform, i.e., Hadoop. To examine data ingestion into Hadoop, data loading is performed and compared repeatedly against different decisions. The experimental results are recorded for various attributes along with manual and traditional data loading to highlight the efficiency of our proposed solution. On the other hand, the processing is achieved using YARN cluster management framework with specific customization of dynamic scheduling. In addition, the effectiveness of our proposed solution regarding processing and computation is also highlighted and decorated in the context of throughput. (C) 2019 Elsevier B.V. All rights reserved. |
| https://napier-repository.worktribe.com/preview/1619659/UrbanDataManagementSystem.pdf |
Similar Articles
| ID | Score | Article |
|---|---|---|
40988
|
Babar, M; Arif, F Smart urban planning using Big Data analytics to contend with the interoperability in Internet of Things(2017) | |
| 45709
|
Silva, BN; Khan, M; Jung, C; Seo, J; Muhammad, D; Han, J; Yoon, Y; Han, K Urban Planning and Smart City Decision Management Empowered by Real-Time Data Processing Using Big Data Analytics(2018)Sensors, 18, 9 | |
| 43011
|
Babar, M; Arif, F Smart Urban Planning using Big Data Analytics based Internet of Things(2017) | |
| 40433
|
Rathore, MM; Ahmad, A; Paul, A; Rho, S Urban planning and building smart cities based on the Internet of Things using Big Data analytics(2016) | |
| 45231
|
Rathore, MM; Ahmad, A; Paul, A IoT-Based Smart City Development using Big Data Analytical Approach(2016) | |
| 38538
|
Silva, BN; Khan, M; Han, K Big Data Analytics Embedded Smart City Architecture for Performance Enhancement through Real-Time Data Processing and Decision-Making(2017) | |
| 36479
|
Yu, HX; Mihai, IC; Srivastava, A Study And Research On Iot And Big Data Analysis For Smart City Development(2021)Scalable Computing-Practice And Experience, 22, 2 | |
| 36886
|
Rathore, MM; Paul, A; Ahmad, A; Jeon, G IoT-Based Big Data: From Smart City towards Next Generation Super City Planning(2017)International Journal On Semantic Web And Information Systems, 13.0, 1 | |
| 44338
|
Diaconita, V; Bologa, AR; Bologa, R Hadoop Oriented Smart Cities Architecture(2018)Sensors, 18, 4 | |
| 38209
|
Kaleem, S; Talha, M; Babar, M Managing and Processing Information in the Internet of Things-Based Smart City Environment Using Big Data Analytics(2019) |