Title | Design and Implementation of Smart City Big Data Processing Platform Based On Distributed Architecture |
---|---|
ID_Doc | 38163 |
Authors | Ma, SM; Liang, ZL |
Title | Design and Implementation of Smart City Big Data Processing Platform Based On Distributed Architecture |
Year | 2016 |
Published | |
DOI | |
Abstract | For the problem about low efficiency and poor degree of the sharing and integration of the massive, heterogeneous data, this paper proposes a design scheme based on distributed architecture, mainly using Kafka, Storm and Spark clusters, and implements real-time transmission of structured data, unstructured data and database data, and achieves real-time analysis of real-time data and statistical analysis of offline data. Finally, test results show the performance of Big Data processing platform, and fully demonstrated the advantage of using the distributed architecture. |
Author Keywords | Smart city; Distributed architecture; Big data processing platform |
Index Keywords | Index Keywords |
Document Type | Other |
Open Access | Open Access |
Source | Conference Proceedings Citation Index - Social Science & Humanities (CPCI-SSH) |
EID | WOS:000390842500007 |
WoS Category | Business; Management |
Research Area | Business & Economics |