Knowledge Agora



Scientific Article details

Title Implementing big data lake for heterogeneous data sources
ID_Doc 43570
Authors Mehmood, H; Gilman, E; Cortes, M; Kostakos, P; Byrne, A; Valta, K; Tekes, S; Riekki, J
Title Implementing big data lake for heterogeneous data sources
Year 2019
Published
DOI 10.1109/ICDEW.2019.00-37
Abstract Modern connected cities are more and more leveraging advances in ICT to improve their services and the quality of life of their inhabitants. The data generated from different sources, such as environmental sensors, social networking platforms, traffic counters, are harnessed to achieve these end goals. However, collecting, integrating, and analyzing all the heterogeneous data sources available from the cities is a challenge. This article suggests a data lake approach built on Big Data technologies, to gather all the data together for further analysis. The platform, described here, enables data collection, storage, integration, and further analysis and visualization of the results. This solution is the first attempt to integrate a diverse set of data sources from four pilot cities as part of the CUTLER project (Coastal urban development through the lenses of resiliency). The design and implementation details, as well as usage scenarios are presented in this paper.
Author Keywords data lake; Big Data; Smart City; data analysis
Index Keywords Index Keywords
Document Type Other
Open Access Open Access
Source Conference Proceedings Citation Index - Science (CPCI-S)
EID WOS:000584318800008
WoS Category Computer Science, Information Systems; Computer Science, Theory & Methods
Research Area Computer Science
PDF https://oulurepo.oulu.fi/bitstream/10024/25160/1/nbnfi-fe2019082024798.pdf
Similar atricles
Scroll