Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Large-Scale Distributed Linkage of Records Containing Spatio-Temporal Information
Spatio-temporal information is increasingly made available in modern data sets, together with traditional numerical and categorical attributes. Such information can play a vital role in deciding whether two records, coming from disparate data sources, correspond to the same real-world entity. Linkage of records containing spatio-temporal information requires novel linkage methods and is usually associated with a significant computational overhead. To reduce computational costs, in this paper, we propose the first Spark-based approach for distributed, on-demand, spatio-temporal linkage. Through experimental evaluation, we illustrate that our Spark-based approach achieves (on average) 35% performance improvement compared with the respective Map/Reduce-based implementation.
Large-Scale Distributed Linkage of Records Containing Spatio-Temporal Information
Spatio-temporal information is increasingly made available in modern data sets, together with traditional numerical and categorical attributes. Such information can play a vital role in deciding whether two records, coming from disparate data sources, correspond to the same real-world entity. Linkage of records containing spatio-temporal information requires novel linkage methods and is usually associated with a significant computational overhead. To reduce computational costs, in this paper, we propose the first Spark-based approach for distributed, on-demand, spatio-temporal linkage. Through experimental evaluation, we illustrate that our Spark-based approach achieves (on average) 35% performance improvement compared with the respective Map/Reduce-based implementation.
Large-Scale Distributed Linkage of Records Containing Spatio-Temporal Information
Karapiperis, Dimitrios (Autor:in) / Gkoulalas-Divanis, Aris (Autor:in) / Verykios, Vassilios S. (Autor:in)
28.09.2020
1511754 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Linkage of Spatio-Temporal Data and Trajectories
| IEEE | 2019
Spatio‐temporal models for large‐scale indicators of extreme weather
| Online Contents | 2011