A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Streamlining Smart Meter Data Analytics
Today smart meters are increasingly used in worldwide. Smart meters are the advanced meters capable of measuring customer energy consumption at a fine-grained time interval, e.g., every 15 minutes. The data are very sizable, and might be from different sources, along with the other social-economic metrics such as the geographic information of meters, the information about users and their property, geographic location and others, which make the data management very complex. On the other hand, data-mining and the emerging cloud computing technologies make the collection, management, and analysis of the so-called big data possible. This can improve energy management, e.g., help utilities improve the management of energy and services, and help customers save money. As this regard, the paper focuses on building an innovative software solution to streamline smart meter data analytic, aiming at dealing with the complexity of data processing and data analytics. The system offers an information integration pipeline to ingest smart meter data; scalable data processing and analytic platform for pre-processing and mining big smart meter data sets; and a web-based portal for visualizing data analytics results. The system incorporates hybrid technologies, including big data technologies Spark and Hive, the high performance RDBMS PostgreSQL with the in-database machine learning toolkit, MADlib, which are able to satisfy a variety of requirements in smart meter data analytics.
Streamlining Smart Meter Data Analytics
Today smart meters are increasingly used in worldwide. Smart meters are the advanced meters capable of measuring customer energy consumption at a fine-grained time interval, e.g., every 15 minutes. The data are very sizable, and might be from different sources, along with the other social-economic metrics such as the geographic information of meters, the information about users and their property, geographic location and others, which make the data management very complex. On the other hand, data-mining and the emerging cloud computing technologies make the collection, management, and analysis of the so-called big data possible. This can improve energy management, e.g., help utilities improve the management of energy and services, and help customers save money. As this regard, the paper focuses on building an innovative software solution to streamline smart meter data analytic, aiming at dealing with the complexity of data processing and data analytics. The system offers an information integration pipeline to ingest smart meter data; scalable data processing and analytic platform for pre-processing and mining big smart meter data sets; and a web-based portal for visualizing data analytics results. The system incorporates hybrid technologies, including big data technologies Spark and Hive, the high performance RDBMS PostgreSQL with the in-database machine learning toolkit, MADlib, which are able to satisfy a variety of requirements in smart meter data analytics.
Streamlining Smart Meter Data Analytics
Liu, Xiufeng (author) / Nielsen, Per Sieverts (author)
2015-01-01
Liu , X & Nielsen , P S 2015 , Streamlining Smart Meter Data Analytics . in Proceedings of the 10th Conference on Sustainable Development of Energy, Water and Environment Systems . International Centre for Sustainable Development of Energy, Water and Environment Systems , 10th Conference on Sustainable Development of Energy, Water and Environment Systems , Dubrovnik , Croatia , 27/09/2015 .
Article (Journal)
Electronic Resource
English
DDC:
690
Energy Monitoring Platform: A High-Performance Smart Meter Data Analytics Engine
| BASE | 2021
SmartFog: Training the Fog for the energy-saving analytics of Smart-Meter data
| BASE | 2019
Sustainable Development with Smart Meter Data Analytics Using NoSQL and Self-Organizing Maps
| DOAJ | 2020