Menu
Data transformation
Extracted data are transformed and cleaned using ETL (Extract, Transform, Load) processes. During transformation, data are cleaned by correcting errors, duplicates, and irrelevancies. Data are normalized and enriched for use in various application contexts.
Data storage
The transformed and cleaned data are stored in the Data-Highway infrastructure in the cloud. Data storage is done according to the European standard NGSI-LD, promoting interoperability, analysis and efficient information retrieval.
Esposizione dei dati
I dati elaborati vengono esposti tramite API o interfacce utente, permettendo un accesso intuitivo e efficiente, sfruttando Artificial Intelligence quando necessario. Le API possono integrare i dati in altri sistemi o applicazioni esterne.
Data acquisition
Using a combination of web scraping and URL analysis, supported by machine learning, AI and LLM, linked data related to Sicily are extracted from provider sites, including government portals and open data provided by private operators, both large (such as OpenStreetMap) and local. Where APIs or an endpoint are available for direct access to the data, these methods are preferred to extract the data in a structured and efficient manner, building spatiotemporal queries for extraction.
Data processing and analysis
Stored data are ready for processing and analysis, meeting the needs of current and future applications. AI and LLM tools are used for natural language analysis and to extract useful insights from the data.
Monitoraggio e manutenzione
A continuous monitoring system ensures data availability and integrity. Regular maintenance processes are defined to update and manage changes in data and sources.
