REVIEW 3 major objections 4 minor 225 references
Big Data Energy Systems: A Survey of Practices and Associated Challenges
T0 review · 3 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Energy big data is stored well but integrated poorly, review finds
desk verdict A competent orientation survey of big data storage and integration for energy systems, undercut by a search strategy that cannot support its headline negative claims about P2P and DHT systems. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The review organises everything around the big-data value chain (acquisition, analysis and processing, storage and curation, services and visualisation) and a comparison table of storage technologies. This value-chain lens is the device that turns a loose set of 53 papers into a gap map: it shows where the chain breaks (integration and real-time access) and which storage options are already in use or missing in energy systems. A data-exchange reference architecture acts as the companion device that pins regulatory and interoperability requirements onto the technical comparison.
What would settle it
Repeat the same 12,290-hit search with additional academic databases and screen for energy-sector P2P or real-time data-integration systems published before 2025; if several such papers meet the inclusion criteria, the claim that these are unaddressed gaps collapses. A simpler check is to identify any utility or grid operator running a DHT-based or fully decentralised data-management layer in production.
Extended reading notes
Core claim
The paper's central discovery is a mapping, not a measurement: across 53 selected articles from 2016 to 2025, energy-system big data management concentrates on analytics and on a handful of storage technologies (relational databases, NoSQL, Hadoop, cloud, some blockchain), while data integration is comparatively thin and real-time integration is essentially absent. Each storage family has a characteristic bottleneck: relational systems scale poorly, NoSQL gives up consistency, Hadoop is batch-oriented and centralised, blockchain is slow and resource-hungry, and cloud creates vendor lock-in and data fragmentation. No current approach simultaneously delivers scalability, consistency, real-time response, and regulatory compliance, so the authors position peer-to-peer data management with distributed hash tables as the nearest unexploited path to decentralised, scalable, regulatory-friendly data management, noting that their search found no P2P data-management implementation in energy systems.
Load-bearing premise
The review's conclusion that P2P data management, real-time integration, and several related mechanisms are missing from energy systems rests on the assumption that its 53-article sample represents the whole field; if relevant work was missed by the title-and-abstract screening, the gap analysis would be wrong.
Editorial extensions
If this is right
- No single incumbent storage technology meets the energy sector's needs, so hybrid storage pairing NoSQL or DBMSs with peer-to-peer overlays is forwarded as a balanced route to scalability, security, and performance.
- Distributed hash tables are identified as a near-unexplored integration mechanism that would let stakeholders keep their own DBMSs while querying datasets from other systems that share a common architecture.
- Adopting data-space style governance and reference architectures would help energy stakeholders meet FAIR principles and regulatory data-sharing obligations.
- The absence of P2P data-management implementations in energy systems is treated as a research gap worth filling, not as evidence that the approach is infeasible.
- Real-time data integration remains unsupported by traditional ETL/ELT processes, pushing future designs toward edge computing and streaming technologies.
Reading between the lines
- Extension the paper leaves untested: hybrid NoSQL/DBMS-plus-P2P designs would need to beat cloud-only storage on measured latency, cost, and consistency in real smart-meter workloads before that recommendation becomes actionable.
- Inference from the gap analysis: the negative finding that no P2P data-management system exists for energy systems may partly reflect the screening and publication record rather than a true absence, so a grey-literature or industry-case search could change the conclusion.
- Testable extension: the paper's emphasis on governance implies that data-sharing success in energy depends at least as much on trust agreements, naming standards, and regulatory alignment as on any storage technology, and that prioritisation can be checked by comparing pilot projects that adopt data-space governance against those that adopt only new storage engines.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper is a rapid/narrative survey of big-data storage and integration practices in energy systems for the period 2016–2025. Starting from keyword searches across Web of Science, Google Scholar, IEEE Explorer, and journal websites, the authors reduce 12,290 hits to 53 articles and synthesize practices for relational databases, NoSQL, Hadoop, GFS, blockchain, P2P, and cloud storage, together with ETL/ELT, data fusion, and data-space integration approaches. The paper also reviews European regulatory and reference frameworks (DERA, IDS-RAM, OFGEM, DESAP) and concludes with recommendations, including a P2P/DHT-enhanced DERA architecture. The stated contribution is a gap analysis identifying weaknesses in scalability, integration, real-time processing, and regulatory compliance, intended as a guidebook for deploying big data technologies in energy systems.
Significance. If the gap analysis were reliable, the survey would be a useful orientation for practitioners and researchers in energy informatics, particularly for its synthesis of NoSQL/Hadoop/cloud limitations and its connection of data-management practice to European reference architectures and data-space initiatives. The paper gives a fair, balanced account of the trade-offs of each storage family and summarizes recent regulatory framework material (DERA 2.0/3.0, IDS-RAM, OFGEM). At the same time, the manuscript offers no machine-checked artifacts and its central claims are descriptive; the value of the survey depends on whether the 53-article corpus can support the strong absence claims that drive its recommendations.
major comments (3)
- [§1.2, §3.4.5, Table 3] The search protocol in §1.2 lists eight keyword phrases, all variants of 'big data' and 'large-scale data'; none include 'peer-to-peer,' 'P2P,' 'distributed hash table,' 'DHT,' 'structured overlay,' 'blockchain,' or 'NoSQL.' This makes the strong negative claims in §3.4.5 — that 'the implementations of P2P data management are scarce, and based on the current search, none are available for energy systems' — and Table 3's 'No case' entry for P2P Data Management an expected artifact of the query design rather than an evidence-based conclusion about the literature. The same problem afflicts §3.5.2, where 'we did not find approaches that support query processing while addressing efficient data integration challenges' is presented as a general finding. Because the P2P/DHT recommendations in §4.1–§4.3 are explicitly motivated by these gaps, the gap analysis needs to be re-run with technology-specific search terms, or all absence claims must be restricted to the reviewed corpus and the 'No case' entries must be removed.
- [§1.2, Figure 2] The screening pipeline is reported as 12,290 → 298 → 53, but the 53 included articles are never enumerated, and the inclusion/exclusion criteria are summarized only by the diagram in Figure 2. This makes the corpus non-auditable, which is especially consequential for negative claims: a single relevant energy-sector P2P/DHT or query-processing paper would overturn the claimed gaps, yet the reader cannot determine whether such a paper was considered. I recommend providing a supplementary list of the 53 articles (with references and screening decisions), or at minimum a transparent flow table, so that the representativeness of the evidence base can be checked.
- [§4.2, §4.3, Figure 10] The proposed DERA extension in §4.2 and §4.3 is presented as filling a gap: 'With DHT platforms, stakeholders would benefit from their existing DBMSs whilst having the advantage of easily accessing datasets from other systems,' and Figure 10 integrates P2P/DHT components into the reference architecture. The novelty of this proposal rests on the asserted absence of P2P data management in energy systems in §3.4.5, which, for the reasons above, the search cannot establish. The architectural idea may be reasonable, but it currently functions as a gap-filling contribution; it should be reframed as an open design direction or justified from the intrinsic properties of P2P systems (autonomy, scalability, fault tolerance), independent of an unsupported absence claim.
minor comments (4)
- [Title/Abstract] The title contains a typo, 'Associate d Challenges,' which should read 'Associated Challenges.'
- [§3.2.1] The phrase 'communication latency„ time costs' contains a stray character after 'latency' and should be cleaned up.
- [§1.2] The methods paragraph does not state the exact date the searches were run, and Figure 2 is schematic; adding the search date and the basis for the 298-article reduction would improve reproducibility.
- [Table 3] The row 'Distributed File Systems, i.e., GFS' lists 'Non-existent' for energy applications, while the text in §3.4.6 says 'To the best of the knowledge established in this work, the implementation of GFS in energy systems is non-existent'; the table should carry the same hedge.
Circularity Check
No significant circularity; the survey's claims are descriptive syntheses of an explicitly qualified corpus, not reductions to fitted inputs or load-bearing self-citations.
full rationale
This paper is a narrative/rapid literature review, not a derivation. Its central claims—that big-data storage and integration approaches have characteristic limitations and that certain technologies are underexplored in energy systems—are supported by the 53-paper corpus and by cited external literature, not by any fitted parameter or by construction. The strongest negative claims are explicitly qualified: §3.4.5 says P2P implementations are 'scarce, and based on the current search, none are available for energy systems,' and §3.5.2 says 'In our review, we did not find approaches that support query processing while addressing efficient data integration challenges.' These are transparent statements about the sample obtained with the listed keywords, not predictions derived from that sample, so the skeptic's search-coverage objection is a correctness/coverage limitation rather than a circularity. The author group's own prior works ([66], [70], [83]) are cited as domain examples and background; none is used as a load-bearing uniqueness theorem, ansatz, or fitted input, and they are externally available published work. No self-definitional relationship, renamed known result, or imported-uniqueness pattern appears. The survey therefore has no circular derivation chain.
Assumptions & free parameters
assumptions (4)
- domain assumption The 53 selected articles are representative of the state of the art in big data management for energy systems.
- domain assumption Energy system data volumes and velocities exceed the capacity of traditional relational management.
- domain assumption DERA and IDSA data space frameworks are valid models for European energy data exchange.
- ad hoc to paper Combining P2P overlays with DHTs inside a DERA-style architecture will improve scalability, security, and performance in energy systems.
Cite this review
Pith. "Pith review of Big Data Energy Systems: A Survey of Practices and Associated Challenges." pith.science (2026). https://pith.science/paper/XNAMVZYU
@misc{pith2026250719154,
author = {Pith},
title = {Pith review of: Big Data Energy Systems: A Survey of Practices and Associated Challenges},
year = {2026},
howpublished = {\url{https://pith.science/paper/XNAMVZYU}},
note = {Machine review of arXiv:2507.19154}
}
read the original abstract
Energy systems generate vast amounts of data in extremely short time intervals, creating challenges for efficient data management. Traditional data management methods often struggle with scalability and accessibility, limiting their usefulness. More advanced solutions, such as NoSQL databases and cloud-based platforms, have been adopted to address these issues. Still, even these advanced solutions can encounter bottlenecks, which can impact the efficiency of data storage, retrieval, and analysis. This review paper explores the research trends in big data management for energy systems, highlighting the practices, opportunities and challenges. Also, the data regulatory demands are highlighted using chosen reference architectures. The review, in particular, explores the limitations of current storage and data integration solutions and examines how new technologies are applied to the energy sector. Novel insights into emerging technologies, including data spaces, various data management architectures, peer-to-peer data management, and blockchains, are provided, along with practical recommendations for achieving enhanced data sharing and regulatory compliance.
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
-
[1]
Duarte, Amount of data created daily (2025), Webpage, accessed: 2025-07-07 (2025)
F. Duarte, Amount of data created daily (2025), Webpage, accessed: 2025-07-07 (2025)
2025
-
[2]
Pauline, Unleashing the benefits of data for energy sys tems (2023)
H. Pauline, Unleashing the benefits of data for energy sys tems (2023). URL https://www.iea.org/commentaries/unleashing-the-ben efits-of-data-for-energy-systems
2023
-
[3]
Sinha, State of iot 2024: Number of connected iot devic es growing 13% to 18.8 billion globally, accessed: 3 July 2025 (2024)
S. Sinha, State of iot 2024: Number of connected iot devic es growing 13% to 18.8 billion globally, accessed: 3 July 2025 (2024). URL https://iot-analytics.com/number-connected-iot-devi ces/
2024
-
[4]
S. M. Mahir, G. Koch, J. Herne, J. J. Lee, Data acquisition platform for the energy management of smart factories and buildings, in: 2023 17th International Confe rence on Ubiquitous Information Management and Communication (IMCOM), 2023, pp. 1–7. doi:10.1109/IMCOM56909.2023.10035546
-
[5]
J. Wang, F. Gao, Y . Zhou, Q. Guo, C.-W . Tan, J. Song, Y . Wang, Data sharing in energy systems, Advances in Applied Energy 10 (2023) 100132
2023
-
[6]
Krishnan, Smart electricity meter market 2024: Globa l adoption landscape, https://iot-analytics.com/smart-meter-adoption/ , accessed: 2025-07-07 (2024)
A. Krishnan, Smart electricity meter market 2024: Globa l adoption landscape, https://iot-analytics.com/smart-meter-adoption/ , accessed: 2025-07-07 (2024)
2024
-
[7]
Zhang, T
Y . Zhang, T. Huang, E. F. Bompard, Big data analytics in smart grids: a review, Energy informatics 1 (1) (2018) 1–24
2018
-
[8]
F. R. S. Sevilla, Y . Liu, E. Barocio, P . Korba, M. Andrade, F. Bellizio, J. Bos, B. Chaudhuri, H. Chavez, J. Cre- mer, et al., State-of-the-art of data collection, analytic s, and future needs of transmission utilities worldwide to account for the continuous growth of sensing data, Internat ional journal of electrical power & energy systems 137 (2022) 107772
2022
Show all 225 references
-
[9]
Sarker, M
S. Sarker, M. S. Arefin, M. Kowsher, T. Bhuiyan, P . K. Dhar, O. J. Kwon, A comprehensive re- view on big data for industries: Challenges and opportuniti es, Ieee Access 11 (2023) 744–769. doi:10.1109/access.2022.3232526
2023
-
[10]
Jiang, K
H. Jiang, K. Wang, Y . Wang, M. Gao, Y . Zhang, Energy big data: A survey, IEEE Access 4 (2016) 3844–3861
2016
-
[11]
Freitas, A
N. Freitas, A. D. Rocha, J. Barata, Data management in in dustry: concepts, systematic review and future directions, Journal of Intelligent Manufacturing (2025) 1 –29
2025
-
[12]
K. G, S. P . A. L, A survey on big data classification, Data & Knowledge Engineering 156 (2025) 102408. doi:10.1016/j.datak.2025.102408. URL https://www.sciencedirect.com/science/article/pii/S0169023X25000035
2025
-
[13]
Faridoon, M
A. Faridoon, M. Imran, Big data storage tools using nosq l databases and their applications in various domains: A systematic review, Computing & Informatics 40 (3) (2021)
2021
-
[14]
Mazumdar, D
S. Mazumdar, D. Seybold, K. Kritikos, Y . V erginadis, A s urvey on data storage and placement methodologies for cloud-big data ecosystem, Journal of Big Data 6 (1) (2019 ) 1–37
2019
-
[15]
Siddiqa, A
A. Siddiqa, A. Karim, A. Gani, Big data storage technolo gies: a survey, Frontiers of Information Technology & Electronic Engineering 18 (2017) 1040–1070
2017
-
[16]
C. Xu, X. Du, X. Fan, G. Giuliani, Z. Hu, W . Wang, J. Liu, T. Wang, Z. Y an, J. Zhu, T. Jiang, H. Guo, Cloud- based storage and computing for remote sensing big data: a te chnical review, International Journal of Digital Earth 15 (1) (2022) 1417–1445. doi:10.1080/17538947.202...
2022
-
[17]
W . X. Liu, J. H. Zhao, D. H. Wang, Data mining for energy sy stems: Review and prospect, Wiley Interdisci- plinary Reviews-Data Mining and Knowledge Discovery 11 (4) (2021) 18. doi:10.1002/widm.1406. 28
2021 doi
-
[18]
Oussous, F.-Z
A. Oussous, F.-Z. Benjelloun, A. A. Lahcen, S. Belfkih, Big data technologies: A survey, Journal of King Saud University-Computer and Information Sciences 30 (4) (2018 ) 431–448
2018
-
[19]
Jaramillo, D
M. Jaramillo, D. Carrión, J. Muñoz, L. Tipán, A bibliome tric assessment of ai, iot, blockchain, and big data in renewable energy-oriented power systems, Energies 18 (12) (2025) 3067
2025
-
[20]
Sadhu, J
A. Sadhu, J. E. Peplinski, A. Mohammadkhorasani, F. Mor eu, A review of data management and visualization techniques for structural health monitoring using bim and v irtual or augmented reality, Journal of Structural Engineering 149 (1) (2023) 18. doi:10.1061/(asce)st.1943-541...
2023 doi
-
[21]
Alsolbi, F
I. Alsolbi, F. H. Shavaki, R. Agarwal, G. K. Bharathy, S. Prakash, M. Prasad, Big data optimisation and man- agement in supply chain management: a systematic literatur e review, Artificial Intelligence Review 56 (SUPPL
- [22]
-
[23]
Khanna, N
D. Khanna, N. Jindal, H. Singh, P . S. Rana, Applications and challenges in healthcare big data: A strategic review, Current Medical Imaging 19 (1) (2023) 27–36. doi:10.2174/1573405618666220308113707
2023 doi
-
[24]
Abdelrahman, P
Y . Abdelrahman, P . Hajek, H. Lubica, Research trends in the application of big data in smart cities-a literature review, Canadian Journal of Administrative Sciences-Revu e Canadienne Des Sciences De L Administration 40 (3) (2023) 254–269. doi:10.1002/cjas.1734
2023 doi
-
[25]
Nathan, C
R. Nathan, C. T. Monk, R. Arlinghaus, T. Adam, J. Alós, M. Assaf, H. Baktoft, C. E. Beardsworth, M. G. Bertram, A. I. Bijleveld, T. Brodin, J. L. Brooks, A. Campos- Candela, S. J. Cooke, K. O. Gjelland, P . R. Gupte, R. Harel, G. Hellström, F. Jeltsch, S. S. Killen, T. Klefoth...
2022
-
[26]
Karatas, L
M. Karatas, L. Eriskin, M. Deveci, D. Pamucar, H. Garg, B ig data for healthcare industry 4.0: Applications, challenges and future perspectives, Expert Systems with Applications 200 (2022) 15. doi:10.1016/j.eswa.2022.116912
2022
-
[27]
Cravero, S
A. Cravero, S. Pardo, S. Sepúlveda, L. Muñoz, Challenge s to use machine learning in agricultural big data: A systematic literature review, Agronomy-Basel 12 (3) (2022 ) 34. doi:10.3390/agronomy12030748
2022 doi
-
[28]
Hajjaji, W
Y . Hajjaji, W . Boulila, I. R. Farah, I. Romdhani, A. Huss ain, Big data and iot-based applications in smart environments: A systematic review, Computer Science Revie w 39 (2021) 100318
2021
-
[29]
Z. B. Bai, X. M. Bai, Sports big data: Management, analys is, applications, and challenges, Complexity 2021 (2021) 11. doi:10.1155/2021/6676297
2021 doi
-
[30]
Theodorakopoulos, A
L. Theodorakopoulos, A. Theodoropoulou, Y . Stamatiou , A state-of-the-art review in big data management engineering: Real-life case studies, challenges, and futu re research directions, Eng 5 (3) (2024) 1266–1297
2024
-
[31]
Boopathy, M
P . Boopathy, M. Liyanage, N. Deepa, M. V elavali, S. Redd y, P . K. R. Maddikunta, N. Khare, T. R. Gadekallu, W . J. Hwang, Q. V . Pham, Deep learning for intelligent demand response and smart grids: A comprehensive survey, Computer Science Review 51 (2024) 26. doi:10.1016/j....
2024
-
[32]
M. F. Khan, M. Azam, M. A. Khan, F. Algarni, M. Ashfaq, I. A hmad, I. Ullah, A review of big data resource management: Using smart grid systems as a case study, Wirele ss Communications & Mobile Computing 2021 (2021) 18. doi:10.1155/2021/3740476
2021 doi
-
[33]
Zainab, A
A. Zainab, A. Ghrayeb, D. Syed, H. Abu-Rub, S. S. Refaat, O. Bouhali, Big data management in smart grids: Technologies and challenges, IEEE Access 9 (2021) 73046–73 059
2021
-
[34]
Kolajo, O
T. Kolajo, O. Daramola, A. Adebiyi, Big data stream anal ysis: a systematic literature review, Journal of Big Data 6 (1) (2019) 47. doi:10.1186/s40537-019-0210-7 . 29
2019 doi
-
[35]
Y . Hou, Q. Wang, Big data and artificial intelligence app lication in energy field: a bibliometric analysis, Envi- ronmental Science and Pollution Research 30 (6) (2023) 1396 0–13973
2023
-
[36]
H. Liao, E. Michalenko, S. C. V egunta, Review of big data analytics for smart electrical energy systems, Ener- gies 16 (8) (2023) 3581. URL https://www.mdpi.com/1996-1073/16/8/3581
2023
-
[37]
Tranfield, D
D. Tranfield, D. Denyer, P . Smart, Towards a methodology for developing evidence-informed management knowledge by means of systematic review, British journal of management 14 (3) (2003) 207–222
2003
-
[38]
Smela, M
B. Smela, M. Toumi, K. ´Swierk, C. Francois, M. Biernikiewicz, E. Clay, L. Boyer, Ra pid lit- erature review: definition and methodology, J Mark Access He alth Policy 11 (1) (2023) 2241234. doi:10.1080/20016689.2023.2241234
2023
-
[39]
Taherdoost, Towards nuts and bolts of conducting lit erature review: A typology of literature review, Elec- tronics 12 (4) (2023) 800
H. Taherdoost, Towards nuts and bolts of conducting lit erature review: A typology of literature review, Elec- tronics 12 (4) (2023) 800
2023
-
[40]
Rusitschka, E
S. Rusitschka, E. Curry, Big data in the energy and trans port sectors, New Horizons for a Data-Driven Econ- omy: A Roadmap for Usage and Exploitation of Big Data in Europ e (2016) 225–244
2016
-
[41]
I. A. T. Hashem, V . Chang, N. B. Anuar, K. Adewole, I. Y aqo ob, A. Gani, E. Ahmed, H. Chiroma, The role of big data in smart city, International Journal of informatio n management 36 (5) (2016) 748–758
2016
-
[42]
De Mauro, M
A. De Mauro, M. Greco, M. Grimaldi, A formal definition of big data based on its essential features, Library review 65 (3) (2016) 122–135
2016
-
[43]
Soomro, Mastering the 10 vs of big data (2023)
H. Soomro, Mastering the 10 vs of big data (2023). URL https://datasciencedojo.com/blog/10-vs-of-big-data/ #
2023
-
[44]
Leonowicz, M
Z. Leonowicz, M. Jasinski, Machine learning and data mi ning applications in power systems, Energies 15 (5) (2022) 1676. URL https://www.mdpi.com/1996-1073/15/5/1676
2022
-
[45]
H. Lin, A. Slagell, Z. Kalbarczyk, P . W . Sauer, R. K. Iyer , Semantic security analysis of scada networks to detect malicious control commands in power grids (2013). doi:10.1145/2516930.2516947
2013
-
[46]
H. P . Kothandapani, Emerging trends and technological advancements in data lakes for the financial sector: An in-depth analysis of data processing, analytics, and infra structure innovations, Quarterly Journal of Emerging Technologies and Innovations 8 (2) (2023) 62–75
2023
-
[47]
Horvath, M
K. Horvath, M. R. Abid, T. Merino, R. Zimmerman, Y . Peker , S. Khan, Cloud-based infras- tructure and devops for energy fault detection in smart buil dings, Computers 13 (1) (2024) 12. doi:10.3390/computers13010023
2024 doi
-
[48]
S. B. Bajaj, A. Jatain, S. Chaudhary, P . Nagpal, Cloud st orage architecture: Issues, challenges and op- portunities, International Journal of Innovative Researc h in Computer Science & Technology 9 (3) (2021). doi:10.21276/ijircst.2021.9.3.12
2021 doi
-
[49]
Iberdrola, Smart meters, a building block for the digit isation of the grid (2023)
2023
-
[50]
Hannah, R
R. Hannah, R. Pablo, R. Max, Energy production and consu mption (2020). URL https://ourworldindata.org/energy-production-consum ption#article-citation
2020
-
[51]
J. S. Jones, 326 million smart meters across europe by 20 28 – report, Report, Smart Energy Interna- tional, https: //www.smart-energy.com/industry-sectors/smart-meters/326-million-smart-meters-across-europe- by-2028-report/ (26/02/2024 2024). 30
2024
-
[52]
W . J. Y ang, Analysis and application of big data feature extraction based on improved k-means algorithm, Scalable Computing-Practice and Experience 25 (1) (2024) 1 0. doi:10.12694/scpe.v25i1.2281
2024 doi
-
[53]
Tudora, E
E. Tudora, E. Tirziu, Advanced approaches in building e nergy consumption prediction, Romanian Journal of Information Technology and Automatic Control-Revista Rom ana De Informatica Si Automatica 34 (2) (2024)
2024
-
[54]
doi:10.33436/v34i2y202402
-
[55]
Padmanaban, Y
K. Padmanaban, Y . B. Kalpana, M. Geetha, K. Balan, V . Mani, S. S. Sivaraju, Simulation and modeling in cloud computing-based smart grid power big data analysis technol ogy, International Journal of Modeling Simulation and Scientific Computing (2024) 27 doi:10.1142/s1793962325410053
2024 doi
-
[56]
Y . Gao, D. W . Y an, X. Y . Kong, N. Liu, Z. Y . Zou, B. X. Gao, Y . Wang, Y . Chen, S. Luo, A data- driven analysis method for the trajectory of power carbon em ission in the urban area, Big Data (2023) 17doi:10.1089/big.2022.0299
2023
-
[57]
Shen, Carbon reduction assessment of public buildin gs based on apriori algorithm and intelligent big data analysis, Soft Computing (2023) 10 doi:10.1007/s00500-023-08405-4
X. Shen, Carbon reduction assessment of public buildin gs based on apriori algorithm and intelligent big data analysis, Soft Computing (2023) 10 doi:10.1007/s00500-023-08405-4
2023 doi
-
[58]
Khalil, M
M. Khalil, M. Esseghir, L. M. Boulahia, Privacy-preser ving federated learning: An application for big data load forecast in buildings, Computers & Security 131 (2023) 9. doi:10.1016/j.cose.2023.103211
2023
-
[59]
V arlamis, C
I. V arlamis, C. Sardianos, C. Chronis, G. Dimitrakopou los, Y . Himeur, A. Alsalemi, F. Bensaali, A. Amira, Using big data and federated learning for generating energy efficiency recommendations, International Journal of Data Science and Analytics 16 (3) (2023) 353–369. doi:10....
2023 doi
-
[60]
N. Feng, Y . G. Wang, Z. G. Chen, T. T. Song, The status quo a nd development countermeasures of venture capital in the new energy economy based on big data analysis, Journal of Database Management 34 (1) (2023)
2023
-
[61]
doi:10.4018/jdm.322019
-
[62]
Mouzakitis, O
S. Mouzakitis, O. Markaki, K. Papapostolou, E. Karakol is, S. Pelekis, J. Psarras, Enhancing decision support systems for the energy sector with sustainable artificial in telligence solutions, in: Intelligent Systems Confer- ence (IntelliSys), V ol. 823 of Lecture Notes in Netw...
2024 doi
-
[63]
Mostafa, H
N. Mostafa, H. S. M. Ramadan, O. Elfarouk, Renewable ene rgy management in smart grids by using big data analytics and machine learning, Machine Lear ning with Applications 9 (2022) 12. doi:10.1016/j.mlwa.2022.100363
2022
-
[64]
L. L. Zhu, J. F. Shi, Y . H. Shi, H. P . Xu, A. Shanthini, T. G. Seetharam, Renewable green energy resources for next-generation smart cities using big data analytics, Jou rnal of Interconnection Networks 22 (SUPP01) (2022)
2022
-
[65]
doi:10.1142/s0219265921410048
-
[66]
Ikhlasse, D
H. Ikhlasse, D. Benjamin, C. Vincent, M. Hicham, Recent implications towards sustainable and energy efficient ai and big data implementations in cloud-fog systems: A news worthy inquiry, Journal of King Saud University- Computer and Information Sciences 34 (10) (2022) 8867–8887 ...
2022 doi
-
[67]
Soderi, V
M. Soderi, V . Kamath, J. G. Breslin, Ieee, A demo of a soft ware platform for ubiquitous big data engi- neering, visualization, and analytics, via reconfigurable micro-services, in smart factories, in: 8th IEEE International Conference on Smart Computing (SMARTCOMP), Ieee, NEW...
2022
-
[68]
R. H. Hariri, E. M. Fredericks, K. M. Bowers, Uncertaint y in big data analytics: survey, opportunities, and challenges, Journal of Big data 6 (1) (2019) 1–16
2019
-
[69]
S. B. Abkenar, M. H. Kashani, E. Mahdipour, S. M. Jameii, Big data analytics meets social media: A sys- tematic review of techniques, open issues, and future direc tions, Telematics and Informatics 57 (2021) 38. doi:10.1016/j.tele.2020.101517. 31
2021
-
[70]
Sundsgaard, J
K. Sundsgaard, J. Z. Hansen, G. Y ang, M. Cafaro, P . K. Han sen, Exploring data collection and fusion of medium voltage cable failures-a danish case study, in: 2023 IEEE PES Innovative Smart Grid Technologies Europe (ISGT EUROPE), IEEE, 2023, pp. 1–5
2023
-
[71]
Maatallah, M
M. Maatallah, M. Fariss, H. Asaidi, M. Bellouki, Real-t ime data processing and big data analytics: A compar- ative study of modern platforms, in: The Proceedings of the I nternational Conference on Smart City Applica- tions, Springer, 2025, pp. 93–101
2025
-
[72]
J. C. Liu, C. H. Hsu, J. H. Zhang, E. Kristiani, C. T. Y ang, An event-based data processing sys- tem using kafka container cluster on kubernetes environmen t, Neural Computing & Applications (2023) 18doi:10.1007/s00521-023-08326-1
2023 doi
-
[73]
T. S. Sreedhar, S. Islam, M. Atmosa, E. Y azdandoust, M. S . Elnaim, S. Mishra, V . Naresh, V . R. Bajpai, Applications of big data in renewable energy systems based o n cloud computing, International Journal on Information Technologies and Security 16 (3) (2024) 121–12 8
2024
-
[74]
Sundsgaard, J
K. Sundsgaard, J. Z. Hansen, L. J. Mwinuka, G. Y ang, M. Ca faro, A decentralised relational data model for reliability studies of medium-voltage cables, IEEE ISGT Eu rope (2024)
2024
-
[75]
Bölat, S
K. Bölat, S. H. Tindemans, P . Palensky, Stable training of probabilistic models using the leave-one-out maxi- mum log-likelihood objective, Electric Power Systems Rese arch 235 (2024) 110775
2024
-
[76]
M. Gui, A. Pahwa, S. Das, Bayesian network model with mon te carlo simulations for analysis of animal-related outages in overhead distribution systems, IEEE Transactio ns on Power Systems 26 (3) (2011) 1618–1624
2011
-
[77]
Salboukh, Y
F. Salboukh, Y . Mousavi, I. B. Kucukdemiral, A. Fekih, U . Cali, Reliability assessment and condition moni- toring of wind energy conversion systems using bayesian net works: Recent advances and key insights, IEEE Access (2025)
2025
-
[78]
T. P . Abud, A. A. Augusto, M. Z. Fortes, R. S. Maciel, B. S. M. C. Borba, State of the art Monte Carlo method applied to power system analysis with distributed generati on, Energies 16 (1) (2022) 394
2022
-
[79]
Coronel, S
C. Coronel, S. Morris, Database Systems: Design, Imple mentation, and Management, 14th Edition, Cengage learning, United States of America, 2023
2023
-
[80]
M. A. Mohamed, O. G. Altrafi, M. O. Ismail, Relational vs. nosql databases: A survey, International Journal of Computer and Information Technology 3 (03) (2014) 598–601
2014
-
[81]
Adiba, J.-C
M. Adiba, J.-C. Castrejon-Castillo, J. A. E. Oviedo, G. V argas-Solar, J.-L. Zechinelli-Martini, Big data man- agement challenges, approaches, tools and their limitatio ns, Networking for big data (2016)
2016
-
[82]
Madison, M
M. Madison, M. Barnhill, C. Napier, J. Godin, Nosql data base technologies, Journal of International Technol- ogy and Information Management 24 (1) (2015) 1
2015
-
[83]
W . Khan, T. Kumar, C. Zhang, K. Raj, A. M. Roy, B. Luo, Sql a nd nosql database software architecture performance analysis and assessments—a systematic litera ture review, Big Data and Cognitive Computing 7 (2) (2023) 97
2023
-
[84]
B. M. Ma’mirovna, Enhancing data management e fficiency with modern database systems, Miasto Przyszło ´sci 54 (2024) 232–235
2024
-
[85]
J. O. Padallan, Distributed Database Architecture, Ar cler Press, Burlington„ 2021
2021
-
[86]
M. T. Özsu, P . V alduriez, Principles of distributed database systems, 4th Edition, V ol. 4, Springer, 2020
2020
-
[87]
Cafaro, I
M. Cafaro, I. Epicoco, M. Pulimeno, Special issue on par allel and distributed data mining, Information Sciences 496 (2019) 284–286. doi:10.1016/j.ins.2019.05.062. 32
2019 doi
-
[88]
T. Erl, R. Puttini, Z. Mahmood, Cloud computing: concep ts, technology & architecture, Pearson Education, 2013
2013
-
[89]
Andronie, G
M. Andronie, G. Lazaroiu, O. L. Karabolevski, R. Stefan escu, I. Hurloiu, A. Dijmarescu, I. Dij- marescu, Remote big data management tools, sensing and comp uting technologies, and visual percep- tion and environment mapping algorithms in the internet of r obotic things, Elect...
2023 doi
-
[90]
U. M. Rao, J. K. R. Sastry, Enhanced feature-driven mult i-objective learning for optimal cloud resource allocation, Scalable Computing-Practice and Exp erience 25 (3) (2024) 1963–1979. doi:10.12694/scpe.v25i3.2689
2024 doi
-
[91]
Choudhary, M
A. Choudhary, M. C. Govil, G. Singh, L. K. A wasthi, E. S. P illi, Energy-aware scientific workflow scheduling in cloud environment, Cluster Computing-the Journal of Net works Software Tools and Applications 25 (6) (2022) 3845–3874. doi:10.1007/s10586-022-03613-3
2022 doi
-
[92]
Xiang, Large scale graph data processing technology on cloud computing environments, in: 2023 International Conference on Networking, Informatics and C omputing (ICNETIC), 2023, pp
Y . Xiang, Large scale graph data processing technology on cloud computing environments, in: 2023 International Conference on Networking, Informatics and C omputing (ICNETIC), 2023, pp. 819–823. doi:10.1109/ICNETIC59568.2023.00173
2023
-
[93]
W . A. Günther, M. H. R. Mehrizi, M. Huysman, F. Feldberg, Debating big data: A literature review on realizing value from big data, The Journal of Strategic Information Sy stems 26 (3) (2017) 191–209
2017
-
[94]
Tran, Scalable data-management systems for Big D ata, Theses, École normale supérieure de Cachan - ENS Cachan (Jan
V .-T. Tran, Scalable data-management systems for Big D ata, Theses, École normale supérieure de Cachan - ENS Cachan (Jan. 2013). URL https://theses.hal.science/tel-00920432
2013
-
[95]
M. J. Amiri, D. Agrawal, A. El Abbadi, Modern large-scal e data management systems after 40 years of consen- sus, in: 2020 IEEE 36th International Conference on Data Eng ineering (ICDE), IEEE, 2020, pp. 1794–1797
2020
-
[96]
M. J. Amiri, Large-scale data management using permiss ioned blockchains, University of California, Santa Barbara, 2020
2020
-
[97]
El Abbadi, Fault-tolerant, secure large scale data m anagement in a new world, in: The fourth paradigm: from data to discovery, Bhopal, India, 2020, pp
A. El Abbadi, Fault-tolerant, secure large scale data m anagement in a new world, in: The fourth paradigm: from data to discovery, Bhopal, India, 2020, pp. 1–10, https ://conf.iiserb.ac.in/thefourthparadigm/
2020
-
[98]
A. K. Bapatla, D. Puthal, S. P . Mohanty, V . P . Y anambaka, E. Kougianos, Easychain: an iot- friendly blockchain for robust and energy-e fficient authentication, Frontiers in Blockchain 6 (2023) 19. doi:10.3389/fbloc.2023.1194883
2023
-
[99]
Z. H. Lv, A. K. Singh, Big data analysis of internet of thi ngs system, Acm Transactions on Internet Technology 21 (2) (2021) 15. doi:10.1145/3389250
2021 doi
-
[100]
C. T. Y ang, S. T. Chen, J. C. Liu, R. H. Liu, C. L. Chang, On c onstruction of an energy monitoring service using big data technology for the smart campus, Cluster Comp uting-the Journal of Networks Software Tools and Applications 23 (1) (2020) 265–288. doi:10.1007/s10586-019-02921-5
2020 doi
-
[101]
T. Shu, C. Q. Wu, Energy-e fficient mapping of large-scale workflows under deadline const raints in big data computing systems, Future Generation Computer Systems-th e International Journal of Escience 110 (2020) 515–530. doi:10.1016/j.future.2017.07.050
2020 doi
-
[102]
Vijayakumari, R
R. Vijayakumari, R. Kirankumar, K. G. Rao, Comparative analysis of google file system and hadoop distributed file system, International Journal of Advanced Trends in Com puter Science and Engineering 3 (1) (2014) 553– 558
2014
-
[103]
X. Pan, Z. Luo, L. Zhou, Navigating the landscape of dist ributed file systems: Architectures, implementations, and considerations, arXiv preprint arXiv:2403.15701 (202 4). 33
-
[104]
URL https://www.ibm.com/docs/en/i/7.4?topic=database-se curity-considerations-distributed-relationa
IBM, Security considerations for a distributed relat ional database (11/04/2023 2023). URL https://www.ibm.com/docs/en/i/7.4?topic=database-se curity-considerations-distributed-relationa
2023
-
[105]
Z. Lv, W . Deng, Z. Zhang, N. Guo, G. Y an, A data fusion and data cleaning system for smart grids big data, in: 2019 IEEE Intl Conf on Parallel & Distribu ted Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communicat ions, Social Computing &...
2019
-
[106]
T. Z. Emara, T. Trinh, J. Z. Huang, Geographically dist ributed data management to support large-scale data analysis, Scientific Reports 13 (1) (2023) 17783
2023
-
[107]
Akram, S
A. Akram, S. Abbas, M. Khan, A. Athar, T. Ghazal, H. Al Ha madi, Smart energy management system using machine learning, Computers, Materials & Continua 78 (1) (2 024)
-
[108]
Mili´c, Next-generation data center energy management: a data-d riven decision-making framework, Frontiers in Energy Research 12 (2024) 1449358
V . Mili´c, Next-generation data center energy management: a data-d riven decision-making framework, Frontiers in Energy Research 12 (2024) 1449358
2024
-
[109]
IEA, Energy end-use data collection methodologies an d the emerging role of digital technologies, Report, International Energy Agency (2020)
2020
-
[110]
O’Dwyer, I
E. O’Dwyer, I. Pan, S. Acha, N. Shah, Smart energy syste ms for sustainable smart cities: Current developments, tre nds and future Applied Energy 237 (2019) 581–597. doi:10.1016/j.apenergy.2019.01.024. URL https://www.sciencedirect.com/science/article/pii/S0306261919300248
2019 doi
-
[111]
Mohammadi, Y
M. Mohammadi, Y . Noorollahi, B. Mohammadi-ivatloo, M . Hosseinzadeh, H. Y ousefi, S. T. Khorasani, Opti- mal management of energy hubs and smart energy hubs–a review , Renewable and Sustainable Energy Reviews 89 (2018) 33–50
2018
-
[112]
J. Dean, S. Ghemawat, Mapreduce: simplified data proce ssing on large clusters, Communications of the ACM 51 (1) (2008) 107–113
2008
-
[113]
Brahem, K
M. Brahem, K. Zeitouni, L. Y eh, Astroide: a unified astr onomical big data processing engine over spark, IEEE Transactions on Big Data 6 (3) (2018) 477–491
2018
-
[114]
Cheng, S
B. Cheng, S. Longo, F. Cirillo, M. Bauer, E. Kovacs, Bui lding a big data platform for smart cities: Experience and lessons from santander, in: 2015 IEEE International Con gress on Big Data, IEEE, 2015, pp. 592–599
2015
-
[115]
Cassandras, L
C. Cassandras, L. Hutyra, E. Silva, E. Terzi, Bic a smar t-city cloud-based open platform and ecosystem (scope), Report, Boston university (2016). URL https://www.bu.edu/cise/research/pfibic-a-smart-cit y-cloud-based-open-platform-and-ecosystem
2016
-
[116]
Zahariadis, A
T. Zahariadis, A. Papadakis, F. Alvarez, J. Gonzalez, F. Lopez, F. Facca, Y . Al-Hazmi, Fiware lab: managing resources and services in a cloud federation supporting fut ure internet applications, in: 2014 IEEE /ACM 7th International Conference on Utility and Cloud Computing, I...
2014
-
[117]
Farao, C
A. Farao, C. Ntantogian, C. Istrate, G. Suciu, C. Xenak is, Sealedgrid: Scalable, trusted, and interoperable platform for secured smart grid, in: 6th International Symp osium for ICS & SCADA Cyber Security Research 2019, BCS Learning & Development, 2019, pp. 74–81
2019
-
[118]
M. Li, K. Zhang, J. Liu, H. Gong, Z. Zhang, Blockchain-b ased anomaly detection of electricity consumption in smart grids, Pattern Recognition Letters 138 (2020) 476– 482
2020
-
[119]
M. Li, Z. Fang, W . W . Cao, Y . Ma, S. Wu, Y . Guo, Y . Xue, R. F.Mansour, Residential electricity classification method based on cloud computing platform and random forest, Computer Systems Science and Engineering 38 (1) (2021) 39–46. doi:10.32604/csse.2021.016189. 34
2021
-
[120]
I. S. Ibrahim, F. Rabee, Smart cities population class ification using hadoop mapreduce, in: 3rd Doctoral Sym- posium on Computational Intelligence (DoSCI), V ol. 479 of Lecture Notes in Networks and Systems, Springer International Publishing Ag, CHAM, 2023, pp. 165–179. doi:10...
2023 doi
-
[121]
Shyam, H
R. Shyam, H. B. Bharathi Ganesh, S. Kumar, P . Poornachandran, K. P . Soman, Apache spark a big data analytics platform for smart grid, Procedia Technology 21 (2015) 171– 178
2015
-
[122]
Katsaragakis, D
M. Katsaragakis, D. Masouros, L. Papadopoulos, F. Cat thoor, D. Soudris, Ieee, On the implications of hetero- geneous memory tiering on spark in-memory analytics, in: 37 th IEEE International Parallel and Distributed Processing Symposium (IPDPS), IEEE International Symposi um ...
2023
-
[123]
G. Lingam, Reinforcement learning based energy e fficient resource allocation strategy of mapreduce jobs with deadline constraint, Cluster Computing-the Journal of Networks Software Tools and Applications 26 (5) (2023) 2719–2735. doi:10.1007/s10586-022-03761-6
2023 doi
-
[124]
Cioara, C
T. Cioara, C. Pop, R. Zanc, I. Anghel, M. Antal, I. Salom ie, Smart grid management using blockchain: fu- ture scenarios and challenges, in: 2020 19th RoEduNet confe rence: Networking in education and research (RoEduNet), IEEE, 2020, pp. 1–5
2020
-
[125]
I. J. Abad, E. Lambert, B. Bak-Jensen, F. Lampathaki, F . Bosco, E. Maqueda, F. Coelho, G. Papadopoulos, A. Dognini, K. Piotrowski, M. Farré, W . Radziszewska, J. F. G onzalez, D. Sebilleau, O. Genest, D. Siksnys, I. Kokos, M. Tosic, G. Korjus, G. Y ang, European (energy) data...
2023 doi
-
[126]
D. S. B. Alliance, Unleashing the european data econom y (n.d.). URL https://data-spaces-business-alliance.eu/
-
[127]
K. K. Kalle Kukk, European (energy) data exchange refe rence architecture 2.0 – Data Management Working Group – June 2022, Publications O ffice of the European Union, 2023. doi:doi/10.2833/142689
2022 doi
-
[128]
Schweichhart, Reference architectural model indu strie 4.0 (rami 4.0), An Introduction 40 (2016)
K. Schweichhart, Reference architectural model indu strie 4.0 (rami 4.0), An Introduction 40 (2016)
2016
-
[129]
Fremantle, A reference architecture for the intern et of things, WSO2 White paper (2015) 02–04
P . Fremantle, A reference architecture for the intern et of things, WSO2 White paper (2015) 02–04
2015
-
[130]
Commission, Digitalising the energy system - eu act ion plan, Report, European Union (18 October 2022 2022)
E. Commission, Digitalising the energy system - eu act ion plan, Report, European Union (18 October 2022 2022). URL https://eur-lex.europa.eu/legal-content/EN/TXT/?uri =CELEX%3A52022DC0552&qid=1666369684560
2022
-
[131]
Department for Business, I
E. Department for Business, I. Strategy, Digitalisin g our energy system for net zero: Strategy and action plan 202 1, Report, Department Business, Energy and Industrial Strate gy (2021). URL https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/fi
2021
-
[132]
URL https://www.iea.org/energy-system/decarbonisation-e nablers/digitalisation
IEA, Energy digitalisation (2023). URL https://www.iea.org/energy-system/decarbonisation-e nablers/digitalisation
2023
-
[133]
Turkmayali, N
A. Turkmayali, N. Gras, Making the dataspace protocol an international standard (Jul. 2024). doi:10.5281/zenodo.12663036
2024 doi
-
[134]
Giussani, S
G. Giussani, S. Steinbuss, N. Gras, T. Prasse, Data con nector report, Report, IDSA (September 2024). doi:10.5281/zenodo.13838396
2024 doi
-
[135]
Janev, M
V . Janev, M. E. Vidal, K. Endris, D. Pujic, M. Assoc Comp , Managing knowledge in energy data spaces, in: 30th World Wide Web (WWW) Conference (WebConf), Assoc Computing Machinery, NEW YORK, 2021, pp. 7–15. doi:10.1145/3442442.3453541. 35
2021
-
[136]
Dognini, A
A. Dognini, A. Monti, A. Kung, A. Medela, C. M. Joglekar , C. Scha ffer, D. Stampatori, D. Jimenez, E. Maqueda, F. Coelho, et al., Blueprint of the common europe an energy data space, Fraunhofer-Gesellschaft (2024). doi:10.5281/zenodo.10789975
2024 doi
-
[137]
Johnston, Data best practice guidance, Report, OFG EM (2021 2021)
G. Johnston, Data best practice guidance, Report, OFG EM (2021 2021)
2021
-
[138]
B. U. Nisa, A comparison between relational databases and nosql databases, International Journal of Trend in Scientific Research and Development (IJTSRD) 2 (3) (2018)
2018
-
[139]
Pereira, R
L. Pereira, R. Gonalves, F. Quintal, N. Nunes, Data sto rage and maintenance challenges: The case of ad- vanced metering infrastructure systems, in: B. Penzenstad ler, S. Easterbrook, C. C. V enters, S. I. Ahmed (Eds.), 5th International Conference on Information and Co mmunic...
2018 doi
-
[140]
Papadopoulos, energyledger: Integrated energy ac counting using relational databases, Report, OpenRisk (May 19, 2023 2023)
P . Papadopoulos, energyledger: Integrated energy ac counting using relational databases, Report, OpenRisk (May 19, 2023 2023). URL https://www.openriskmanagement.com/wp-content/uploa ds/2023/05/OpenRiskWP14_190523.pdf
2023
-
[141]
Y ang, J
D. Y ang, J. Y u, Z. He, P . Li, X. Du, Applying self-powere d sensor and support vector machine in load energy consumption modeling and prediction of relational databas e, Scientific Reports 13 (1) (2023) 19097
2023
-
[142]
Gagliardelli, L
L. Gagliardelli, L. Zecchini, L. Ferretti, D. Beneven tano, G. Simonini, S. Bergamaschi, M. Orsini, L. Magnotta, E. Mescoli, A. Livaldi, A big data platform exploiting audit able tokenization to promote good practices inside local energy communities, Future Generation Computer...
2023
-
[143]
Trillo-Montero, S
D. Trillo-Montero, S. Cosano-Lucena, M. Gonzalez-Re dondo, J. J. Luna-Rodriguez, I. Santiago, Design and development of a relational database management system (rdbms) with open source tools for the processing of d ata Applied Sciences 13 (3) (2023) 1357. URL https://www.mdpi....
2023
-
[144]
Raghavendra, K
G. Raghavendra, K. T. Basha, Data processing through d ata warehouse and data mining, International Journal of Modern Trends in Engineering & Research 4 (5) (2017) 45–48. doi:10.21884/IJMTER.2017.4151.1EA3X
2017
-
[145]
Asrani, R
D. Asrani, R. Jain, U. Saxena, Data warehouse developm ent standardization framework (dwdsf): A way to handle data warehouse failure, IOSR Journal of Computer Eng ineering (IOSRJCE) 19 (2017) 29–38
2017
-
[146]
Mitchell, Why data warehouse projects fail (2017)
T. Mitchell, Why data warehouse projects fail (2017). URL https://www.timmitchell.net/post/2017/01/10/why-dat a-warehouse-projects-fail/#:~:text=At%20one
2017
-
[147]
Bourne, The state of data management why data wareho use projects fail, Report, SnapLogic (2020)
V . Bourne, The state of data management why data wareho use projects fail, Report, SnapLogic (2020)
2020
-
[148]
Giebler, C
C. Giebler, C. Gröger, E. Hoos, H. Schwarz, B. Mitschan g, Leveraging the data lake: current state and chal- lenges, in: Big Data Analytics and Knowledge Discovery: 21s t International Conference, DaWaK 2019, Linz, Austria, August 26–29, 2019, Proceedings 21, Springer, 201 9, ...
2019
-
[149]
Azzabi, Z
S. Azzabi, Z. Alfughi, A. Ouda, Data lakes: A survey of c oncepts and architectures, Computers 13 (7) (2024) 183. URL https://www.mdpi.com/2073-431X/13/7/183
2024
-
[150]
H. Y . Y oussef, M. Ashfaque, J. V . Karunamurthy, Dewa r&d data lake: Big data platform for advanced energy data analytics, in: 2023 International Conference on IT Inn ovation and Knowledge Discovery (ITIKD), 2023, pp. 1–6. doi:10.1109/ITIKD56332.2023.10099717
2023
-
[151]
Nambiar, D
A. Nambiar, D. Mundra, An overview of data warehouse an d data lake in modern enterprise data management, Big Data and Cognitive Computing 6 (4) (2022) 24. doi:10.3390/bdcc6040132. 36
2022 doi
-
[152]
Wieder, H
P . Wieder, H. Nolte, Toward data lakes as central build ing blocks for data management and analysis, Frontiers in big Data 5 (2022) 945720
2022
-
[153]
Syed, The challenge of building e ffective, enterprise-scale data lakes, in: Proceedings of th e 2020 ACM SIGMOD International Conference on Management of Data, 202 0, pp
A. Syed, The challenge of building e ffective, enterprise-scale data lakes, in: Proceedings of th e 2020 ACM SIGMOD International Conference on Management of Data, 202 0, pp. 803–803
2020
-
[154]
Nargesian, E
F. Nargesian, E. Zhu, R. J. Miller, K. Q. Pu, P . C. Arocen a, Data lake management: challenges and opportuni- ties, Proceedings of the VLDB Endowment 12 (12) (2019) 1986– 1989
2019
-
[155]
Miloslavskaya, A
N. Miloslavskaya, A. Tolstoy, Big data, fast data and d ata lake concepts, Procedia Computer Science 88 (2016) 300–305
2016
-
[156]
Saadane, A
R. Saadane, A. Chehri, S. Jeon, Ai-based modeling and d ata-driven evaluation for smart farming-oriented big data architecture using iot with energy harvesting capabil ities, Sustainable Energy Technologies and Assess- ments 52 (2022) 102093
2022
-
[157]
I. G. Terrizzano, P . M. Schwarz, M. Roth, J. E. Colino, D ata wrangling: The challenging yourney from the wild to the lake, in: CIDR, Asilomar, 2015, pp. –
2015
-
[158]
R. E. Ochogwu, M. C. Okoronkwo, C. I. Osuji, F. E. Adoba, Features and conceptual design of nosql database modeling, Annals of Industrial Technology 1 (9) (2024)
2024
-
[159]
Corbellini, C
A. Corbellini, C. Mateos, A. Zunino, D. Godoy, S. Schia ffino, Persisting big-data: The nosql landscape, Infor- mation Systems 63 (2017) 1–23
2017
-
[160]
Vijaykumar, S
S. Vijaykumar, S. Saravanakumar, Implementation of n osql for robotics, in: INTERACT-2010, IEEE, 2010, pp. 195–200
2010
-
[161]
C. J. Tauro, B. R. Patil, K. Prashanth, A comparative an alysis of different nosql databases on data model, query model and replication model, in: Proceedings of the Interna tional Conference on ERCICA, 2013
2013
-
[162]
Dourhri, M
A. Dourhri, M. Hanine, H. Ouahmane, Kvmod—a novel appr oach to design key-value nosql databases, Infor- mation 14 (10) (2023) 563
2023
-
[163]
Agrawal, A
S. Agrawal, A. Patel, Astudy on graph storage database of nosql, International Journal on Soft Computing, Artificial Intelligence and Applications (IJSCAI) 5 (1) (20 16) 33–39
-
[164]
Falcão, J
F. Falcão, J. Moura, G. Silva, C. Araujo, E. Sousa, E. Ta vares, Energy consumption and performance evaluation of multi-model nosql dbmss, Revista de Informática Teórica e Aplicada 30 (2) (2023) 132–140
2023
-
[165]
Gomes, M
C. Gomes, M. N. de O. Junior, B. Nogueira, P . Maciel, E. T avares, Nosql-based storage systems: influence of consistency on performance, availability and energy con sumption, The Journal of Supercomputing 79 (18) (2023) 21424–21448
2023
-
[166]
Gomes, E
C. Gomes, E. Tavares, M. N. d. O. Junior, Energy consump tion evaluation of nosql dbmss, in: Anais do XV Workshop em Desempenho de Sistemas Computacionais e de Comu nicaçao, SBC, 2016, pp. 2828–2838
2016
-
[167]
Quintal, D
F. Quintal, D. Garigali, D. V asconcelos, J. Cavaleiro , W . Santos, L. Pereira, Energy monitoring in the wild: Platform development and les sons learned from a real-world demonstrator, Energies 14 (18) (2021) 5786. URL https://www.mdpi.com/1996-1073/14/18/5786
2021
-
[168]
Dhupia, M
B. Dhupia, M. U. Rani, A. Alameen, The role of big data an alytics in smart grid management, in: 2nd Inter- national Conference on Computing, Communications and Data Engineering (CCODE), V ol. 1054 of Advances in Intelligent Systems and Computing, Springer-V erlag Sin gapore P...
2020 doi
-
[169]
Dos Santos, J
R. Dos Santos, J. Aguilar, M. D. R-Moreno, Ieee, A synth etic data generator for smart grids based on the variational-autoencoder technique and linked data paradi gm, in: 48th Latin American Computer Conference (CLEI), Ieee, NEW YORK, 2022, pp. 1–7. doi:10.1109/clei56649.2022.9959918
2022
-
[170]
H. S. Lella, R. Chattaraj, S. Chimalakonda, M. Kurra, T owards comprehending energy consumption of database management systems-a tool and empirical study, in: Proceed ings of the 28th International Conference on Eval- uation and Assessment in Software Engineering, 2024, pp. 27 2–281
2024
-
[171]
T. A. A. Monteiro, Energy consumption on database mana gement systems, Thesis, School of Engineering (2021)
2021
-
[172]
Nayak, A
A. Nayak, A. Poriya, D. Poojary, Type of nosql database s and its comparison with relational databases, Inter- national Journal of Applied Information Systems 5 (4) (2013 ) 16–19
2013
-
[173]
Lam, Hadoop in Action, Manning Publications, Shelt er Island, NY , 2010
C. Lam, Hadoop in Action, Manning Publications, Shelt er Island, NY , 2010
2010
-
[174]
Borthakur, Hdfs architecture guide, Hadoop apache project 53 (1-13) (2008) 2
D. Borthakur, Hdfs architecture guide, Hadoop apache project 53 (1-13) (2008) 2
2008
-
[175]
V . K. V avilapalli, A. C. Murthy, C. Douglas, S. Agarwal , M. Konar, R. Evans, T. Graves, J. Lowe, H. Shah, S. Seth, Apache hadoop yarn: Y et another resource negotiato r, in: Proceedings of the 4th annual Symposium on Cloud Computing, 2013, pp. 1–16
2013
-
[176]
B. P . Bhattarai, S. Paudyal, Y . Luo, M. Mohanpurkar, K. Cheung, R. Tonkoski, R. Hovsapian, K. S. Myers, R. Zhang, P . Zhao, Big data analytics in smart grids: state-o f-the-art, challenges, opportunities, and future directions, IET Smart Grid 2 (2) (2019) 141–154
2019
-
[177]
H. Daki, A. El Hannani, A. Aqqal, A. Haidine, A. Dahbi, B ig data management in smart grid: concepts, requirements and implementation, Journal of Big Data 4 (201 7) 1–19
-
[178]
del Rio, G
A. del Rio, G. Conti, S. Castano-Solis, J. Serrano, D. J imenez, J. Fraile-Ardanuy, A guide to data collection for computation and monitoring of node energy consumption, Big Data and Cognitive Computing 7 (3) (2023) 22. doi:10.3390/bdcc7030130
2023 doi
-
[179]
M. R. Akbari, H. Barati, A. Barati, An e fficient gray system theory-based routing protocol for energy con- sumption management in the IoT using fog and cloud computing , Computing 104 (6) (2022) 1307–1335. doi:10.1007/s00607-021-01048-z
2022 doi
-
[180]
Khalid, M
M. Khalid, M. M. Y ousaf, A comparative analysis of big d ata frameworks: An adoption perspective, Applied Sciences 11 (22) (2021) 11033. URL https://www.mdpi.com/2076-3417/11/22/11033
2021
-
[181]
Deepa, Q
N. Deepa, Q. V . Pham, D. C. Nguyen, S. Bhattacharya, B. P rabadevi, F. Fang, P . N. Pathirana, T. R. Gadekallu, P . K. R. Maddikunta, A survey on blockchain for bi g data: Approaches, opportunities, and future directions, Future Generation Computer Systems-the Inter national ...
2022 doi
-
[182]
Kumari, R
A. Kumari, R. Gupta, S. Tanwar, N. Kumar, Blockchain an d ai amalgamation for energy cloud management: Challenges, solutions, and future directions, Journal of P arallel and Distributed Computing 143 (2020) 148–
2020
-
[183]
doi:10.1016/j.jpdc.2020.05.004
2020 doi
-
[184]
O. O. Apeh, N. I. Nwulu, Enhancing transparency and e fficiency in green energy management through blockchain: A comprehensive bibliometric analysis, Energ y Nexus (2025) 100405
2025
-
[185]
B. B. Y ang, H. Garcia-Molina, Designing a super-peer n etwork, in: Proceedings 19th international conference on data engineering (Cat. No. 03CH37405), IEEE, 2003, pp. 49 –60
2003
-
[186]
X. Shen, H. Y u, J. Buford, M. Akon, Handbook of peer-to- peer networking, V ol. 34, Springer Science & Business Media, 2010. 38
2010
-
[187]
Dhara, Y
K. Dhara, Y . Guo, M. Kolberg, X. Wu, Overview of structu red peer-to-peer overlay algorithms, Handbook of Peer-to-Peer Networking (2010) 223–256
2010
-
[188]
Calvanese, G
D. Calvanese, G. De Giacomo, D. Lembo, M. Lenzerini, R. Rosati, Data management in peer-to-peer data integration systems, Global Data Management 8 (2006) 177–2 01
2006
-
[189]
Akbarinia, V
R. Akbarinia, V . Martins, Data management in the APP A s ystem, Journal of Grid Computing 5 (3) (2007) 303–317
2007
-
[190]
Jawad, Data Privacy in P2P Systems, Theses, Univers ité de Nantes (Jun
M. Jawad, Data Privacy in P2P Systems, Theses, Univers ité de Nantes (Jun. 2011). URL https://theses.hal.science/tel-00638721
2011
-
[191]
Presley, X
J. Presley, X. Wang, X. Ai, T. Y u, T. Brandel, P . Podder, V . Patil, A. Afanasyev, F. A. Feltus, L. Zhang, Hydra: A scalable decentralized p2p storage federation for large s cientific datasets, in: 2024 International Conference on Computing, Networking and Communications (ICN...
2024
-
[192]
Ghemawat, H
S. Ghemawat, H. Gobio ff, S.-T. Leung, The google file system, in: Proceedings of the n ineteenth ACM sym- posium on Operating systems principles, 2003, pp. 29–43
2003
-
[193]
Ghawade, Comparative analysis of cloud computing m achine learning - azure vs
G. Ghawade, Comparative analysis of cloud computing m achine learning - azure vs. gcp vs. aws, Inter- national Journal for Research in Applied Science and Engine ering Technology 10 (1) (2022) 1090–1094. doi:10.22214/ijraset.2022.39967
2022
-
[194]
M. R. Siddiqui, Redefining data management with bdaas- big data as-a-service a deep dive into bdaas gover- nance, compliance and security, Innovative Journal of Appl ied Science (2025) 19–19
2025
-
[195]
J. Li, C. Gu, Y . Xiang, F. Li, Edge-cloud computing syst ems for smart grid: State-of-the-art, archi- tecture, and applications, Journal of Modern Power Systems and Clean Energy 10 (4) (2022) 805–817. doi:10.35833/MPCE.2021.000161
2022
-
[196]
Katal, S
A. Katal, S. Dahiya, T. Choudhury, Energy e fficiency in cloud computing data centers: a survey on software technologies, Cluster Computing 26 (3) (2023) 1845–1875. doi:10.1007/s10586-022-03713-0
2023 doi
-
[197]
Zhang, K
J. Zhang, K. Wu, R. Y an, Z. Tian, Y . Sun, Y . Wu, Y . Guo, A verifiable trust-based cp-abe access control scheme for cloud-assisted renewable energy systems., Computers, Materials & Continua 82 (1) (2025)
2025
-
[198]
L. K. Mortensen, K. Sundsgaard, H. R. Shaker, J. Z. Hans en, G. Y ang, Designing digitally enabled proactive maintenance system s in power distribution grids: A scoping literature review, Energy Reports 12 (2024) 1–21. doi:10.1016/j.egyr.2024.08.044. URL https://www.sciencedir...
2024 doi
-
[199]
Khattar, J
N. Khattar, J. Sidhu, J. Singh, Toward energy-e fficient cloud computing: a survey of dynamic power manage- ment and heuristics-based optimization techniques, The Jo urnal of Supercomputing 75 (8) (2019) 4750–4810. doi:10.1007/s11227-019-02764-2
2019 doi
-
[200]
Zhang, A
S. Zhang, A. Pandey, X. Luo, M. Powell, R. Banerji, L. Fa n, A. Parchure, E. Luzcando, Practical adoption of cloud computing in power systems—drivers, challenges, gui dance, and real-world use cases, IEEE Transactions on Smart Grid 13 (3) (2022) 2390–2411. doi:10.1109/TSG.2022.3148978
2022
-
[201]
Singh, V
Sneha, P . Singh, V . Tripathi, Green cloud computing: A chieving sustainability through energy-e fficient tech- niques, architectures, and addressing research challenges, in: A. Y adav, S. J. Nanda, M.-H. Lim (Eds.), Proceed- ings of International Conference on Paradigms of Com...
2023
-
[202]
Ashraf, J
M. Ashraf, J. v. d. Bremen, M. Satapathy, R. ElDebs, The cloud imperative for the energy industry, Report, Accenture (2020). URL https://www.accenture.com/us-en/insights/energy/clo ud-imperative-energy 39
2020
-
[203]
Y . Wang, X. Y ang, Cloud computing energy consumption prediction based on kernel extreme learning machine algorithm improved by vector weighted average algorithm, a rXiv preprint arXiv:2503.04088 (2025)
2025 arXiv
-
[204]
Barton, Data warehouses, data lakes, and the cloud - big data in the age of ai video tutorial | linkedin learning, formerly lynda.com (2019/9// 2019)
P . Barton, Data warehouses, data lakes, and the cloud - big data in the age of ai video tutorial | linkedin learning, formerly lynda.com (2019/9// 2019). URL https://www.linkedin.com/learning/big-data-in-the-a ge-of-ai/data-warehouses-data-lakes-and-t
2019
-
[205]
I. B. Ozyurt, D. B. Keator, D. Wei, C. Fennema-Notestin e, K. R. Pease, J. Bockholt, J. S. Grethe, Federated web-accessible clinical data management within an extensi ble neuroimaging database, Neuroinformatics 8 (4) (2010) 231–249. doi:10.1007/s12021-010-9078-6
2010 doi
-
[206]
Abouzied, D
A. Abouzied, D. J. Abadi, K. Bajda-Pawlikowski, A. Sil berschatz, Integration of large-scale data processing systems and traditional parallel database technology, Pro ceedings of the VLDB Endowment 12 (12) (2019) 2290–2299
2019
-
[207]
Abouzeid, K
A. Abouzeid, K. Bajda-Pawlikowski, D. Abadi, A. Silbe rschatz, A. Rasin, HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workload s, Proceedings of the VLDB Endowment 2 (1) (2009) 922–933
2009
-
[208]
Hutterer, B
A. Hutterer, B. Krumay, Integrating heterogeneous da ta in dataspaces-a systematic mapping study, Pacific Asia Conference on Information Systems (2022)
2022
-
[209]
R. Song, B. Xiao, Y . B. Song, S. T. Guo, Y . Y . Y ang, A survey of blockchain-based schemes for data sharing and exchange , Ieee Transactions on Big Data 9 (6) (2023) 1477–1495. doi:10.1109/tbdata.2023.3293279. URL <return>://WOS:001107490500003
2023
-
[210]
Walha, F
A. Walha, F. Ghozzi, F. Gargouri, Data integration fro m traditional to big data: main features and comparisons of etl approaches, The Journal of Supercomputing (2024) 1–3 9
2024
-
[211]
Scionti, J
A. Scionti, J. Martinovic, O. Terzo, E. Walter, M. Levr ier, S. Hachinger, D. Magarielli, T. Goubier, S. Louise, A. Parodi, S. Murphy, C. D’Amico, S. Ciccia, E. Danovaro, M. Lagasio, F. Donnat, M. Golasowski, T. Quintino, J. Hawkes, T. Martinovic, L. Riha, K. Slaninova, S. Ser...
2020
-
[212]
M. S. Hossain, M. A. Rahman, G. Muhammad, Towards energ y-aware cloud-oriented cyber-physical ther- apy system, Future Generation Computer Systems-the Intern ational Journal of Escience 105 (2020) 800–813. doi:10.1016/j.future.2017.08.045
2020 doi
-
[213]
Muniswamaiah, T
M. Muniswamaiah, T. Agerwala, C. C. Tappert, Ieee, Ene rgy consumption for iot streaming applications, in: 7th IEEE International Conference on Cyber Security and Cloud C omputing (CSCloud) / 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom), Iee...
2020
-
[214]
L. Hu, A. Y adav, A. Khan, H. Liu, A. Ul Haq, Application o f big data fusion based on cloud storage in green transportation: An application of healthc are, Scientific Programming 2020 (2020) 8. doi:10.1155/2020/1593946
2020 doi
-
[215]
Heidari, H
A. Heidari, H. Shishehlou, M. Darbandi, N. J. Navimipo ur, S. Y alcin, A reliable method for data aggregation on the industrial internet of things using a hybrid optimisa tion algorithm and density correlation degree, Cluster Computing 27 (6) (2024) 7521–7539
2024
-
[216]
Malita, G
M. Malita, G. V . Popescu, G. M. Stefan, Pseudo-reconfig urable heterogeneous solution for accelerating spectral clustering, in: 8th IEEE International Conference on Big Da ta (Big Data), IEEE International Conference on Big Data, Ieee, NEW YORK, 2020, pp. 5138–5145. doi:10.110...
2020
-
[217]
S. K. Bansal, Towards a semantic extract-transform-l oad (etl) framework for big data integration, in: 2014 IEEE International Congress on Big Data, IEEE, 2014, pp. 522 –529
2014
-
[218]
M. Ma, P . Wang, E fficient event inference and context-awareness in internet of things edge systems, Ieee Transactions on Big Data 8 (3) (2022) 658–670. doi:10.1109/tbdata.2019.2907978
2022
-
[219]
Bagozi, D
A. Bagozi, D. Bianchini, A. Rula, Multi-perspective d ata modelling in cyber physical produc- tion networks: Data, services and actors, Data Science and E ngineering 7 (3) (2022) 193–212. doi:10.1007/s41019-022-00194-4
2022 doi
-
[220]
A. R. Messina, Data Fusion and Data Mining for Power Sys tem Monitoring, CRC Press, 2020
2020
-
[221]
Bouganim, J
L. Bouganim, J. Loudet, I. Sandu Popa, Highly distribu ted and privacy-preserving queries on personal data management systems, The VLDB Journal 32 (2) (2023) 415–445
2023
-
[222]
Gkikopoulos, V
P . Gkikopoulos, V . Schiavoni, J. Spillner, Decentral ised data quality control in ground truth production for autonomic decisions, IEEE Transactions on Parallel and Dis tributed Systems 33 (10) (2022) 2416–2427
2022
-
[223]
A. I. Ameur, O. S. Oubbati, A. Lakas, A. Rachedi, M. B. Y a goubi, Efficient vehicular data sharing using aerial p2p backbone, IEEE Transactions on Intelligent V ehicles (2024)
2024
-
[224]
M. D. Wilkinson, M. Dumontier, I. J. Aalbersberg, G. Ap pleton, M. Axton, A. Baak, N. Blomberg, J.-W . Boiten, L. B. da Silva Santos, P . E. Bourne, The fair guiding p rinciples for scientific data management and stewardship, Scientific data 3 (1) (2016) 1–9
2016
-
[225]
Jiang, L
W . Jiang, L. Y an, Y . Tu, X. Zhou, Z. Ma, Pg-explorer: Res ource description framework data exploration with property graphs, Expert Systems with Applications 198 (202 2) 116789. 41
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.