Next-Generation Data Warehousing: Innovations in cloud-native data warehouses and the rise of serverless architectures
Keywords:
Cloud-native data warehouse, serverless architecture, data warehousingAbstract
Next-generation data warehousing has shifted towards cloud-native and serverless architectures, marking a significant innovation in storing, processing, and analyzing data. Cloud-native data warehouses, explicitly designed for the flexibility and scalability of the cloud, enable companies to seamlessly handle large volumes of data without the constraints of traditional on-premises infrastructure. This approach reduces the need for constant hardware upgrades and enables businesses to scale up or down according to demand. Serverless architectures extend this capability by removing users' need to manage servers, allowing automatic resource allocation and billing based on actual usage rather than pre-provisioned capacity. With serverless models, data professionals can focus on analytics and insight generation without worrying about the underlying infrastructure, thereby increasing agility and cost efficiency. These advancements in cloud-native and serverless data warehousing also support real-time data processing and analytics, making them ideal for modern applications requiring speed and responsiveness. As a result, businesses are empowered to make faster and more informed decisions, leveraging data in ways that previously required substantial infrastructure investment. These innovations are reshaping data warehousing by reducing overhead and complexity, enabling businesses to adapt to changing data needs and laying the foundation for more dynamic and flexible data environments. This transformation holds promise for organizations aiming to stay competitive in a data-driven world while keeping operational costs manageable and focusing on growth.
Downloads
References
Laszewski, T., Arora, K., Farr, E., & Zonooz, P. (2018). Cloud Native Architectures: Design high-availability and cost-effective applications for the cloud. Packt Publishing Ltd.
NETTO, M. A., TOOSI, A. N., RODRIGUEZ, M. A., LLORENTE, I. M., DI VIMERCATI, S. D. C., SAMARATI, P., ... & SHEN, H. (2018). A Manifesto for Future Generation Cloud Computing: Research Directions for the Next Decade.
Tech, B. (2015). Cloud Computing. SlideShare Site: https://www. slideshare. net/ranjanravi33/cloud-computing-46478251.
Stodder, D. (2018). BI and Analytics in the Age of AI and Big Data. TWDI Best Practices Report.
Kousalya, G., Balakrishnan, P., & Raj, C. P. (2017). Automated workflow scheduling in self-adaptive clouds: Concepts, algorithms and methods. Springer.
Samwel, B., Cieslewicz, J., Handy, B., Govig, J., Venetis, P., Yang, C., ... & Venkataraman, S. (2018). F1 query: Declarative querying at scale. Proceedings of the VLDB Endowment, 11(12), 1835-1848.
Ramos Chavez, R. (2018). Towards network based media processing using cloud technologies.
Fox, G. C., Ishakian, V., Muthusamy, V., & Slominski, A. (2017). Status of serverless computing and function-as-a-service (faas) in industry and research. arXiv preprint arXiv:1708.08028.
Inmon, W. H., Strauss, D., & Neushloss, G. (2010). DW 2.0: The architecture for the next generation of data warehousing. Elsevier.
Russom, P. (2009). Next generation data warehouse platforms. TDWI Best Practices Report: fourth quarter.
Garcelon, N., Neuraz, A., Salomon, R., Bahi-Buisson, N., Amiel, J., Picard, C., ... & Rance, B. (2018). Next generation phenotyping using narrative reports in a rare disease clinical data warehouse. Orphanet journal of rare diseases, 13, 1-11.
Thiele, H., Glandorf, J., Hufnagel, P., Körting, G., & Blüggel, M. (2008). Managing proteomics data: from generation and data warehousing to central data repository. J Proteomics Bioinform, 1, 485-507.
Abrahiem, R. (2007, May). A new generation of middleware solutions for a near-real-time data warehousing architecture. In 2007 IEEE International Conference on Electro/Information Technology (pp. 192-197). IEEE.
Inmon, B. (2006). DW 2.0; Architecture for the Next Generation of Data Warehousing. Information Management, 16(4), 8.
Kelly, S. (2007). Data warehousing in action. John Wiley & Sons.
Gade, K. R. (2018). Real-Time Analytics: Challenges and Opportunities. Innovative Computer Sciences Journal, 4(1).
Gade, K. R. (2017). Integrations: ETL/ELT, Data Integration Challenges, Integration Patterns. Innovative Computer Sciences Journal, 3(1).
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
License Terms
Ownership and Licensing:
Authors of research papers submitted to Distributed Learning and Broad Applications in Scientific Research retain the copyright of their work while granting the journal certain rights. Authors maintain ownership of the copyright and have granted the journal a right of first publication. Simultaneously, authors agree to license their research papers under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) License.
License Permissions:
Under the CC BY-NC-SA 4.0 License, others are permitted to share and adapt the work, as long as proper attribution is given to the authors and acknowledgement is made of the initial publication in the journal. This license allows for the broad dissemination and utilization of research papers.
Additional Distribution Arrangements:
Authors are free to enter into separate contractual arrangements for the non-exclusive distribution of the journal's published version of the work. This may include posting the work to institutional repositories, publishing it in journals or books, or other forms of dissemination. In such cases, authors are requested to acknowledge the initial publication of the work in this journal.
Online Posting:
Authors are encouraged to share their work online, including in institutional repositories, disciplinary repositories, or on their personal websites. This permission applies both prior to and during the submission process to the journal. Online sharing enhances the visibility and accessibility of the research papers.
Responsibility and Liability:
Authors are responsible for ensuring that their research papers do not infringe upon the copyright, privacy, or other rights of any third party. Scientific Research Canada disclaims any liability or responsibility for any copyright infringement or violation of third-party rights in the research papers.
If you have any questions or concerns regarding these license terms, please contact us at editor@dlabi.org.
