Delta Lake: The Foundation of Reliable Data and AI
摘要
In this chapter, we will examine a crucial aspect of the lakehouse paradigm: the data storage format. As discussed in Chapter 1 , the ideal storage format for a lakehouse is one that provides similar data management and performance features of a data warehouse but is an open format and built on top of cloud data storage. Delta Lake is a storage protocol that exactly fits the requirements. Delta Lake is an open, performant storage format that enables organizations to build data lakehouses, allowing data warehousing, machine learning and GenAI directly on the data lake.