How to build metadata-driven data pipelines with Delta Live Tables

How to build metadata-driven data pipelines with Delta Live Tables

HomeDatabricksHow to build metadata-driven data pipelines with Delta Live Tables
How to build metadata-driven data pipelines with Delta Live Tables
ChannelPublish DateThumbnail & View CountDownload Video
Channel AvatarPublish Date not found Thumbnail
0 Views
In this session, you'll learn how to use metaprogramming to automate the creation and management of Delta Live Tables pipelines at scale. The goal is to make using DLT easy for large-scale migrations and other use cases that require ingesting and managing hundreds or thousands of tables, using generic code components and configuration-driven pipelines that can be dynamically reused across projects or datasets. .

Lecture by: Mojgan Mazouchi and Ravi Gawai

Contact us: Website: https://databricks.com
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc
Facebook: https://www.facebook.com/databricksinc

Please take the opportunity to connect and share this video with your friends and family if you find it helpful.