Join this session to learn about Labcorp’s data platform transformation from on-premises Hadoop to AWS Databricks Lakehouse. We’ll share best practices and lessons learned from selecting, deploying, and migrating Hadoop cloud-native data platforms (within six months) with Unity Catalog.

We’ll share the steps taken to deprecate various legacy on-premises technologies and leverage native Databricks features such as Spark streaming, workflows, job pools, cluster policies, and Spark JDBC within the Databricks platform. Lessons learned from implementing Unity Catalog and building a security and governance model that scales across applications. We’ll show demos that walk you through batch frameworks, streaming frameworks, and data comparison tools used across applications to improve data quality and speed of delivery.

Learn how we improved operational efficiency, resilience, and reduced TCO, and how we scaled on-premises workspaces and associated cloud infrastructure using the Terraform provider.

Lecture by: Mohan Kolli and Sreekanth Ratakonda

Contact Us: Website: https://databricks.com
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc
Facebook: https://www.facebook.com/databricksinc

Please feel free to share this video with your friends and family if you found it useful.