Tips and tricks for robust big data applications – Yousry Mohamed – NDC Sydney 2020

Tips and tricks for robust big data applications – Yousry Mohamed – NDC Sydney 2020

HomeNDC ConferencesTips and tricks for robust big data applications – Yousry Mohamed – NDC Sydney 2020
Tips and tricks for robust big data applications – Yousry Mohamed – NDC Sydney 2020
ChannelPublish DateThumbnail & View CountDownload Video
Channel AvatarPublish Date not found Thumbnail
0 Views
Is there anyone else working on big data? Some people may think it's an old buzzword that won't attract the cool kids in the age of self-driving cars.
Well, big data is still here and will remain relevant as long as people and companies need to count things.

In this session you will learn several tips and tricks that are crucial for any successful big data application.
You will see how to optimize data storage in columnar files to save storage costs and also improve computing performance.
If 'garbage in' means 'garbage out', your data must be high quality.
You will also learn how to unit test big data applications and ensure high-quality data results.

With the explosion of data sources that a single organization has to deal with, it is critical that governance and tracking are in place.
You'll see how to track the provenance of a given data set so you're always prepared for the toughest audits or compliance checks.

Finally, I'll show you some tools that can help you with automation and collaboration.

Please take the opportunity to connect and share this video with your friends and family if you find it helpful.