How data engineering works

How data engineering works

HomeAltexSoftHow data engineering works
How data engineering works
ChannelPublish DateThumbnail & View CountDownload Video
Channel AvatarPublish Date not found Thumbnail
0 Views
So the sole purpose of data engineering is to extract data from the source and store it to make it available for analysis. Sounds simple, but it's all about the system that works under the hood.

Watch our video to learn more about data engineering:
00:00 Basic data infrastructure
02:07 ETL pipeline
04:34 Data warehouse
06:07 Data scientists and data engineers
08:05 Big data
09:45 Data streaming
11:47 Distributed computing

Sources:
[1] https://sre.google/sre-book/eliminating-toil/
[2] https://www.statista.com/statistics/419778/paypal-annual-payments/
[3] https://www.forbes.com/sites/bernardmarr/2019/08/23/the-amazing-ways-youtube-uses-artificial-intelligence-and-machine-learning/?sh=3752a1d75852

For more information, check out our articles:
1) What is Data Engineer: role description, responsibilities, skills and background https://www.altexsoft.com/blog/what-is-data-engineer-role-skills/?utm_source=youtube&utm_medium=link&utm_campaign=howdataengineeringworks
2) Explanation of the roles of Data Pipeline, Data Warehouse and Data Engineer https://www.altexsoft.com/blog/datascience/what-is-data-engineering-explaining-data-pipeline-data-warehouse-and-data – engineer role/
3) Big Data Engineer: https://www.altexsoft.com/blog/big-data-engineer/
4) What is ETL Developer https://www.altexsoft.com/blog/datascience/who-is-etl-developer-role-description-process-breakdown-responsibility-and-skills/

More information about AltexSoft: https://www.altexsoft.com/
Follow us on LinkedIn: https://www.linkedin.com/company/altexsoft/
Follow us on Facebook: https://www.facebook.com/altexsoft/
Follow us on Twitter: https://twitter.com/AltexSoft
Follow us on Instagram: https://www.instagram.com/altexsoftcom/

Music in video by Kevin MacLeod (https://incompetech.filmmusic.io): Sneaky Snitch, Sheep May Safely Graze – BWV 208, Wholesome, Disco Sting, Krampuss Workshop, Thinking Music, Whiskey on the Mississippi, Hidden Agenda, Egmont Overture , Sheep May Graze Safely, Holiday Weasel, Brittle Rille, March of the Spoons, Hidden Agenda, Fuzzball Parade, Gothamlicious, Light Sting.
License https://incompetech.filmmusic.io/standard-license

Please take the opportunity to connect and share this video with your friends and family if you find it helpful.