DataHour: Making Data Pipelines Easy with Dataproc and Composer
DataHour: Making Data Pipelines Easy with Dataproc and Composer
17 Feb 202315:02pm - 17 Feb 202316:02pm
DataHour: Making Data Pipelines Easy with Dataproc and Composer
About the Event
In this DataHour Julian will walk you through best practices for Data engineering teams and discuss why and how to use serverless Spark options. Dataproc on its own is a managed Apache Spark and Apache Hadoop service that lets you take advantage of open source data tools for batch processing, querying, streaming and machine learning. However we will also understand how to go about with automating processes and making life simpler. We do this with the use of Airflow and go quite in depth with the operators used for different Dataproc services. Composer is a managed Airflow service provided by Google Cloud and its ease of setup will be clearly shown in a demo during this webinar. Any aspiring Data or ML engineer stands to benefit from this webinar in understanding best practices while running a Data pipeline in Cloud.
Prerequisites: Interest in learning the application of Data Science.
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
Who is this DataHour for?
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
About the Speaker
Participate in discussion
Registration Details
Registered
Become a Speaker
Share your vision, inspire change, and leave a mark on the industry. We're calling for innovators and thought leaders to speak at our event
- Professional Exposure
- Networking Opportunities
- Thought Leadership
- Knowledge Exchange
- Leading-Edge Insights
- Community Contribution
