Azure Data Integration Pipelines – Advanced Design and Delivery

SQLBITS 2022 – FULL DAY OF TRAINING

9TH MARCH – ONLINE OR IN PERSON AT THE LONDON EXCEL

https://sqlbits.com


In this full day training data session, we’ll quickly cover the fundamentals of data integration pipelines before going much deeper into our Azure resources. Within a typical Azure data platform solution for any enterprise grade data analytics or data science workload an umbrella resource is needed to trigger, monitor, and handle the control flow for transforming datasets, with the goal being actionable data insight. Those requirements are met by deploying Azure Data Integration pipelines, delivered using Azure Synapse Analytics or Azure Data Factory. In this session, I’ll show you how to create rich dynamic data pipelines and apply these orchestration resources in production. Using scaled architecture design patterns, best practice, data mesh principals, and the latest metadata driven frameworks. We will take a deep dive into the services, considering how to build custom activities, complex pipelines and think about hierarchical design patterns for enterprise grade deployments. All this and more in a complete set of 12 modules (based on real world experience) we will take you through how to implement data integration pipelines in production and deliver advanced orchestration patterns.


• Module 1: Pipeline Fundamentals
• Module 2: Integration Runtime Design Patterns
• Module 3: Data Transformation
• Module 4: Dynamic Pipelines
• Module 5: Execution Parallelism
• Module 6: Pipeline Extensibility
• Module 7: VNet Integration
• Module 8: Security
• Module 9: Monitoring & Alerting
• Module 10: CI/CD
• Module 11: Solution Testing
• Module 12: Final Thoughts


Hope to see you there.

Many thanks

avatar
Paul Andrewhttps://mrpaulandrew.com/
Group Manager & Analytics Architect specialising in big data solutions on the Microsoft Azure cloud platform. Data engineering competencies include Azure Synapse Analytics, Data Factory, Data Lake, Databricks, Stream Analytics, Event Hub, IoT Hub, Functions, Automation, Logic Apps and of course the complete SQL Server business intelligence stack. Many years’ experience working within healthcare, retail and gaming verticals delivering analytics using industry leading methods and technical design patterns. STEM ambassador and very active member of the data platform community delivering training and technical sessions at conferences both nationally and internationally. Father, husband, swimmer, cyclist, runner, blood donor, geek, Lego and Star Wars fan!

Related Articles

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Stay Connected

6,065FollowersFollow
5,933FollowersFollow

Subscribe to our newsletter

To be updated with all the latest news, offers and special announcements.

Latest Articles