Description
Part I. Getting Started1. The Tools and Pre-Requisites2. Data Factory vs SSIS vs Databricks3. Design a Data Lake Storage Gen2 Account
Part II. Azure Data Factory for ELT4. Dynamically Load SQL Database to Data Lake Storage Gen 25. Use COPY INTO to Load Synapse Analytics Dedicated SQL Pool6. Load Data Lake Storage Gen2 Files into Synapse Analytics Dedicated SQL Pool7. Create and Load Synapse Analytics Dedicated SQL Pool Tables Dynamically8. Build Custom Logs in SQL Database for Pipeline Activity Metrics9. Capture Pipeline Error Logs in SQL Database10. Dynamically Load Snowflake Data Warehouse11. Mapping Data Flows for Data Warehouse ETL 12. Aggregate and Transform Big Data Using Mapping Data Flows13. Incrementally Upsert Data14. Loading Excel Sheets into Azure SQL Database Tables15. Delta Lake
Part III. Real-Time Analytics in Azure16. Stream Analytics Anomaly Detection17. Real-time IoT Analytics Using Apache Spark 18. Azure Synapse Link for Cosmos DB
Part IV. DevOps for Continuous Integration and Deployment 19. Deploy Data Factory Changes 20. Deploy SQL Database
Part V. Advanced Analytics21. Graph Analytics Using Apache Spark's GraphFrame API22. Synapse Analytics Workspaces23. Machine Learning in Databricks
Part VI. Data Governance24. Purview for Data Governance
Author: Ron C. L'Esteve
Publisher: Apress
Published: 08/24/2021
Pages: 612
Binding Type: Paperback
Weight: 2.40lbs
Size: 10.00h x 7.00w x 1.28d
ISBN13: 9781484271810
ISBN10: 1484271815
BISAC Categories:
- Computers | Programming | Microsoft
- Computers | Database Administration & Management
About the Author
Ron L'Esteve is a professional author residing in Chicago, IL, USA. His passion for Azure Data Engineering stems from his deep experience with implementing, leading, and delivering Azure Data projects for numerous clients. He is a trusted architectural leader and digital innovation strategist, responsible for scaling key data architectures, defining the road map and strategy for the future of data and business intelligence (BI) needs, and challenging customers to grow by thoroughly understanding the fluid business opportunities and enabling change by translating them into high quality and sustainable technical solutions that solve the most complex business challenges and promote digital innovation and transformation. Ron has been an advocate for data excellence across industries and consulting practices, while empowering self-service data, BI, and AI through his contributions to the Microsoft technical community.