國立高雄大學圖資館 |

Mapping data flows in Azure data factorybuilding scalable ETL projects in the Microsoft Cloud /

Record Type:	Electronic resources : Monograph/item
Title/Author:	Mapping data flows in Azure data factoryby Mark Kromer.
Reminder of title:	building scalable ETL projects in the Microsoft Cloud /
Author:	Kromer, Mark.
Published:	Berkeley, CA :Apress :2022.
Description:	xviii, 194 p. :ill., digital ;24 cm.
Contained By:	Springer Nature eBook
Subject:	Data warehousing.
Online resource:	https://doi.org/10.1007/978-1-4842-8612-8
ISBN:	9781484286128$q(electronic bk.)

Mapping data flows in Azure data factorybuilding scalable ETL projects in the Microsoft Cloud /
Kromer, Mark.

Mapping data flows in Azure data factorybuilding scalable ETL projects in the Microsoft Cloud /[electronic resource] :by Mark Kromer. - Berkeley, CA :Apress :2022. - xviii, 194 p. :ill., digital ;24 cm.

Introduction -- Part I. Getting Started with Azure Data Factory and Mapping Data Flows-- 1. Introduction to Azure Data Factory -- 2. Introduction to Mapping Data Flows -- Part II. Designing Scalable ETL Jobs with ADF Mapping Data Flows -- 3. Build Your First Pipeline -- 4. Common Pipeline Patterns -- 5. Design Your First Mapping Data Flow -- 6. Common Data Flow Patterns -- 7. Debugging Mapping Data Flows -- 8. Data Pipelines with Data Flows -- Part III. Operationalize your ETL Data Pipelines -- 9. CI/CD and Scheduling -- 10. Monitoring, Management, and Security -- Part IV. Sample Project -- 11. Build a New ETL Project in ADF using Mapping Data Flows -- 12. End-to-End Review of the ADF Project.

Build scalable ETL data pipelines in the cloud using Azure Data Factory's Mapping Data Flows. Each chapter of this book addresses different aspects of an end-to-end data pipeline that includes repeatable design patterns based on best practices using ADF's code-free data transformation design tools. The book shows data engineers how to take raw business data at cloud scale and turn that data into business value by organizing and transforming the data for use in data science projects and analytics systems. The book begins with an introduction to Azure Data Factory followed by an introduction to its Mapping Data Flows feature set. Subsequent chapters show how to build your first pipeline and corresponding data flow, implement common design patterns, and operationalize your result. By the end of the book, you will be able to apply what you've learned to your complex data integration and ETL projects in Azure. These projects will enable cloud-scale big analytics and data loading and transformation best practices for data warehouses. What You Will Learn Build scalable ETL jobs in Azure without writing code Transform big data for data quality and data modeling requirements Understand the different aspects of Azure Data Factory ETL pipelines from datasets and Linked Services to Mapping Data Flows Apply best practices for designing and managing complex ETL data pipelines in Azure Data Factory Add cloud-based ETL patterns to your set of data engineering skills Build repeatable code-free ETL design patterns.

ISBN: 9781484286128$q(electronic bk.)

Standard No.: 10.1007/978-1-4842-8612-8doiSubjects--Uniform Titles:

Windows Azure.
Subjects--Topical Terms:

199894
Data warehousing.

LC Class. No.: QA76.9.D37 / K76 2022

Dewey Class. No.: 005.7565

Mapping data flows in Azure data factorybuilding scalable ETL projects in the Microsoft Cloud /
LDR:03239nmm a2200313 a 4500 001 629428
003 DE-He213
005 20220825133327.0
007 cr nn 008maaau
008 230224s2022 cau s 0 eng d
020 $a 9781484286128$q(electronic bk.)
020 $a 9781484286111$q(paper)
024 7 $a 10.1007/978-1-4842-8612-8 $2 doi
035 $a 978-1-4842-8612-8
040 $a GP $c GP
041 0 $a eng
050 4 $a QA76.9.D37 $b K76 2022
072 7 $a UMP $2 bicssc
072 7 $a COM051380 $2 bisacsh
072 7 $a UMP $2 thema
082 0 4 $a 005.7565 $2 23
090 $a QA76.9.D37 $b K93 2022
100 1 $a Kromer, Mark. $3 934219
245 1 0 $a Mapping data flows in Azure data factory $h [electronic resource] : $b building scalable ETL projects in the Microsoft Cloud / $c by Mark Kromer.
260 $a Berkeley, CA : $b Apress : $b Imprint: Apress, $c 2022.
300 $a xviii, 194 p. : $b ill., digital ; $c 24 cm.
505 0 $a Introduction -- Part I. Getting Started with Azure Data Factory and Mapping Data Flows-- 1. Introduction to Azure Data Factory -- 2. Introduction to Mapping Data Flows -- Part II. Designing Scalable ETL Jobs with ADF Mapping Data Flows -- 3. Build Your First Pipeline -- 4. Common Pipeline Patterns -- 5. Design Your First Mapping Data Flow -- 6. Common Data Flow Patterns -- 7. Debugging Mapping Data Flows -- 8. Data Pipelines with Data Flows -- Part III. Operationalize your ETL Data Pipelines -- 9. CI/CD and Scheduling -- 10. Monitoring, Management, and Security -- Part IV. Sample Project -- 11. Build a New ETL Project in ADF using Mapping Data Flows -- 12. End-to-End Review of the ADF Project.
520 $a Build scalable ETL data pipelines in the cloud using Azure Data Factory's Mapping Data Flows. Each chapter of this book addresses different aspects of an end-to-end data pipeline that includes repeatable design patterns based on best practices using ADF's code-free data transformation design tools. The book shows data engineers how to take raw business data at cloud scale and turn that data into business value by organizing and transforming the data for use in data science projects and analytics systems. The book begins with an introduction to Azure Data Factory followed by an introduction to its Mapping Data Flows feature set. Subsequent chapters show how to build your first pipeline and corresponding data flow, implement common design patterns, and operationalize your result. By the end of the book, you will be able to apply what you've learned to your complex data integration and ETL projects in Azure. These projects will enable cloud-scale big analytics and data loading and transformation best practices for data warehouses. What You Will Learn Build scalable ETL jobs in Azure without writing code Transform big data for data quality and data modeling requirements Understand the different aspects of Azure Data Factory ETL pipelines from datasets and Linked Services to Mapping Data Flows Apply best practices for designing and managing complex ETL data pipelines in Azure Data Factory Add cloud-based ETL patterns to your set of data engineering skills Build repeatable code-free ETL design patterns.
630 0 0 $a Windows Azure. $3 541398
650 0 $a Data warehousing. $3 199894
650 0 $a Database management. $3 182428
650 0 $a Information storage and retrieval systems $x Data processing. $3 934220
650 0 $a Cloud computing. $3 378527
650 1 4 $a Microsoft. $3 915087
650 2 4 $a Cloud Computing. $3 777671
650 2 4 $a Database Management. $3 273994
710 2 $a SpringerLink (Online service) $3 273601
773 0 $t Springer Nature eBook
856 4 0 $u https://doi.org/10.1007/978-1-4842-8612-8
950 $a Professional and Applied Computing (SpringerNature-12059)