M365Con 2027 – free online conference · 11–22 Jan 2027 · 120 sessions m365con.net

Data Factory in Microsoft Fabric

Product

The data integration experience built into Microsoft Fabric for moving and transforming data with pipelines, Dataflow Gen2, copy jobs and mirroring; Microsoft positions it as the successor to Azure Data Factory.

◆ PRODUCTData Factory inMicrosoft FabricM365.FM
Title graphic: Data Factory in Microsoft Fabric (Product)

Often discussed together

Episodes about Data Factory in Microsoft Fabric often also cover Fabric notebooks.

Description

Data Factory in Microsoft Fabric is the data integration service built into Microsoft Fabric. Microsoft describes it as the next generation of Azure Data Factory. Its purpose is to bring together data that is scattered across databases, files, cloud services and legacy systems, clean it, and prepare it for analytics in a lakehouse or data warehouse. Movement and transformation are orchestrated from a single interface. Using it requires a Fabric tenant account with an active subscription and a workspace with Fabric enabled.

The service connects to well over a hundred data sources. These include multicloud and hybrid sources, which can be reached through on-premises gateways. Both ETL and ELT patterns are supported, so teams can choose whether data is transformed before or after it lands in the target.

For moving data, the documentation names several options. A copy job is the preferred option and handles bulk copies, incremental copies and change data capture copies. Copy activity inside a pipeline gives manual control over parallelism. Mirroring keeps a near-real-time replica of an operational database in OneLake. Choosing between them typically depends on whether a one-time load, a recurring incremental load or a continuously updated replica is needed, and how much control over the copy process is required.

Transformations can run in several ways. Pipeline activities can call notebooks, Spark job definitions, stored procedures and SQL scripts. Dataflow Gen2 offers a low-code interface for shaping data. dbt jobs can be run against a Fabric data warehouse. This allows both code-first and low-code teams to work in the same environment.

Orchestration covers schedules, event-based triggers, control flow in the pipeline designer and Apache Airflow DAGs. Copilot can create pipelines and dataflows from natural-language prompts and can explain errors, which can help when building or troubleshooting integration logic.

Security is a recurring theme in the M365.FM coverage. The episode "Secure Microsoft Fabric Data Pipelines" advises reviewing data movement policies regularly and updating them as the organization grows or as new threats appear. It states that strong data movement security protects sensitive information and supports compliance with regulations. The episode also discusses managed identity authentication for securing Data Factory in Microsoft Fabric. According to the episode, this method lets pipelines connect to resources without storing passwords or secrets, which avoids the risks that come with hardcoded credentials.

In practice, teams working with Data Factory in Microsoft Fabric decide which movement method fits each source, which transformation approach suits their skills, and how to authenticate and govern pipelines. Because the service sits inside Fabric, its output feeds directly into the lakehouse and warehouse experiences that the rest of the platform uses for analytics.

Overview compiled with AI from M365.FM episodes and the facts on this page. You can improve it with the edit button below.

TypeProduct
DocumentationData Factory in Microsoft Fabric – Microsoft Learn learn.microsoft.com

Episodes about Data Factory in Microsoft Fabric

Episodes in which Data Factory in Microsoft Fabric is discussed:

Timeline of episodes about Data Factory in Microsoft Fabric

Frequently asked questions

Questions marked with AI were written with AI from the facts on this page.

What is Data Factory in Microsoft Fabric? (AI)

It is the data integration service in Microsoft Fabric for moving and transforming data using pipelines, Dataflow Gen2, copy jobs and mirroring. Microsoft describes it as the next generation of Azure Data Factory.

Which options exist for moving data in Data Factory in Microsoft Fabric? (AI)

A copy job is the preferred option and handles bulk, incremental and change data capture copies. Copy activity offers manual control over parallelism, and mirroring keeps a near-real-time replica of an operational database in OneLake.

How can pipelines be secured according to M365.FM? (AI)

The episode "Secure Microsoft Fabric Data Pipelines" recommends managed identity authentication, which connects to resources without storing passwords or secrets in pipelines. It also advises reviewing data movement policies regularly.

Glossary

Community wiki

Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.

Experts and companies for this topic

Nobody has listed this topic yet. Add it to your profile.

Sources

Maintained by Mirko Peters (Microsoft MVP) · Last updated: