Title graphic: Data Factory in Microsoft Fabric (Product)
Often discussed together
Episodes about Data Factory in Microsoft Fabric often also cover Fabric notebooks.
Description
Data Factory in Microsoft Fabric is the data integration service built into Microsoft Fabric. Microsoft describes it as the next generation of Azure Data Factory. Its purpose is to bring together data that is scattered across databases, files, cloud services and legacy systems, clean it, and prepare it for analytics in a lakehouse or data warehouse. Movement and transformation are orchestrated from a single interface. Using it requires a Fabric tenant account with an active subscription and a workspace with Fabric enabled.
The service connects to well over a hundred data sources. These include multicloud and hybrid sources, which can be reached through on-premises gateways. Both ETL and ELT patterns are supported, so teams can choose whether data is transformed before or after it lands in the target.
For moving data, the documentation names several options. A copy job is the preferred option and handles bulk copies, incremental copies and change data capture copies. Copy activity inside a pipeline gives manual control over parallelism. Mirroring keeps a near-real-time replica of an operational database in OneLake. Choosing between them typically depends on whether a one-time load, a recurring incremental load or a continuously updated replica is needed, and how much control over the copy process is required.
Transformations can run in several ways. Pipeline activities can call notebooks, Spark job definitions, stored procedures and SQL scripts. Dataflow Gen2 offers a low-code interface for shaping data. dbt jobs can be run against a Fabric data warehouse. This allows both code-first and low-code teams to work in the same environment.
Orchestration covers schedules, event-based triggers, control flow in the pipeline designer and Apache Airflow DAGs. Copilot can create pipelines and dataflows from natural-language prompts and can explain errors, which can help when building or troubleshooting integration logic.
Security is a recurring theme in the M365.FM coverage. The episode "Secure Microsoft Fabric Data Pipelines" advises reviewing data movement policies regularly and updating them as the organization grows or as new threats appear. It states that strong data movement security protects sensitive information and supports compliance with regulations. The episode also discusses managed identity authentication for securing Data Factory in Microsoft Fabric. According to the episode, this method lets pipelines connect to resources without storing passwords or secrets, which avoids the risks that come with hardcoded credentials.
In practice, teams working with Data Factory in Microsoft Fabric decide which movement method fits each source, which transformation approach suits their skills, and how to authenticate and govern pipelines. Because the service sits inside Fabric, its output feeds directly into the lakehouse and warehouse experiences that the rest of the platform uses for analytics.
Overview compiled with AI from M365.FM episodes and the facts on this page. You can improve it with the edit button below.
Stop guessing where your data went. In Microsoft Fabric, automatic lineage, workspace-based permissions, and Purview’s enterprise catalog turn opaque pipelines into auditable, end-to-end flows—from ingestion to transformation to the report. Fabric captures…
Microsoft Fabric is Microsoft’s unified analytics platform, bringing together data engineering, data integration, data science, data warehousing, and business intelligence into a single cloud service. But where does Copilot fit into the picture? In this…
Stop exporting Dynamics 365 data to Excel. Connect Dataverse to Microsoft Fabric, build an analytics model once, and embed Power BI directly inside Dynamics 365 (CRM/ERP) screens. With live, role-aware metrics (RLS), sales and ops teams act on fresh data…
Timeline of episodes about Data Factory in Microsoft Fabric
Frequently asked questions
Questions marked with AI were written with AI from the facts on this page.
What is Data Factory in Microsoft Fabric? (AI)
It is the data integration service in Microsoft Fabric for moving and transforming data using pipelines, Dataflow Gen2, copy jobs and mirroring. Microsoft describes it as the next generation of Azure Data Factory.
Which options exist for moving data in Data Factory in Microsoft Fabric? (AI)
A copy job is the preferred option and handles bulk, incremental and change data capture copies. Copy activity offers manual control over parallelism, and mirroring keeps a near-real-time replica of an operational database in OneLake.
How can pipelines be secured according to M365.FM? (AI)
The episode "Secure Microsoft Fabric Data Pipelines" recommends managed identity authentication, which connects to resources without storing passwords or secrets in pipelines. It also advises reviewing data movement policies regularly.
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Experts and companies for this topic
Nobody has listed this topic yet. Add it to your profile.