Connecting to Microsoft Fabric - Data Factory

Introduction

We recommend using metadata import in the Portal as the primary method of connecting to your data sources.
The Portal offers significant advantages compared to the Desktop application:

• Import multiple sources in a single flow.
• Schedule recurring tasks (metadata import).
• Manage connections centrally.

Import through Desktop is still available and allows importing one source at a time. You can find the instructions below.

---

Importing Metadata in Dataedo Portal

Entry point

To start the Metadata Import flow, make sure you have the Connection Manager role. Then navigate to:

Connections -> Add new connection -> MS Fabric - Data Factory

This opens the import wizard described in the following steps.

Step 1. Host details

Provide connection details such as workspace. You will also be asked to name the Connection.

info

A Connection in Dataedo represents a saved configuration for accessing a data source. It can be reused for future imports and scheduling. Choose a clear, unique name so you can easily identify this connection later.

Step 2. Credentials

Choose credentials from the list of existing ones available for the selected connector, or add new credentials.

Supported authentication methods:

• Interactive - opens a browser-based Microsoft login flow where you sign in with your Microsoft account and grant access to Dataedo
• Service Principal - using Azure Application Registration

If you use Service Principal credentials, see Connecting with Service Principal (Microsoft Entra ID) for configuration details.

Step 3. Data Sources

• The Portal will display all data sources accessible with the provided credentials.
• For Fabric Data Factory, this means pipelines and Copy data activities available in the selected workspace.
• You can select the source(s) to import and use the search box to narrow down results.
• Each selected source should be given a Title, which will be visible in Dataedo.

Step 4. Objects to import

For each selected source, you can refine which objects to import:

• Pipelines
• Activities
• Sources
• Destinations

Step 5. Linked sources (optional)

A linked source refers to a connection between databases or systems established during the import process. They are essential for data lineage, enabling visualization and tracking of how data flows and transforms across systems.

In this step, you can map linked sources to existing Dataedo sources. This mapping can also be updated later in the Connection details.

Step 6. Schedule

caution

You must configure at least one import task in the schedule section. If you skip this, an empty database will be created and no metadata will be imported.

Define Metadata Import schedule options for each source individually:

• Run daily, on selected weekdays, or on specific days of the month.
• Choose an exact time of execution.
• Task state:
  • Active - the task will run as scheduled.
  • Draft - the task is saved but not executed until switched to Active.
• Run immediately - when checked, the task will also be executed right after clicking Create connection.

useful tip

Only one source in a metadata import can have Run immediately selected.

---

Connecting with Service Principal (Microsoft Entra ID)

The Microsoft Entra ID - Service Principal authentication option for Microsoft Fabric Data Factory uses the standard Microsoft Entra ID service principal setup flow.

1. Create (or reuse) an App Registration in Azure

If you already have an Azure Application Registration prepared for Microsoft Fabric API access, you can reuse it. Otherwise, create one as described below.

Creating Azure Application Registration

To create an Azure Application Registration:

1. Log in to the Azure Portal.
2. In the search bar, search for App registrations and select it from the list.
3. From the toolbar, on the App registrations page, click + New registration.
4. On the Register page for Name, enter a name of your client application, select supported account types, and Redirect URI as Public client/native, with http://localhost redirect URI.
   
5. Click Register.
6. On the homepage of your created application, from the Overview screen, copy the values for the Application (client) ID field and Directory (tenant) ID.
   
7. From the left menu of your created application registration page, click Certificates & secrets.
   
8. On the Certificates & secrets page, under Client secrets, click + New client secret.
   
9. In the Add client secret screen, enter the description, expiry and click Add.
10. On the Certificates & secrets page, under Client secrets copy the secret value and store it securely for use in Dataedo.

You will use these values in Dataedo:

• User = Application (client) ID
• Password = Client secret value

2. Configure Fabric permissions for the Service Principal

Configure workspace access for the Service Principal:

• Create a Security Group in Microsoft Entra ID and add the Service Principal (created from the App Registration) to that group.
• Add that Security Group (or the Service Principal directly, if applicable in your tenant) to the target Microsoft Fabric workspace.
• Assign the Viewer workspace role.

Open the target workspace and use Manage access:

Then add the Security Group / Service Principal and assign the Viewer role:

3. Use the Service Principal in Dataedo

In Dataedo Desktop (and in Portal credentials), configure authentication as follows:

• Authentication: Microsoft Entra ID - Service Principal
• User: Application (client) ID
• Password: Client secret value

useful tip

If the connection fails, verify the App Registration and confirm the Service Principal (or its Security Group) has Viewer access to the target workspace.

---

Importing Metadata in Dataedo Desktop

Metadata import is also possible using Dataedo Desktop.
In this mode, you can only import one source at a time.

Add new connection

To connect to a Microsoft Fabric Data Factory instance, create new documentation by clicking Add and choosing Database connection.

On the connection screen, choose MS Fabric.

Then pick MS Fabric - Data Factory.

Connection details

Provide connection details:

• Authentication - Way of authentication to be used when connecting:
  • Interactive - logging in with a Microsoft account
  • Microsoft Entra ID - Service Principal - Authentication using Service Principal (configuration details: Connecting with Service Principal (Microsoft Entra ID))
• Workspace - Select the Fabric workspace containing the pipelines you want to document
• Analyze Pipeline Runs - Enable to get lineage from runtime values of pipeline parameters
• Last days - Number of recent days for analyzing pipeline runs (default: 7)
• Recent runs - Number of recent runs per pipeline to analyze (default: 7)

Importing schema

After providing required connection parameters, click Connect to let Dataedo connect to your Microsoft Fabric instance.

When the connection is successful, Dataedo will read objects and show a list of objects found. You can choose which object types to import.

Confirm the list of objects to import by clicking Next.

The next screen allows you to change the default name of the documentation under which your schema will be visible in the Dataedo repository.

Click Import to start the import.

When done, close the import window with the Finish button.

Importing changes

To sync changes and reimport technical metadata, choose Import changes. You will be asked to connect to Microsoft Fabric - Data Factory again, and changes will be synced from the source.

Scheduling imports

You can also schedule metadata updates using command-line files. After creating documentation, use Save update command. The downloaded file can be run in the command line to reimport changes.

Microsoft Fabric support

Learn more about Microsoft Fabric support:

• Microsoft Fabric - Data Factory support
• Microsoft Fabric