12,165 questions with Azure Data Factory tags

Sort by: Updated
1 answer

Can a single ADF pipeline trigger multiple Azure ML pipelines in parallel when their inputs and outputs are independent?

I have an Azure Data Factory pipeline that orchestrates a multi-stage classification workflow. Right now every activity is chained one after another with success dependencies, so the whole pipeline runs strictly sequentially and takes a long time…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-06-04T19:08:41.69+00:00
Inkey IT User 1 20 Reputation points
commented 2026-06-04T21:07:05.14+00:00
SAI JAGADEESH KUDIPUDI 3,215 Reputation points Microsoft External Staff Moderator
1 answer

Data factory - Azure Key Vault (Preview) Activity - bug?

The Azure Key Vault Activity in data factory (in preview) does not do anything - settings tab just says azure-key-vault-activity-settings works! Is this expected?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-06-04T08:40:23.46+00:00
Oliver Mills 0 Reputation points
commented 2026-06-04T16:57:30.03+00:00
Oliver Mills 0 Reputation points
3 answers

How to copy data from google secops platform using ADF

Hi there, How to copy data from google secops platform using ADF Thanks & Best regards, zmsoft

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-21T07:27:05.67+00:00
zmsoft 755 Reputation points
commented 2026-06-04T14:27:58.75+00:00
Pilladi Padma Sai Manisha 8,730 Reputation points Microsoft External Staff Moderator
1 answer

Any changes happened in the backend of Parse JSON Mapping data flow in ADF in Feb Week 2

Hi All, Is anyone else faced an issue with Json array not being parsed correctly in the ADF Mapping data flows. Earlier the string worked fined and able to parse the columns but it now shows Null Json Array is like [{"abc":"def",…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-26T17:18:58.1433333+00:00
Piyush Jain 0 Reputation points
commented 2026-06-04T13:51:06.25+00:00
Piyush Jain 0 Reputation points
4 answers

Some of the CDS connection copy activities in the Azure Data Factory pipelines have been stuck in the queue for a long time.

Today, the copy activities using the CDS connection have been stuck in the queue for a long time. Previously, these activities used to complete within minutes, but today they have been in the queue state for 3–4 hours.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-29T11:04:18.1833333+00:00
Dharma Teja Mukka 0 Reputation points Microsoft Employee
answered 2026-06-04T05:52:37.65+00:00
Dharma Teja Mukka (HCL AMERICA INC) 0 Reputation points Microsoft External Staff
2 answers

Azure Data Factory: Inquiry on New Undocumented Property 'trustModeClaimForMi'

It looks like PG added a new undocumented property on data factory resource properties: "trustModeClaimForMi": { "value": "Enabled", "editable": true } Any ideas about this and any ETA when…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2025-08-08T09:06:38.5766667+00:00
Janne Kujanpää 261 Reputation points
edited an answer 2026-06-03T13:16:59.1533333+00:00
Jaap van der Herberg 0 Reputation points
1 answer

Storage firewall blocking Snowflake stage access for ADF Oracle to Snowflake pipeline

Hi Azure Team, Our ADF pipeline (Oracle to Snowflake) is failing during Snowflake load with stage access error. Observed error: Operation on target Oracle to Snowflake_2024_v1 failed with SnowflakeOperationError. Failure using stage area. Status Code:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-06-01T09:32:54.8766667+00:00
Vashishtha, Kritika 0 Reputation points
commented 2026-06-03T12:55:20.0766667+00:00
Manoj Kumar Boyini 16,150 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

ADF Pipeline issues [Sev 2 ] [MAQ Software] - [ADF Pipeline Execution Delay – Pipelines Persistently Queued During Refresh Window]

Issue Description: We are currently facing an issue where multiple ADF pipelines are remaining in the Queued state for an extended duration during 5/29 refresh process. Pipelines that normally complete within a few minutes are now queued for more than 2…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-29T14:41:08.0133333+00:00
Shruti Rastogi (Maq LLC) 20 Reputation points Microsoft External Staff
accepted 2026-06-03T06:54:22.42+00:00
Shruti Rastogi (Maq LLC) 20 Reputation points Microsoft External Staff
2 answers

Data from FoxPro Onprem server to ADLS

Hi Team, We are using FoxPro 9.0 x3 server in our organization that has some logs with emaint data. I would like to know if there is any way I can download or import the data (.dbf files) to ADLS in Azure using the ADF. Fyi, I have server name and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-19T14:20:26.71+00:00
Nalini Bhavaraju 190 Reputation points
commented 2026-05-29T17:30:49.0733333+00:00
Nalini Bhavaraju 190 Reputation points
2 answers

Azure Data Factory PostgreSqlV2 connector incorrectly serializing DATE columns as internal .NET type name

We are experiencing a sudden issue with an Azure Data Factory pipeline that extracts data from a PostgreSQL source and writes to Parquet files. Since yesterday, the pipeline has started failing without any deployment or configuration changes on our…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-20T08:58:19.4366667+00:00
djemtc 0 Reputation points
commented 2026-05-27T10:45:18.9133333+00:00
Pilladi Padma Sai Manisha 8,730 Reputation points Microsoft External Staff Moderator
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-25T23:37:24.3633333+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
answered 2026-05-25T23:37:45.3633333+00:00

AI answer

2 answers

Quote character and escape character in ADF

Hi, We need to load data from delimited file in storage account to table in dedicated sql pool.. All the record values are enclosed with double quotes (" " ) and column delimiter is pipe (|) For example :- …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2023-02-23T05:02:01.5533333+00:00
M, Murugeswari (Cognizant) 461 Reputation points
commented 2026-05-25T14:14:21.7+00:00
Jinka Chandra Kiran 0 Reputation points
1 answer

Autoupdate on SHIR seems to have re-nabled and forced a restart of the SHIR service

On April 27th we had an issue with batch jobs that caused delays on key business process, which drew quite a bit of attention. After some initial investigation it was found that the overnight jobs failed because the SHIR they were running on had the SHIR…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-21T13:05:18.35+00:00
Marsden, Padraic 0 Reputation points
commented 2026-05-22T13:46:51.82+00:00
Marsden, Padraic 0 Reputation points
2 answers

I want to document ADF pipelines runs / triggers

I want to document ADF pipelines runs / triggers in excel or PowerBI (for report purpose) and note what the data is being used for and source and target data as well as trigger times.. how often and when does it run. Is there any way that I can get these…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2025-04-22T20:40:49.32+00:00
Duyen Su 0 Reputation points
answered 2026-05-22T04:34:45.59+00:00
Tejas Dalbhanjan 0 Reputation points
3 answers

ADF when publishing, the arm templates generation failed with Corporate Public network Disabled errror- how to resolve?

ADF settings show networking with Public Endpoint ADF is using Managed Virtual networks with private endpoints to reach out of other AZ resources When publishing the arm templates generation failed with this error: Generating ARM templates …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-13T18:09:13.11+00:00
Nguyen, Hoa 421 Reputation points
recommended 2026-05-19T22:45:29.96+00:00
Alexandra Tanasescu 0 Reputation points Moderator
1 answer

FoxPro 9.0 to Azure Storage via Azure Data Factory

Hi Team, We are using FoxPro 9.0 x3 server in our organization that has some logs with emaint data. I am unable to find the database details. I would like to know if there is any way I can download or import the data to SQL server in Azure or Azure Data…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2025-03-27T20:51:52.34+00:00
Nalini Bhavaraju 190 Reputation points
commented 2026-05-18T20:08:15.89+00:00
Nalini Bhavaraju 190 Reputation points
2 answers

Best Approach to Move Selected Azure Resources Between Dev and Prod Subscriptions

Hi Everyone, I currently have a Dev Azure subscription containing the following resources: Azure Data Factory with 100 pipelines Azure SQL Database with: 150 tables 100 stored procedures 20 views 10 functions 10 Logic Apps ADLS Gen2 storage account Azure…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-14T05:35:38.22+00:00
SYN 125 Reputation points
commented 2026-05-18T13:02:04.1933333+00:00
Manoj Kumar Boyini 16,150 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

How to fix "Status code 400, "{"error":{"code":"InvalidSubscriptionId","message":"The provided subscription identifier 'resourceGroups' is malformed or invalid."}}""

While testing connectivity in Azure Data Factory (ADF), the dataset test connection succeeds, but the data flow test connection fails with the following error: Status code: 400 { "error": { "code":…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-05T21:23:42.77+00:00
Jaya Vardhani Mamidala 25 Reputation points Microsoft Employee
recommended 2026-05-17T06:55:52.26+00:00
JuliaMarvin 19,255 Reputation points Volunteer Moderator
2 answers One of the answers was accepted by the question author.

Azure Data Factory UserErrorSourceQueryTimeout caused by Linked Service Azure Database for Postgresql

Hello, Recently, I have encountered the following error for Lookup or Script activities when the activity takes longer than 15 minutes to complete: Operation on target Lookup1 failed: Failure happened on 'Source' side.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2025-09-16T08:41:47.3533333+00:00
Mateusz Gródek 30 Reputation points
commented 2026-05-15T09:23:49.79+00:00
Sewina, Michael 0 Reputation points
2 answers

AzureDataLakeStore does not support MSI authentication in data flow.

We are using MSI in Azure data but when we make a change to this pipeline even if not related (triggers) we are always seeing the same issue: AzureDataLakeStore does not support MSI authentication in data flow. Would it be possible to make a change to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,165 questions
asked 2026-05-11T19:06:19.0966667+00:00
Roby Saldana 0 Reputation points Microsoft Employee
commented 2026-05-14T23:46:42.86+00:00
SAI JAGADEESH KUDIPUDI 3,215 Reputation points Microsoft External Staff Moderator