Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
2 answers
How to implement a dynamic trigger interval in ADF without creating infinite loops or pipeline concurrency issues?
Hello everyone, I am currently working on optimizing an existing data pipeline in Azure Data Factory (ADF) and I am facing an architectural challenge regarding dynamic scheduling. Here is my current setup: The pipeline is currently triggered by a fixed…
Azure Data Factory
asked 2026-06-17T13:09:37.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 41%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
Fasd
0
Reputation points
commented 2026-06-19T09:25:52.2666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
2 answers
Does the Azure Data Factory HubSpot connector v2.0 (Preview) support incremental load?
The HubSpot connector 1.0 supported incremental loads by means of passing a query. The new 2.0 connector does not support queries. Does that mean the new connector does not support incremental loads, or is there some other option? Fetching all of the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-15T07:21:26.49+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 45%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETR%3C/text%3E%3C/svg%3E)
Tariq Riahi
0
Reputation points
commented 2026-06-19T09:20:54.77+00:00
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
3 answers
Azure Data Factory Private endpoint for Portal Endpoint
Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-05T12:04:07.2533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 54%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Sumit Gaur
455
Reputation points
commented 2026-06-19T01:57:18.7533333+00:00
Sumit Gaur
455
Reputation points
1 answer
Data Flow source test connection to Cosmos DB fails with InvalidSubscriptionId error via Managed VNet Private Endpoint
Azure Data Factory Data Flow fails to connect to Azure Cosmos DB (SQL API) when using Managed Virtual Network with a Managed Private Endpoint. The Copy Activity works correctly with the same linked service and private endpoint configuration. Error…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-15T06:01:45.58+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 23%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYR%3C/text%3E%3C/svg%3E)
Yeshwanth Reddy Sangam
0
Reputation points Microsoft Employee
answered 2026-06-18T17:40:19.47+00:00
Yeshwanth Reddy Sangam
0
Reputation points Microsoft Employee
3 answers
One of the answers was accepted by the question author.
ADF Trigger Schedules
Can we schedule the trigger for once in last working day of the month?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-17T11:27:24.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 62%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
M, Pratibha
20
Reputation points
accepted 2026-06-18T07:18:04.1933333+00:00
M, Pratibha
20
Reputation points
2 answers
How to break ForEach loop in ADF
Hi everyone, I have a ForEach activity containing a Copy Data task. The Problem: By default, if one iteration fails, the ForEach continues to trigger all other iterations. In my case, if the first one fails, the following ones are guaranteed to fail as…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-05T15:10:56.3066667+00:00
Fasd
0
Reputation points
commented 2026-06-17T23:23:56.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 49%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESJ%3C/text%3E%3C/svg%3E)
SAI JAGADEESH KUDIPUDI
3,470
Reputation points Microsoft External Staff
Moderator
1 answer
Not able to create ADF due regional constraint in student free tier account
Not able to create Data Factory due to the below error-
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2025-08-10T05:47:26.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 10%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
#AVINASH CHAURASIYA#
5
Reputation points
commented 2026-06-12T14:40:32.3866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 95%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES3%3C/text%3E%3C/svg%3E)
SukritaMadhi-3206
0
Reputation points
2 answers
Azure Data Factory Copy activity failing due DNS resolution issue
We have a Data Factory in which our Data Engineers have created a copy activity to pull data from a SQL server which is hosted inside a Azure VM and this VM also act as a SHIR and the target is a storage account and we the same VM as the SHIR. The VM and…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-05T12:43:11.58+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 43%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Sahil Chaudhry
20
Reputation points
commented 2026-06-11T03:05:25.4766667+00:00
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
2 answers
Azure Data Factory Dataverse to SQL - Timeout failures when creating table.
I'm getting repeated and consistent timeout failures during the DataverseToSQL pipeline step of the following guide. The process fails due to a timeout when attempting to create a table on the SQL server. What can I do to resolve this? …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-08T14:11:03.27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 96%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJF%3C/text%3E%3C/svg%3E)
Jordan Fulford
1
Reputation point
commented 2026-06-11T03:04:53.8633333+00:00
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
2 answers
Autoupdate on SHIR seems to have re-nabled and forced a restart of the SHIR service
On April 27th we had an issue with batch jobs that caused delays on key business process, which drew quite a bit of attention. After some initial investigation it was found that the overnight jobs failed because the SHIR they were running on had the SHIR…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-21T13:05:18.35+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 86%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Marsden, Padraic
0
Reputation points
answered 2026-06-10T18:12:00.2366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
17,060
Reputation points Microsoft External Staff
Moderator
1 answer
Timestamp being logged incorrectly some of the time.
I have an ADF pipeline that starts by writing utcnow to a string pipeline variable, then performs operations with assorted casts to different form factors with formatdatetime, including several script blocks that log to a snowflake log table, all based…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-05T19:57:37.6533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 96%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGR%3C/text%3E%3C/svg%3E)
Greg R
0
Reputation points
commented 2026-06-10T17:38:19.7633333+00:00
SAI JAGADEESH KUDIPUDI
3,470
Reputation points Microsoft External Staff
Moderator
3 answers
One of the answers was accepted by the question author.
Data factory - Azure Key Vault (Preview) Activity - bug?
The Azure Key Vault Activity in data factory (in preview) does not do anything - settings tab just says azure-key-vault-activity-settings works! Is this expected?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-04T08:40:23.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 56.00000000000001%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOM%3C/text%3E%3C/svg%3E)
Oliver Mills
40
Reputation points
accepted 2026-06-10T09:34:47.3833333+00:00
Oliver Mills
40
Reputation points
1 answer
Any changes happened in the backend of Parse JSON Mapping data flow in ADF in Feb Week 2
Hi All, Is anyone else faced an issue with Json array not being parsed correctly in the ADF Mapping data flows. Earlier the string worked fined and able to parse the columns but it now shows Null Json Array is like [{"abc":"def",…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-26T17:18:58.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 51%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPJ%3C/text%3E%3C/svg%3E)
Piyush Jain
0
Reputation points
commented 2026-06-10T04:12:02.1333333+00:00
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
Schema Enforcement Strategy for Salesforce to Blob to Data Flow Pipelines
We have a common Azure Data Factory pipeline that extracts Salesforce data via SOQL, stages it as JSON in Blob Storage, and then loads it through Mapping Data Flows. We observed a case where a field such as BillingPostalCode was interpreted as integer…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-08T15:49:39.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 75%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBG%3C/text%3E%3C/svg%3E)
Bilesh Ganguly
20
Reputation points
accepted 2026-06-08T18:07:11.16+00:00
Bilesh Ganguly
20
Reputation points
1 answer
Can a single ADF pipeline trigger multiple Azure ML pipelines in parallel when their inputs and outputs are independent?
I have an Azure Data Factory pipeline that orchestrates a multi-stage classification workflow. Right now every activity is chained one after another with success dependencies, so the whole pipeline runs strictly sequentially and takes a long time…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-04T19:08:41.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 99%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EII%3C/text%3E%3C/svg%3E)
Inkey IT User 1
20
Reputation points
commented 2026-06-08T16:48:05.27+00:00
SAI JAGADEESH KUDIPUDI
3,470
Reputation points Microsoft External Staff
Moderator
2 answers
Azure Data Factory: Inquiry on New Undocumented Property 'trustModeClaimForMi'
It looks like PG added a new undocumented property on data factory resource properties: "trustModeClaimForMi": { "value": "Enabled", "editable": true } Any ideas about this and any ETA when…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2025-08-08T09:06:38.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 45%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
Janne Kujanpää
266
Reputation points
commented 2026-06-05T12:19:22.6+00:00
Janne Kujanpää
266
Reputation points
3 answers
How to copy data from google secops platform using ADF
Hi there, How to copy data from google secops platform using ADF Thanks & Best regards, zmsoft
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-21T07:27:05.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
zmsoft
755
Reputation points
commented 2026-06-04T14:27:58.75+00:00
Pilladi Padma Sai Manisha
10,190
Reputation points Microsoft External Staff
Moderator
4 answers
Some of the CDS connection copy activities in the Azure Data Factory pipelines have been stuck in the queue for a long time.
Today, the copy activities using the CDS connection have been stuck in the queue for a long time. Previously, these activities used to complete within minutes, but today they have been in the queue state for 3–4 hours.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-29T11:04:18.1833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 6%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDT%3C/text%3E%3C/svg%3E)
Dharma Teja Mukka
0
Reputation points Microsoft Employee
answered 2026-06-04T05:52:37.65+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 78%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDT%3C/text%3E%3C/svg%3E)
Dharma Teja Mukka (HCL AMERICA INC)
0
Reputation points Microsoft External Staff
2 answers
One of the answers was accepted by the question author.
ADF Pipeline issues [Sev 2 ] [MAQ Software] - [ADF Pipeline Execution Delay – Pipelines Persistently Queued During Refresh Window]
Issue Description: We are currently facing an issue where multiple ADF pipelines are remaining in the Queued state for an extended duration during 5/29 refresh process. Pipelines that normally complete within a few minutes are now queued for more than 2…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-05-29T14:41:08.0133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 13%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Shruti Rastogi (Maq LLC)
20
Reputation points Microsoft External Staff
accepted 2026-06-03T06:54:22.42+00:00
Shruti Rastogi (Maq LLC)
20
Reputation points Microsoft External Staff
2 answers
Storage firewall blocking Snowflake stage access for ADF Oracle to Snowflake pipeline
Hi Azure Team, Our ADF pipeline (Oracle to Snowflake) is failing during Snowflake load with stage access error. Observed error: Operation on target Oracle to Snowflake_2024_v1 failed with SnowflakeOperationError. Failure using stage area. Status Code:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,173 questions
asked 2026-06-01T09:32:54.8766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 91%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVK%3C/text%3E%3C/svg%3E)
Vashishtha, Kritika
0
Reputation points
answered 2026-06-02T20:41:47.4066667+00:00
Manoj Kumar Boyini
17,060
Reputation points Microsoft External Staff
Moderator