5,526 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Synapse link and security

Hi All. I am looking for any form of white paper on securing dataverse data access from synapse link/data lake and serverless synapse formerly SQL DW. From my investigation, when synapse link gets the data over to a data lake, there are concerns that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-09-12T18:04:29.38+00:00
MrFlinstone 706 Reputation points
edited a comment 2025-11-21T20:49:05.1933333+00:00
Swapnesh Panchal 985 Reputation points Microsoft External Staff Moderator
1 answer

Synapse Spark Pool stuck in Provisioning state and cannot be deleted

Hello Azure Support, Our Azure Synapse Spark Pool "spicebergsmall" is stuck in the Provisioning state, and we cannot delete or update it. Error Message: ResourceInUnupdatableState: Spark pool is not in a terminal state (Succeeded or Failed).…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-20T20:21:11.35+00:00
seonghyeon heo 0 Reputation points
commented 2025-11-21T18:22:46.3333333+00:00
seonghyeon heo 0 Reputation points
5 answers

unable to create dataset in azure data factory

Hi Team, I am unable to create dataset in azure data factory. i am getting the below issue Failed to load Failed to resolve the server name "dpwesteurope.svc.datafactory.azure.com", please refer to troubleshooting doc and check network…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,962 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2023-01-20T12:51:19.5566667+00:00
Ramakrishnan Sivasubramanian 0 Reputation points
answered 2025-11-21T10:12:47.76+00:00
Tayyab Awais 0 Reputation points
1 answer

Optimized Apache Spark pools cluster to run parallel notebook in Synapse

I have a cluster(apache spark pool) in azure synapse analytics of the below size With the above cluster configuration when I am using this same cluster in my synapse pipeline to run notebooks I am only able to run 8 notebooks in foreach parallelly. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-11T13:36:17.43+00:00
ADITYA SINGH 0 Reputation points
commented 2025-11-21T07:11:54.0266667+00:00
ADITYA SINGH 0 Reputation points
3 answers

Intermittent Spark Pool Failures and Increased Startup Time After Upgrading to Spark 3.5 in Azure Synapse

We recently upgraded our Synapse Spark pools from version 3.4 to 3.5. As part of the upgrade process, we followed these steps: Removed custom packages from the pools Upgraded the Spark pool version to 3.5 Re-attached the required packages After the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-09-22T10:41:50.43+00:00
Nikhil Singh 50 Reputation points
commented 2025-11-21T04:23:12.9433333+00:00
VRISHABHANATH PATIL 1,480 Reputation points Microsoft External Staff Moderator
0 answers

Why doesn't the storage account show in the dropdown when creating an Azure Synapse Link?

Trying to create an Azure Synapse Analytics link for a newly created Azure Synapse workspace. Both the workspace and the storage account are in the same region, but the storage account doesn't show in the dropdown. Please see attached.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-19T20:35:45.9966667+00:00
Kevin Boteler 5 Reputation points
commented 2025-11-20T21:05:34.1333333+00:00
Swapnesh Panchal 985 Reputation points Microsoft External Staff Moderator
2 answers

Azure Synapse Link in Power Apps stopped sending new files after Oct 16 – now appending to existing files

We have an Azure Synapse Link configured with a Data Lake in Power Apps.Previously, we received new folders with date and timestamp every hour, each containing fresh data. However, since October 16th, no new timestamped folders have been created.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-05T15:41:17.4066667+00:00
Devika Dev 25 Reputation points
commented 2025-11-20T11:02:45.7466667+00:00
Weronika Kacprzak 0 Reputation points
3 answers

Repeated failure to deploy an Azure Synapse Analytics workspace

I need to create an Azure Synapse Analytics workspace to support report development for our D365 Commerce project that has just started. I've created a resource group and storage account, both in the EastUS region. But I am repeatedly getting the below…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-14T02:51:43.22+00:00
Kevin Boteler 5 Reputation points
answered 2025-11-19T20:37:40.52+00:00
Kevin Boteler 5 Reputation points
2 answers One of the answers was accepted by the question author.

How to collect information of Users running Insert/Update/Delete Command on the Synapse Pool?

I am looking for a solution which collects information of users who have executed Insert/Update/Delete command on synapse. Tried the Log Analytics Route but the table SynapseSQLPoolRequests only contains Statement type and not Login ID, DMVs store 10,000…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-10T08:45:03.1933333+00:00
Pradyumn Joshi 60 Reputation points
accepted 2025-11-19T13:48:51.5066667+00:00
Pradyumn Joshi 60 Reputation points
1 answer

Copy activity and lookup activity for synapse pipelines for some tables are failing because of out of memory , java native interface . SHIR is installed in source system , High availability is not enabled , only one node is available

Copy activity and lookup activity for synapse pipelines for some tables are failing because of below errors   {     "errorCode": "1000",     "message":…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-13T11:40:17.5266667+00:00
Suraj Surendran 60 Reputation points
commented 2025-11-19T11:23:49.08+00:00
Kalyani Kondavaradala 4,015 Reputation points Microsoft External Staff Moderator
3 answers

Error when deploying Synapse

I keep getting the below error when trying to deploy Synapse in Azure. I have tried to change regions and I have unregistered and re-registered services multiple times.. Please help Location 'xxxx' is not accepting creation of new Windows Azure SQL…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-06T20:52:18.8666667+00:00
Mike Fried 0 Reputation points
edited a comment 2025-11-18T10:48:03.5866667+00:00
Kalyani Kondavaradala 4,015 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

Issues with Synapse Workflows After Updating Self-hosted Integration Runtime

After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-06-23T13:01:54.3233333+00:00
John Brynford-Jones 26 Reputation points
answered 2025-11-18T09:00:33.0066667+00:00
Jasper Batterink 5 Reputation points
2 answers

v3.5 is marked as “GA”. Hence does the comment below “It is advisable to continue using Spark 3.4 at this time if your workloads require consistent startup times and reliable package installations via requirements.txt.” still hold true? If yes, then when

Hello Team, Spark pool v3.5 is marked as “GA”. Hence does the comment below “It is advisable to continue using Spark 3.4 at this time if your workloads require consistent startup times and reliable package installations via requirements.txt.” still hold…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-14T05:40:41.3333333+00:00
Nikhil Singh 50 Reputation points
commented 2025-11-18T06:34:18.2766667+00:00
Smaran Thoomu 32,365 Reputation points Microsoft External Staff Moderator
2 answers

User gets "Login failed for user '<token-identified principal>'" when creating a DB in Synapse serverless SQL pool, despite having admin roles

Hi everyone, I have an Azure Synapse Analytics workspace, and I’m trying to give another user access to create a database in the Built-in serverless SQL pool. Here’s what I’ve done so far: In the Synapse workspace, under Manage → Security → Access…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-10-23T10:49:18.9866667+00:00
Priyesh Shrestha 0 Reputation points
commented 2025-11-18T06:01:04.8+00:00
Pilladi Padma Sai Manisha 340 Reputation points Microsoft External Staff Moderator
1 answer

Issues with Synapse Workflows After Auto-Update of Self-Hosted Integration Runtime to 5.55.9315.1 (Salesforce V2 Empty-Result Parquet Schema Regression)

Description After our Self-Hosted Integration Runtime (SHIR) auto-updated to v5.55.9315.1 on November 15, 2025, Synapse pipelines that use the Salesforce V2 connector began producing Parquet files with an incomplete schema when an incremental load…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-17T20:19:47.57+00:00
Jeff S 5 Reputation points
commented 2025-11-17T22:06:17.43+00:00
Jeff S 5 Reputation points
1 answer One of the answers was accepted by the question author.

Salesforce connected App suddenly stopped working

My salesforce linked service in Azure Synapse stopped working on 4th october around 03:00. Here is the error response: Unable to establish connection to the Salesforce environment using provided client id and client secret, please verify the details.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-10-06T11:18:27.1866667+00:00
Balazs Farkas 25 Reputation points
commented 2025-11-17T15:53:33.59+00:00
Jason Zech 0 Reputation points
1 answer

CI/CD deployment of synapse workspace failing on second set of artifacts...

I have a CICD pipeline for deploying my synapse workspace and additional artifacts to production. Step 1 (succeeds) deploys/creates the workspace. Step 2 (succeeds) uses the TemplateForWorkspace.json to deploy all the artifacts (notebooks, pipelines,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-14T20:13:57.02+00:00
Jane Illarionova 1 Reputation point Microsoft Employee
edited the question 2025-11-17T10:34:06.3+00:00
Smaran Thoomu 32,365 Reputation points Microsoft External Staff Moderator
3 answers

Synapse PySpark Notebook issue with Storing Streaming data to ADLS

In Synapse PySpark notebook I am reading data from Event Hub and trying to write/save to ADLS using spark structured streaming as below:- json_schema = StructType([ StructField("id", IntegerType()), StructField("temp",…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-03T13:38:50.13+00:00
Srinivas Challagolla 0 Reputation points
commented 2025-11-17T10:22:49.5666667+00:00
Smaran Thoomu 32,365 Reputation points Microsoft External Staff Moderator
1 answer

Azure Synapse Copy Activity REST sink HTTP compression is corrupting the payload

I believe there is a bug in azure synapse that is causing the payload to be corrupted on a REST sink with http compression turned on. When http compression is set to GZIP the payload is either empty or corrupt, it's hard to say. Is this a known issue?…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-05T23:42:56.99+00:00
Seth Coleman 51 Reputation points
commented 2025-11-17T10:15:53.87+00:00
Smaran Thoomu 32,365 Reputation points Microsoft External Staff Moderator
1 answer

Auto Resolve Integration Runtime is starting in US region even though Source and Sink are in Australia region. This has increased the bill drastically. How to correct it?

We have create a Azure Synapse Pipeline which is connecting to source Business Central hosted in Australia and ingesting data into sink Data Lake Storage which is also hosted in Australia region. But Auto Resolve Integration Runtime is starting in US…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,526 questions
asked 2025-11-17T09:21:22.72+00:00
DataLake Admin 0 Reputation points
answered 2025-11-17T09:21:37.3633333+00:00
Q&A Assist