Synapse link and security
Hi All. I am looking for any form of white paper on securing dataverse data access from synapse link/data lake and serverless synapse formerly SQL DW. From my investigation, when synapse link gets the data over to a data lake, there are concerns that…
Azure Synapse Analytics
Synapse Spark Pool stuck in Provisioning state and cannot be deleted
Hello Azure Support, Our Azure Synapse Spark Pool "spicebergsmall" is stuck in the Provisioning state, and we cannot delete or update it. Error Message: ResourceInUnupdatableState: Spark pool is not in a terminal state (Succeeded or Failed).…
Azure Synapse Analytics
unable to create dataset in azure data factory
Hi Team, I am unable to create dataset in azure data factory. i am getting the below issue Failed to load Failed to resolve the server name "dpwesteurope.svc.datafactory.azure.com", please refer to troubleshooting doc and check network…
Azure Data Factory
Azure Synapse Analytics
Optimized Apache Spark pools cluster to run parallel notebook in Synapse
I have a cluster(apache spark pool) in azure synapse analytics of the below size With the above cluster configuration when I am using this same cluster in my synapse pipeline to run notebooks I am only able to run 8 notebooks in foreach parallelly. …
Azure Synapse Analytics
Intermittent Spark Pool Failures and Increased Startup Time After Upgrading to Spark 3.5 in Azure Synapse
We recently upgraded our Synapse Spark pools from version 3.4 to 3.5. As part of the upgrade process, we followed these steps: Removed custom packages from the pools Upgraded the Spark pool version to 3.5 Re-attached the required packages After the…
Azure Synapse Analytics
Why doesn't the storage account show in the dropdown when creating an Azure Synapse Link?
Trying to create an Azure Synapse Analytics link for a newly created Azure Synapse workspace. Both the workspace and the storage account are in the same region, but the storage account doesn't show in the dropdown. Please see attached.
Azure Synapse Analytics
Azure Synapse Link in Power Apps stopped sending new files after Oct 16 – now appending to existing files
We have an Azure Synapse Link configured with a Data Lake in Power Apps.Previously, we received new folders with date and timestamp every hour, each containing fresh data. However, since October 16th, no new timestamped folders have been created.…
Azure Synapse Analytics
Repeated failure to deploy an Azure Synapse Analytics workspace
I need to create an Azure Synapse Analytics workspace to support report development for our D365 Commerce project that has just started. I've created a resource group and storage account, both in the EastUS region. But I am repeatedly getting the below…
Azure Synapse Analytics
How to collect information of Users running Insert/Update/Delete Command on the Synapse Pool?
I am looking for a solution which collects information of users who have executed Insert/Update/Delete command on synapse. Tried the Log Analytics Route but the table SynapseSQLPoolRequests only contains Statement type and not Login ID, DMVs store 10,000…
Azure Synapse Analytics
Copy activity and lookup activity for synapse pipelines for some tables are failing because of out of memory , java native interface . SHIR is installed in source system , High availability is not enabled , only one node is available
Copy activity and lookup activity for synapse pipelines for some tables are failing because of below errors { "errorCode": "1000", "message":…
Azure Synapse Analytics
Error when deploying Synapse
I keep getting the below error when trying to deploy Synapse in Azure. I have tried to change regions and I have unregistered and re-registered services multiple times.. Please help Location 'xxxx' is not accepting creation of new Windows Azure SQL…
Azure Synapse Analytics
Issues with Synapse Workflows After Updating Self-hosted Integration Runtime
After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…
Azure Synapse Analytics
v3.5 is marked as “GA”. Hence does the comment below “It is advisable to continue using Spark 3.4 at this time if your workloads require consistent startup times and reliable package installations via requirements.txt.” still hold true? If yes, then when
Hello Team, Spark pool v3.5 is marked as “GA”. Hence does the comment below “It is advisable to continue using Spark 3.4 at this time if your workloads require consistent startup times and reliable package installations via requirements.txt.” still hold…
Azure Synapse Analytics
User gets "Login failed for user '<token-identified principal>'" when creating a DB in Synapse serverless SQL pool, despite having admin roles
Hi everyone, I have an Azure Synapse Analytics workspace, and I’m trying to give another user access to create a database in the Built-in serverless SQL pool. Here’s what I’ve done so far: In the Synapse workspace, under Manage → Security → Access…
Azure Synapse Analytics
Issues with Synapse Workflows After Auto-Update of Self-Hosted Integration Runtime to 5.55.9315.1 (Salesforce V2 Empty-Result Parquet Schema Regression)
Description After our Self-Hosted Integration Runtime (SHIR) auto-updated to v5.55.9315.1 on November 15, 2025, Synapse pipelines that use the Salesforce V2 connector began producing Parquet files with an incomplete schema when an incremental load…
Azure Synapse Analytics
Salesforce connected App suddenly stopped working
My salesforce linked service in Azure Synapse stopped working on 4th october around 03:00. Here is the error response: Unable to establish connection to the Salesforce environment using provided client id and client secret, please verify the details.…
Azure Synapse Analytics
CI/CD deployment of synapse workspace failing on second set of artifacts...
I have a CICD pipeline for deploying my synapse workspace and additional artifacts to production. Step 1 (succeeds) deploys/creates the workspace. Step 2 (succeeds) uses the TemplateForWorkspace.json to deploy all the artifacts (notebooks, pipelines,…
Azure Synapse Analytics
Synapse PySpark Notebook issue with Storing Streaming data to ADLS
In Synapse PySpark notebook I am reading data from Event Hub and trying to write/save to ADLS using spark structured streaming as below:- json_schema = StructType([ StructField("id", IntegerType()), StructField("temp",…
Azure Synapse Analytics
Azure Synapse Copy Activity REST sink HTTP compression is corrupting the payload
I believe there is a bug in azure synapse that is causing the payload to be corrupted on a REST sink with http compression turned on. When http compression is set to GZIP the payload is either empty or corrupt, it's hard to say. Is this a known issue?…
Azure Synapse Analytics
Auto Resolve Integration Runtime is starting in US region even though Source and Sink are in Australia region. This has increased the bill drastically. How to correct it?
We have create a Azure Synapse Pipeline which is connecting to source Business Central hosted in Australia and ingesting data into sink Data Lake Storage which is also hosted in Australia region. But Auto Resolve Integration Runtime is starting in US…
Azure Synapse Analytics