How to execute a .purge command in ADX using Azure Data Factory?

Question

Approach 1

Created an ADX activity in ADF, and in the command field, I wrote the purge command (which I copied from Azure Docs): .purge table MyTable in database DBName allrecords

I tried running the purge command but it keeps returning syntax error: BadRequest_SyntaxError: Request is invalid and cannot be executed

Approach 2

Created a Web Activity in ADF, where I used a Linked Service, and set the following config:

Base URL as the URI of the Kusto cluster: https://<clusterName>.<region>.kusto.windows.net Authentication: System Assigned Managed Identity
Resource: https://<clusterName>.<region>.kusto.windows.net (URI of the Kusto cluster)
Relative URL: v1/rest/mgmt
Method: POST
Body:

{
    "db": "DBName",
    "csl": ".purge table MyTable in database DBName allrecords"
}

But it also returns the same error: BadRequest_SyntaxError: Request is invalid and cannot be executed

The user/role has Admin privileges to the cluster and Purge is enabled from the ADX Config.

Note that I'm not using the ingest- endpoint here to run purge because I couldn't get it to work and there isn't info available in the docs as to where to put the ingest- endpoint URL.

Yoni L. · Accepted Answer · 2024-06-12 19:11:23Z

0

it sounds like you're using the wrong URL/endpoint - as mentioned in the documentation: "Purge execution is invoked by running purge table TableName records command on the Data Management endpoint https://ingest-[YourClusterName].[Region].kusto.windows.net."

answered Jun 12, 2024 at 19:11

Yoni L.

26.5k3 gold badges46 silver badges63 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Shailesh Over a year ago

How exactly does it work? There is no way to configure that in ADX Activity. And for that to work in Web Activity in ADF, where do I need to put the ingest endpoint? In the base URL? What should be the relative URL?

Yoni L. Over a year ago

if the tool you've chosen (e.g., ADF) doesn't allow you to configure/execute the flow you need to (e.g., cause it only supports a specific type of endpoint which isn't the one you need), then you should consider using a different tool (examples are provided here, for instance Power Apps, Power Automate, Azure Functions, Logic Apps)

Shailesh Over a year ago

As I said, I tried to use Web Activity which technically should support this. But it's still giving the same error

Collectives™ on Stack Overflow

How to execute a .purge command in ADX using Azure Data Factory?

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related