I need to create an ADF pipeline to restart a databricks cluster. I am trying to do this using web activity by using token authentication. Token is saved in keyvault but how to fetch the token from keyvault and pass it in web activity without exposing the secret in pipeline run logs.
-
can you share what you have tried? and error you are facingPratik Lad– Pratik Lad2025-05-06 14:14:44 +00:00Commented May 6 at 14:14
-
stackoverflow.com/questions/78777623/… try to follow the samePritam– Pritam2025-05-06 16:57:38 +00:00Commented May 6 at 16:57
-
Please read How to AskDavid Makogon– David Makogon2025-05-07 23:43:02 +00:00Commented May 7 at 23:43
Add a comment
|
1 Answer
I need to create an ADF pipeline to restart a databricks cluster. I am trying to do this using web activity by using token authentication. Token is saved in keyvault but how to fetch the token from keyvault and pass it in web activity without exposing the secret in pipeline run logs.
Make sure your ADF instance has permission to access your Key Vault. You can do this by assigning the appropriate role using either RBAC (IAM) or by adding an Access Policy directly in the Key Vault settings to allow Get permission on secrets.
This allows you to securely pass the token into headers or bodies of subsequent Web activities by using dynamic content. "@activity('Web1').output.value"
Make sure to turn on Secure Inputs and Secure Outputs for any activities dealing with the secret. This ensures that the token doesn’t show up in pipeline run history or logs, protecting it from being viewed by unauthorized users.
Output :
Also you can refer SO
1 Comment
David Makogon
Please do not answer off-topic questions. The OP showed zero work. Plus, as written, it's not a programming question. This is not the place for someone to post requirements and receive custom solutions. And your answer isn't actually fixing/solving/answering anything specific (aside from implementing a spec)
