0

I have a create function script .create-or-alter function that I am submitting to an ADX cluster every 5 mins using Azure Data Factory (ADF).

I keep firing the command .show journal to detect whether this was executed. The first time ADF submitted this script, when the function was not already there, the function got created and I could even see its entry using .show journal command. But after that I could not see 'ADD-FUNCTION' event in the latest output of .show journal even though I kept checking for a long time, and during this the pipeline has been succeeding.

I don't understand that if the pipeline is successfully submitting the existing create function script without any change , why ADX is not allowing to go through?

If I open existing function script in Kusto Explorer and just re-execute it without any change, it is reflected in .show journal but logically the same thing ADF is doing but that is not reflected in .show journal.

Just to experiment , I dropped this function using Kusto Explorer.

So, the next time when the ADF pipeline ran , it created the function again and that entry was reflected in the output of .show journal.

It means whenever we are re-submitting create function script from ADF to ADX , probably ADF checks if the function definition is changed , if not , it ignores the command ?

But then this check is not performed when we do the same thing from Kusto Explorer, which is strange.

ADX behavior should not change depending on how we are submitting commands.

Another interesting fact is that this behavior is unique to functions ,

I also tested re-creating the same update policy for a table through ADF again and again without any change and every time it ends up showing up in the output of .show journal.

Is this behavior a feature or a bug in case of functions?

1
  • just wanted to mention there is no ALTER-FUNCTION event as well , basically there is nothing in the output of .show journal command that would indicate that the function is updated , so probably ADX is preventing updating function with the same definition, the inconsistency is that it's only happening through ADF not from Kusto Explorer. So just want to know why. Commented Aug 4, 2021 at 21:11

1 Answer 1

2

From the ADX service's perspective, when you execute an .alter function or a .create-or-alter command that results with an existing function having the exact same body, parameters, folder and docstring - the command does nothing, and therefore nothing is written to the journal.

If you're seeing differently, I would recommend that you open a support ticket.

Sign up to request clarification or add additional context in comments.

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.