25

I want to use Azure CLI to get the list of all the VMs in my resource group. But I want to implement the same using a python script.

For example, I will use the following command in Azure CLI to list the VMs in my resource group:

" az vm list -g MyResourceGroup "

But, I want the python script to do the same, where I just have to incorporate the CLI command in the python program.

9
  • 3
    Just curious: Why attempt to call the CLI commands, when you already have the management REST API available to you, wrapped in a python SDK? The CLI and the various SDKs (including python) are built upon the same REST API. Commented Jul 26, 2018 at 19:23
  • its a lot easier to use cli, like a LOT. we were using some sdk calls and some cli calls in our python solution. mostly because of that Commented Jul 26, 2018 at 19:26
  • well, just do a standard shell command, thats it Commented Jul 26, 2018 at 19:26
  • 1
    @4c74356b41 - there is a function defined in the python sdk ( list_resources() ) for enumerating items in a resource group. Unless the OP is doing something esoteric, this is all built-in and has no dependency on running shell processes. Commented Jul 26, 2018 at 19:30
  • 1
    So, how do I use Python to run the Azure CLI? Commented Jul 26, 2018 at 19:55

7 Answers 7

27

I have been implementing this over the last couple days. The method that @cbehrenberg provides is mostly what I used, but I found that you can do it without using a temporary file. Instead catch the output directly from the azure client. Thought it might be useful.

from azure.cli.core import get_default_cli

def az_cli (args_str):
    args = args_str.split()
    cli = get_default_cli()
    cli.invoke(args)
    if cli.result.result:
        return cli.result.result
    elif cli.result.error:
        raise cli.result.error
    return True

Then invoked the same way:

from azhelper import az_cli

response = az_cli("vm list")
print("vm's: %s" % (response))
Sign up to request clarification or add additional context in comments.

7 Comments

If you want to suppress the output to stdout then invoke the cli like this: cli.invoke(args, out_file = open(os.devnull, 'w'))
When I run az ad sp list --display-name example-name --query "[].appId", I can get the result from the az cli but when I call this from a python script like run_az_cli('ad sp list --display-name example-name --query "[].appId"'), I don't get any results. This is happening when I include the --query "[].appId" to the string. Somehow, the cli couldn't get the result because I am assuming the library does not support something like --query "[].appId"? Have you ever try anything like this?
@alpersilistre Try removing the double quotes around your query - I ran into this issue today. The reason why the double quotes work in a shell but not with the az_cli function from this answer is that the shell interprets and then removes the quotes before handing the arguments to the az cli. The az_cli python function, on the other hand, just splits by space, leaving any quotes in place.
I am getting this error when I run this : CommandNotFoundError: 'az' is misspelled or not recognized by the system.
@Sajal - I was getting the same error message because we are including 'az' at the beginning of the arguments. Since the CLI automatically calls the 'az' command, we don't need to include it in the arg list.
|
12

How to run Azure CLI commands using python?

According to this file. we could invoke the Azure CLI with following way:

from azure.cli.core import get_default_cli
get_default_cli().invoke(['vm', 'list', '-g', 'groupname'])

Note : If you get No module named 'azure.cli.command_modules' error, please install azure-cli

enter image description here

1 Comment

I get the error you mentioned when packaging the app with cx_freeze. It works in the .py format just fine. Any thoughts why packaging is breaking it?
8

Using the subprocess solution is problematic as subprocess doesn't check the PATH where Azure CLI is found e.g. on Windows. To use "cmd -c" would be a Windows-specific solution and needs a fork if/else for additional Linux support.

@tom-sun's answer is almost correct, as you can reuse the Azure CLI python modules, as the CLI is also written in Python. Problem is, that the return of the .invoke() instruction is always returning the error code. To get the full body response, you must pass a file like object on the argument list of the underlying Knack Code to get the response. By default, this redirects to StdOut, that is why you can see it e.g. in your terminal but you always get a zero for success.

I wrote a little helper function that accepts the Azure CLI instructions in one string (I don't like many arguments as list, it doesn't read nicely - but that is just a personal preference, don't blame me). It uses a temporary file as output target and then it is read back in memory - this is required afaik from the underlying Knack CLI code; by default StdOut is the standard pipe.

It requires you to have azure-cli installed for Python: pip install azure-cli

File azhelper.py:

from azure.cli.core import get_default_cli
import tempfile

def az_cli (args_str):
    temp = tempfile.TemporaryFile()
    args = args_str.split()
    code = get_default_cli().invoke(args, None, temp)
    temp.seek(0)
    data = temp.read().strip()
    temp.close()
    return [code, data]

You can then invoke like this:

from azhelper import *

code, response = az_cli("vm list")
print("vm's: %s" % (response))

Of course you need to be logged in, see @4c74356b41 answer.

If somebody finds a better way to deal with the response instead with a temporary file, this would be much appreciated! I tried with an in memory StringIO object but this somehow doesn't comply with the underlying Knack CLI code.

2 Comments

Use supprocess.Popen() and the az binary instead. pipe json directly. My major reason for not using pypi azure-cli is that it is 335MB of modules that needs to be installed while the az binary (apt install azure-cli) just takes a few seconds.
I have to use tempfile.TemporaryFile(mode = "r+") and code = get_default_cli().invoke(args, out_file=temp) But all the other bits work great!! Thank you.
5

My understanding is that the current recommendation is to use the management libraries for this.

The SDK's management (or "management plane") libraries, the names of which all begin with azure-mgmt-, help you create, provision and otherwise manage Azure resources from Python scripts. All Azure services have corresponding management libraries.
With the management libraries, you can write configuration and deployment scripts to perform the same tasks that you can through the Azure portal or the Azure CLI.

More info here: Provision and manage Azure resources with management libraries

Comments

4

Use subprocess.run instead of using subprocess.Popen

It will by default cause python script to wait until the program run from subprocess (in this case azure cli command) is completed.

For example, let's create an Azure AD application.

import subprocess
import json

# create command you want to run on az cli as a string
create_app_command = "az ad sp create-for-rbac --skip-assignment --years 20 --name dummy_app"

# use 'shell = True' as Azure CLI installed on system is accessible from native shell
# using 'subprocess.PIPE' will return stderr and stdout to create_app object
create_app = subprocess.run(create_app_command, shell = True, stdout=subprocess.PIPE, stderr = subprocess.PIPE)

# reading output and error
create_app_stdout =  create_app.stdout.decode("utf-8")
create_app_stderr = create_app.stderr.decode("utf-8")

# now you can log error to a file 'logging.error(create_app_stderr)

# you can use stdout for further logic in code
# You get need to get appID and password for authentication somewhere later in code
ad_app_details = json.loads(create_app_stdout)
ad_app_appId = ad_app_details['appId']
ad_app_password = ad_app_details['password']

For more information on using subprocess module see this link

1 Comment

I have used subprocess where I construct the azure command separately as a string and then subprocess.run(<string>, shell=True). The inclusion of shell=True is critical.
3

since you still didnt delete this I assume you still looking for a way.

from subprocess import call   
call(["az", "vm", "list", "-g", "rgName"])

you will also need to silently auth first with something like:

az login --service-principal -u http://sample-cli-login -p Test1234 --tenant 54826b22-38d6-4fb2-bad9-b7b93a3e9c5a

Comments

2

I think you can use the subprocess and call the az cli to get the output instead using get_default_cli. Reference Git Repo

import subprocess
import json

process = subprocess.Popen(['az','network', 'ddos-protection', 'list'], stdout=subprocess.PIPE)
out, err = process.communicate()
d = json.loads(out)
print(d)

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.