Python: get output from a command line which exits with nonzero exit code

Question

I am Using Python 2.7.1 on a Windows Server 2008 R2 x64 box.

I'm trying to get the output of a command line process which gives a nonzero exit status after outputting the information I need.

I was initially using subprocess.check_output, and catching the CalledProcessError which occurs with nonzero exit status, but while the returncode was stored in the error, no output revealed this.

Running this against cases which give output but have an exit status of 0 works properly and I can get the output using subprocess.check_output.

My assumption was that the output was being written to STDOUT but the exception pulls its 'output' from STDERR. I've tried to re implement the functionality of check_output, but I still get nothing on the output when I believe I should be seeing output to STDOUT and STDERR. My current code is below (where 'command' is the full text, including parameters, of command I am running:

process = subprocess.Popen(command, stdout=subprocess.PIPE, 
stderr=subprocess.STDOUT, universal_newlines=True)
output = process.communicate()
retcode = process.poll()
if retcode:
    raise subprocess.CalledProcessError(retcode, image_check, output=output)
    return output

This gives me the following in the variable output: [('', None)]

Is my subprocess.Popen code correct?

after .communicate(), you could use process.returncode directly instead of process.poll(). — jfs
– jfs, Commented Aug 20, 2013 at 10:48
How to get output from the commandline with Python: stackoverflow.com/a/20456745/445131 — Eric Leschinski
– Eric Leschinski, Commented Dec 8, 2013 at 17:53

Rod · Accepted Answer · 2011-02-17 03:16:02Z

10

You code works fine. Turns out that the process that you are calling is probably outputing to CON. See the following example

import subprocess

def check_output(command):
    process = subprocess.Popen(command, shell=True, stdout=subprocess.PIPE, stderr=subprocess.STDOUT, universal_newlines=True)
    output = process.communicate()
    retcode = process.poll()
    if retcode:
            raise subprocess.CalledProcessError(retcode, command, output=output[0])
    return output 

command = "echo this>CON"

print "subprocess -> " + subprocess.check_output(command, shell=True)
print "native -> " + str(check_output(command))

try:
    subprocess.check_output("python output.py", shell=True)
except subprocess.CalledProcessError, e:
    print "subproces CalledProcessError.output = " + e.output

try:
    check_output("python output.py")
except subprocess.CalledProcessError, e:
    print "native CalledProcessError.output = " + e.output

Output

subprocess -> 
native -> ('', None)
stderr subproces CalledProcessError.output = stdout
native CalledProcessError.output = stderr stdout

Sadly, I do not know how to resolve the issue. Notice that subprocess.check_output results contains only the output from stdout. Your check_output replacement would output both stderr and stdout.

After inspecting subprocess.check_output, it does indeed generate a CalledProcessError with the output containing only stdout.

edited Feb 17, 2011 at 3:16

answered Feb 16, 2011 at 20:17

Rod

56.5k3 gold badges43 silver badges55 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

bplattenburg Over a year ago

I'm pretty sure this is where it is going. I was able to get in touch with the vendor and found out abotu some additional undocumented parameters that strop the nonzero exit statuses from occurring, so my scripting is working now, although I would still like to know how to capture output from CON.

kaptan · Accepted Answer · 2017-05-04 00:16:19Z

3

Have you tried stderr=subprocess.STDOUT as mentioned in the python doc page:

To also capture standard error in the result, use stderr=subprocess.STDOUT:

Here is a test code:

import subprocess

try:
    subprocess.check_output('>&2 echo "errrrr"; exit 1', shell=True)
except subprocess.CalledProcessError as e:
    print 'e.output: ', e.output


try:
    subprocess.check_output('>&2 echo "errrrr"; exit 1', shell=True, stderr=subprocess.STDOUT)
except subprocess.CalledProcessError as e:
    print 'e.output: ', e.output

output:

errrrr
e.output:  
e.output:  errrrr

answered May 4, 2017 at 0:16

kaptan

3,1695 gold badges39 silver badges50 bronze badges

Comments

beer_monk · Accepted Answer · 2011-02-16 18:40:59Z

1

There is an issue here that might be hitting you- http://bugs.python.org/issue9905

answered Feb 16, 2011 at 18:40

beer_monk

9667 silver badges7 bronze badges

Collectives™ on Stack Overflow

Python: get output from a command line which exits with nonzero exit code

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related