How to redirect stdout for a subprocess?

Question

def StartProc(dir, parm):
    global proc    

    proc_log = open(dir + os.sep + "MyLog.txt","w")  #new path for each file

    if parm:
        proc = subprocess.Popen(path, 0, None, subprocess.PIPE, proc_log, None)
    else:
        MyReset(proc)                     #reset the process(proc) to its default values
        proc.stdout = proc_log            #no effect
        print "fptr ", proc.stdout
    #endif
#enddef

prm = True

for i in range(0, 5):
    StartProc(i, prm)
    prm = False
#endfor

What I want to do is to start an executable only once, but on each iteration I want to redirect the process output to a different file. What is happening, is that files are created in the different path, but output is redirected to the file that is created first time.

Note: MyReset() initializes the process (executable) to its default values after the first iteration.

Will the following line change the process stdout to new file?

proc.stdout = proc_log

liwp · Accepted Answer · 2010-01-29 15:04:50Z

6

Like unwind said, you cannot change the file descriptor that the child process is writing its output to.

What you can do, is read the output from the child process in your python script and then write it back to whatever file you want to. E.g.:

proc = subprocess.Popen(path, 0, None, subprocess.PIPE, subprocess.PIPE, None)

for l in proc.stdout.readlines():
  output_file.write(l)

Obivously, you'll need to figure out how control should behave in your app, i.e. can you do the writing from the main thread, when should the main thread return from StartProc() in that case, or do you have to do the writing from another thread so that the main thread can return from StartProc() immediately.

answered Jan 29, 2010 at 15:04

liwp

6,9562 gold badges30 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

unwind · Accepted Answer · 2010-01-29 12:12:02Z

4

You can't. Once the process is started, its stdout is nothing you can change from the outside. You need to get inside that process' space to muck with its file descriptors.

If you have a way (in MyReset() I guess) to talk to the running process, perhaps you can engineer a way to pass a new filename for it to (re)open as its stdout, that way.

edited Jan 29, 2010 at 12:12

answered Jan 29, 2010 at 11:07

unwind

402k64 gold badges492 silver badges620 bronze badges

Comments

user553965 · Accepted Answer · 2010-12-28 01:26:07Z

1

There are subtle problems/bugs in python related to subprocess.PIPE: http://bugs.python.org/issue1652

Apparently this was fixed in python3+, but not in python 2.7 and older. For that you need to use: code.google.com/p/python-subprocess32/

answered Dec 28, 2010 at 1:26

user553965

1,31115 silver badges17 bronze badges

Collectives™ on Stack Overflow

How to redirect stdout for a subprocess?

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related