Import compressed SQL dump into Postgresql with python

Question

I have to import a compressed sql dump into a PostgreSQL database. The dump gets created by:

pg_dump -F c

So I get a compressed file, which I can't just parse line by line and then use psycopg2 to upload it into my database.

The compressed dumps I'm dealing with are quite big (up to 10GB). What would be an efficient way to do import them?

Is there a reason you can't re-import using the command line? Doing it through Python is going to be inefficient. — asthasr
– asthasr, Commented Feb 10, 2011 at 21:48
If you have to "control" it via Python, you can always execute the necessary command line command from within Python. — payne
– payne, Commented Feb 10, 2011 at 21:50
@Keith: Its own, as its says in the man. File is 'src/bin/pg_dump/pg_backup_archiver.c' in the source tree. It uses zlib but it has its own structure. Its not just zipped. Best bet would probably be interfacing with it in C and using the pg headers if you really have to do it this way. — nate c
– nate c, Commented Feb 10, 2011 at 23:26

Peter Eisentraut · Accepted Answer · 2011-02-11 04:22:15Z

2

You basically can't do that unless you reimplement pg_restore in your Python project. Consider instead calling pg_restore from your Python program.

answered Feb 11, 2011 at 4:22

Peter Eisentraut

37.1k12 gold badges91 silver badges91 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Import compressed SQL dump into Postgresql with python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related