Load image by chunks in Python for GDAL processing

Question

I need to load image *.tif for process it in GDAL. I use this code:

data = gdal.Open("a.tif", gdal.GA_ReadOnly)
img = data.ReadAsArray()

All works well on small images (~10Mb). But when i try to load bigger image (~1Gb) it start to use a lot of memory (~15Gb RAM). How I can load this image by a chunks for sequential processing?

Thanks!

stackoverflow.com/questions/19695249/…

aslavkin
– aslavkin

2017-02-28 10:03:09 +00:00
Commented Feb 28, 2017 at 10:03 — aslavkin
– aslavkin, Commented Feb 28, 2017 at 10:03

Logan Byers · Accepted Answer · 2017-02-28 13:00:26Z

6

ReadAsArray() has some optional parameters to read portions of an image.

ReadAsArray(x_off, y_off, x_size, y_size)

Full code:

import gdal
ds = gdal.Open('input.tif', gdal.GA_ReadOnly)
rb = ds.GetRasterBand(1)
xsize = rb.XSize
ysize = rb.YSize
ystep = ysize / 10
yresidual = ysize - (ystep * 10)

for i in range(10):
    if i != 9:
        img_part = rb.ReadAsArray(0, ystep * i, xsize, ystep)
    else:
        img_part = rb.ReadAsArray(0, ystep * i, xsize, ystep + yresidual)
    # do something with img_part

ds = None

answered Feb 28, 2017 at 13:00

Logan Byers

1,58313 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Load image by chunks in Python for GDAL processing

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related