read tiff file directly to numpy array without saving to disk

Question

I often download (geo) tiff files, save them to a temporary disk space, then read in the data using rasterio to get a numpy.ndarray that I can then analyze.

For example, using this url for NAIP imagery:

import os
from requests import get
from rasterio import open as rasopen

req = get(url, verify=False, stream=True)
if req.status_code != 200:
    raise ValueError('Bad response from NAIP API request.')
temp = os.path.join(os.getcwd(), 'temp', 'tile.tif')
with open(temp, 'wb') as f:
    f.write(req.content)
with rasopen(temp, 'r') as src:
    array = src.read()
    profile = src.profile
os.remove(temp)

For other (netcdf) geographic gridded data, I might use xarray to get data from this url to get Gridmet data:

from xarray import open_dataset

xray = open_dataset(url)
variable = 'pr' # precipitation
subset = xray.loc[dict(lat=slice(north, south),
                       lon=slice(west,east))]
arr = subset.variable.values

So getting an xarray object works as a stream and is easy to get into an ndarray, but I only know of this working on netcdf datasets. Is there a way to 'stream' in tif data to an ndarray object? Ideally, one could do this with

with rasopen(url, 'r') as src:
    array = src.read()

as rasterio returns a nice metadata object along with the ndarray, though I have not gotten that to work with a url resource. Thanks.

RyanH · Accepted Answer · 2018-03-21 18:58:33Z

3

Yes, you can either read it from memory:

from rasterio.io import MemoryFile

with MemoryFile(data) as memfile:
    with memfile.open() as dataset:
        data_array = dataset.read()

Or directly from a URL:

with rasterio.open('https://pathto.tif') as dataset:
    print(dataset.profile)

I couldn't get the latter to work with your URL though so you may want to try the first.

answered Mar 21, 2018 at 18:58

RyanH

1,0518 silver badges14 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

read tiff file directly to numpy array without saving to disk

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related