Saving a NetCDF4 variable as it's own NetCDF4 file

Question

I am using a very big netcdf map file in python, and looking to "pull out" and save one variable in it (I don't need the rest). The orignal file is too large to open alone, I get the error "ValueError: array is too big; arr.size * arr.dtype.itemsize is larger than the maximum possible size." have to do this because the file is otherwise too big to use on my system.

I used:

ds2= netCDF4.Dataset("2020_original_Map.1.1.nc").variables['lccs_class']

This gets me the correct data in a size I can read, but then ds2 is <class 'netCDF4._netCDF4.Variable'>. I have tried all of the usual ways to save this as a netcdf, but none of them are working. Does anyone know how I save ds2 as it's own nc file, or another way to pull out 'llcs class' and save it separately? How can I make a new nc file and pass this variable into it?

Thanks a lot!

Dharman · Accepted Answer · 2021-09-22 11:56:46Z

2

Using xarray, you can write :

import xarray as xr

xr.open_dataset("2020_original_Map.1.1.nc")[['lccs_class']].to_netcdf('outfile.nc')

edited Sep 22, 2021 at 11:56

Dharman♦

33.9k27 gold badges105 silver badges157 bronze badges

answered Sep 22, 2021 at 11:51

cyril

6193 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Maya WillStep Over a year ago

Unfortunately the original file is too big. I get "ValueError: array is too big; arr.size * arr.dtype.itemsize is larger than the maximum possible size."

Collectives™ on Stack Overflow

Saving a NetCDF4 variable as it's own NetCDF4 file

Thanks a lot!

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

Thanks a lot!

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related