Create a torch::Tensor from C/C++ array without using "from_blob(...)..."

Question

Using the C++ libtorch api for Pytorch

I want to create a torch::Tensor from a C++ double[] array, legacy C/C++ pointer. I could not find a simple documentation about the subject not in docs nor in the forums.

Something like:

double array[5] = {1, 2, 3, 4, 5};   // or double *array;
auto tharray = torch::Tensor(array, 5, torch::Device(torch::kCUDA));

The only thing I found is to use torch::from_blob but then I would have to clone() and use to(device) if I wanted to use it with CUDA.

double array[] = { 1, 2, 3, 4, 5};. // or double *array;
auto options = torch::TensorOptions().dtype(torch::kFloat64);
torch::Tensor tharray = torch::from_blob(array, {5}, options);

Is there any cleaner way of doing so?

Can you use TensorOptions to set the device at the same time you create your tensor? Something like auto options = torch::TensorOptions().dtype(torch::kFloat64).device(torch::kCUDA, 1) — JoshVarty
– JoshVarty, Commented Oct 30, 2019 at 18:30

JoshVarty · Accepted Answer · 2019-10-30 18:37:02Z

16

You can read more about tensor creation here: https://pytorch.org/cppdocs/notes/tensor_creation.html

I don't know of any way to create a tensor from an array without using from_blob but you can use TensorOptions to control various things about the tensor including its device.

Based on your example you could create your tensor on the GPU as follows:

double array[] = { 1, 2, 3, 4, 5};
auto options = torch::TensorOptions().dtype(torch::kFloat64).device(torch::kCUDA, 1);
torch::Tensor tharray = torch::from_blob(array, {5}, options);

answered Oct 30, 2019 at 18:37

JoshVarty

9,4964 gold badges56 silver badges84 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

imbr Over a year ago

no it doesn't work, it still creates on CPU, a to.device is still needed

JacKeown Over a year ago

Does it? How can you tell if it's on the CPU or GPU?

imbr Over a year ago

Yes it works! you are right @JacKeown I was confused by this issue here github.com/pytorch/pytorch/issues/12506#issuecomment-429573396

JoshVarty Over a year ago

This doesn't seem to work for me anymore... I've raise a question about this at: discuss.pytorch.org/t/create-tensor-on-cuda-device-in-c/113232

xiaobing Over a year ago

from_blob with kCUDA in options raise an error for me, from_blob()clone().to(torch::kCUDA) works. see this: github.com/pytorch/pytorch/issues/15426#issuecomment-451225787

Sholto Armstrong · Accepted Answer · 2020-07-23 18:34:30Z

8

I usually use:

torch::Tensor tharray = torch::tensor({1, 2, 3, 4, 5}, {torch::kFloat64});

answered Jul 23, 2020 at 18:34

Sholto Armstrong

4435 silver badges6 bronze badges

1 Comment

imbr Over a year ago

well fine people got happy with your answer but the question is regarding a legacy C/C++ array pointer.

abggcv · Accepted Answer · 2020-06-06 04:49:04Z

1

I do not have cleaner way, but I would give you another way to do it.

double array[5] = {1, 2, 3, 4, 5};
auto tharray = torch::zeros(5,torch::kFloat64) //or use kF64
std::memcpy(tharray.data_ptr(),array,sizeof(double)*tharray.numel())

Hope its helpful.

Corrected KF64 to kFloat64 because KF64 does not exist in torch

edited Jun 6, 2020 at 4:49

abggcv

4716 silver badges21 bronze badges

answered Apr 1, 2020 at 8:14

helloswift123

1631 gold badge4 silver badges13 bronze badges

Collectives™ on Stack Overflow

Create a torch::Tensor from C/C++ array without using "from_blob(...)..."

3 Answers 3

5 Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

5 Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related