Mounting a folder in Dask distributed AWS ECS/EC2 cluster

Question

I am using dask distributed package to create a EC2/ECS cluster, I want to read the ML models within the workers, something like

def read_model(model_path):
    model = pickle.load(model_path)
    return model

future = client.submit(read_model, model_path)
model = future.result()

How do I mount/volume the local folder while creating the ECS/EC2 cluster using python.

tried to look into the parameters provided here

Guillaume EB · Accepted Answer · 2023-02-23 13:21:53Z

0

As answered in https://dask.discourse.group/t/mounting-a-folder-in-dask-distributed-aws-ecs-ec2-cluster/1591/3, if by local folder you mean a folder on your personal computer, then you won't be able to mount it on a ECS or EC2 instance.

answered Feb 23, 2023 at 13:21

Guillaume EB

8226 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Mounting a folder in Dask distributed AWS ECS/EC2 cluster

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related