Cannot start dataproc cluster because network is not found

[iris-garden]

Note

The following post was exported from discuss.hail.is, a forum for asking questions about Hail which has since been deprecated.

(Jan 02, 2024 at 18:30) danking said:

When I run

hailctl dataproc start my-cluster

I get this error:

(gcloud.dataproc.clusters.create) NOT_FOUND: The resource 'projects/my-gcp-project/global/networks/default' was not found

(Jan 02, 2024 at 18:31) danking said:

This means that your Google Cloud project is not configured with a default network. When you have this kind of Google Cloud project, you must explicitly specify a network with --network NAME:

hailctl dataproc start my-cluster --network NAME

You can see the available networks with

gcloud compute networks list