...
There are two ways to resolve this issue: raise your project quota , or configure Dataproc disk sizes.
Raise your project quota
This The quota that must be raised for this error is Persistent disk standard (GB)
. There are both project wide and regional quotas. You can see that documentation here for more information as well as steps on how to raise it: https://cloud.google.com/compute/quotas.
Configure Dataproc disk sizes
...
Set these to a low enough value (in Gb) so that the resultant dataproc Dataproc cluster remains under quota.
...