dae.dask package

Submodules

dae.dask.config module

dae.dask.config.reconfigure() None[source]

Load default config into dask.

dae.dask.named_cluster module

dae.dask.named_cluster.set_up_kubernetes_cluster(cluster_conf: dict[str, Any]) Cluster[source]

Create a kubernetes cluster.

dae.dask.named_cluster.set_up_local_cluster(cluster_conf: dict[str, Any]) Cluster[source]

Create a local cluster using the passed cluster configuration.

dae.dask.named_cluster.set_up_manual_client(cluster_conf: dict[str, Any]) Client[source]

Create a dask client using the passed cluster configuration.

dae.dask.named_cluster.set_up_sge_cluster(cluster_conf: dict[str, Any]) Cluster[source]
dae.dask.named_cluster.set_up_slurm_cluster(cluster_conf: dict[str, Any]) Cluster[source]
dae.dask.named_cluster.setup_client(cluster_name: str | None = None, number_of_workers: int | None = None) tuple[Client, dict[str, Any]][source]

Create a dask client from the provided cluster name.

dae.dask.named_cluster.setup_client_from_config(cluster_config: dict[str, Any], *, number_of_workers: int | None = None) tuple[Client, dict[str, Any]][source]

Create a dask client from the provided config.

Module contents