dae.dask package

Submodules

dae.dask.config module

dae.dask.config.reconfigure() → None

Load default config into dask.

dae.dask.named_cluster module

dae.dask.named_cluster.set_up_kubernetes_cluster(cluster_conf: dict[str, Any]) → Cluster

Create a kubernetes cluster.

dae.dask.named_cluster.set_up_local_cluster(cluster_conf: dict[str, Any]) → Cluster

Create a local cluster using the passed cluster configuration.

dae.dask.named_cluster.set_up_manual_client(cluster_conf: dict[str, Any]) → Client

Create a dask client using the passed cluster configuration.

dae.dask.named_cluster.set_up_sge_cluster(cluster_conf: dict[str, Any]) → Cluster

dae.dask.named_cluster.set_up_slurm_cluster(cluster_conf: dict[str, Any]) → Cluster

dae.dask.named_cluster.setup_client(cluster_name: str | None = None, number_of_workers: int | None = None) → tuple[Client, dict[str, Any]]

Create a dask client from the provided cluster name.

dae.dask.named_cluster.setup_client_from_config(cluster_config: dict[str, Any], *, number_of_workers: int | None = None) → tuple[Client, dict[str, Any]]

Create a dask client from the provided config.

Module contents