dae.dask package

Submodules

dae.dask.config module

dae.dask.config.reconfigure()[source]: Load default config into dask.

dae.dask.named_cluster module

dae.dask.named_cluster.set_up_kubernetes_cluster(cluster_conf)[source]: Create a kubernetes cluster.

dae.dask.named_cluster.set_up_local_cluster(cluster_conf)[source]: Create a local cluster using the passed cluster configuration.

dae.dask.named_cluster.set_up_sge_cluster(cluster_conf)[source]

dae.dask.named_cluster.set_up_slurm_cluster(cluster_conf)[source]

dae.dask.named_cluster.setup_client(cluster_name: str | None = None, number_of_threads: int | None = None) → Tuple[Client, Dict[str, Any]][source]: Create a dask client from the provided cluster name.

dae.dask.named_cluster.setup_client_from_config(cluster_config, number_of_threads_param: int | None = None) → Tuple[Client, Dict[str, Any]][source]: Create a dask client from the provided config.

Module contents