pydvl.parallel.config

ParallelConfig dataclass

ParallelConfig(
    backend: Literal["joblib", "ray"] = "joblib",
    address: Optional[Union[str, Tuple[str, int]]] = None,
    n_cpus_local: Optional[int] = None,
    logging_level: Optional[int] = None,
    wait_timeout: float = 1.0,
)

Configuration for parallel computation backend.

PARAMETER	DESCRIPTION
backend	Type of backend to use. Defaults to 'joblib' TYPE: Literal['joblib', 'ray'] DEFAULT: 'joblib'
address	(DEPRECATED) Address of existing remote or local cluster to use. TYPE: Optional[Union[str, Tuple[str, int]]] DEFAULT: None
n_cpus_local	(DEPRECATED) Number of CPUs to use when creating a local ray cluster. This has no effect when using an existing ray cluster. TYPE: Optional[int] DEFAULT: None
logging_level	(DEPRECATED) Logging level for the parallel backend's worker. TYPE: Optional[int] DEFAULT: None
wait_timeout	(DEPRECATED) Timeout in seconds for waiting on futures. TYPE: float DEFAULT: 1.0