Search results

Optuna not parallelising across workers using joblib spark backend on Databricks

Status: Open.

#61 In joblib/joblib-spark;

· alexisdrakopoulos opened on Mar 18, 2025

Cannot register_spark() for Databricks Runtime ML 16.0 and 16.1

Status: Open.

#60 In joblib/joblib-spark;

· splatt92 opened on Jan 7, 2025

<code>SparkDistributedBackend._is_support_stage_scheduling</code> always prints warning

Status: Open.

#59 In joblib/joblib-spark;

· philipmat opened on Dec 30, 2024

catboost &amp; joblib spark

Status: Open.

#58 In joblib/joblib-spark;

· timpiperseek opened on Sep 10, 2024

[Bug] Method cpus does not exist, version 0.5.3 doesn't work with spark 3.4 or 3.5

Status: Open.

#57 In joblib/joblib-spark;

· thinkall opened on Aug 15, 2024

Is there a plan to implement Spark Connect to Joblib-spark?

Status: Open.

#50 In joblib/joblib-spark;

· Kurdzik opened on Jul 4, 2023

Is Databricks auto-scaling supposed to work with joblib-spark?

Status: Open.

#45 In joblib/joblib-spark;

· pauljohn32 opened on Jan 5, 2023

Parallelisation not working for BIRCH clustering

Status: Open.

#42 In joblib/joblib-spark;

· siddharth-redseer opened on Aug 26, 2022

Ability to reuse existing spark session for ParallelBackend

Status: Open.

#40 In joblib/joblib-spark;

· aaronzo opened on May 29, 2022

ModuleNotFoundError: No module named 'sklearn.svm.classes

Status: Open.

#39 In joblib/joblib-spark;

· jayasuriya888 opened on Jan 28, 2022

Use pyspark.InheritableThread as the base thread class for threadpool

Status: Open.

#32 In joblib/joblib-spark;

· NivekNey opened on Jul 19, 2021

Print warning if estimator/model/transformer doesn't support job-lib spark parallelism.

Status: Open.

#31 In joblib/joblib-spark;

· WeichenXu123 opened on Jul 16, 2021