Afiq Johari
09/13/2023, 8:13 AMstorage_path
for the AutoNHITS
or HyperOptSearch
?
I'm trying to get the ray
or tune
working with neuralforecast
and I keep getting this error below.
(_train_tune pid=21000) 2023-09-13 08:02:48,610 ERROR syncer.py:466 -- Caught sync error: Sync process failed: GetFileInfo() yielded path 'C:/Users/bubu/ray_results/_train_tune_2023-09-13_08-02-34/_train_tune_7a885f1f_1_h=12,input_size=24,learning_rate=0.0032,loss=ref_ph_de895953,max_steps=10,n_freq_downsample=24_12_1,n_pool__2023-09-13_08-02-39/error.pkl', which is outside base dir 'C:\Users\bubu\ray_results\_train_tune_2023-09-13_08-02-34\_train_tune_7a885f1f_1_h=12,input_size=24,learning_rate=0.0032,loss=ref_ph_de895953,max_steps=10,n_freq_downsample=24_12_1,n_pool__2023-09-13_08-02-39\'. Retrying after sleeping for 1.0 seconds...
(_train_tune pid=21000) 2023-09-13 08:02:49,617 ERROR syncer.py:466 -- Caught sync error: Sync process failed: GetFileInfo() yielded path 'C:/Users/bubu/ray_results/_train_tune_2023-09-13_08-02-34/_train_tune_7a885f1f_1_h=12,input_size=24,learning_rate=0.0032,loss=ref_ph_de895953,max_steps=10,n_freq_downsample=24_12_1,n_pool__2023-09-13_08-02-39/error.pkl', which is outside base dir 'C:\Users\bubu\ray_results\_train_tune_2023-09-13_08-02-34\_train_tune_7a885f1f_1_h=12,input_size=24,learning_rate=0.0032,loss=ref_ph_de895953,max_steps=10,n_freq_downsample=24_12_1,n_pool__2023-09-13_08-02-39\'. Retrying after sleeping for 1.0 seconds...
It seems this is a known bug and a suggested workaround is to predefine the storage path as below https://github.com/ray-project/ray/issues/36448#issuecomment-1673274452
from ray import air, tune
tuner = tune.Tuner(
train_fn,
run_config=air.RunConfig(storage_path="./")
)
tuner.fit()
However, I'm not sure where to define run_config=air.RunConfig(storage_path="./")
with AutoNHITS
Really appreciate any tips on this issue, thanks!Cristian (Nixtla)
09/13/2023, 3:10 PMstorage_path
from the auto model.José Morales
09/13/2023, 3:40 PMAfiq Johari
09/13/2023, 10:47 PMCristian (Nixtla)
09/14/2023, 4:30 PMAfiq Johari
09/15/2023, 1:49 AMhyperparameter tuning
that works well with neuralforecast
, please let me know. At the moment, I'm thinking of going with optuna
https://forecastegy.com/posts/multiple-time-series-forecasting-nbeats-python/Cristian (Nixtla)
09/15/2023, 5:19 PMAfiq Johari
09/19/2023, 9:24 AMoptuna
with NHITS
, and able to run the hyperparameter tuning, and more importantly I can make use of the GPU on my windows server