https://github.com/nixtla logo
#neural-forecast
Title
# neural-forecast
m

marah othman

08/02/2023, 5:25 PM
does any one try transformer models and get killed after running ?
m

Mark

08/02/2023, 5:42 PM
like tft? yes
what error are you getting, i had a heck of a time
c

Cristian (Nixtla)

08/02/2023, 5:49 PM
TFT wont run in some colab examples due to limited memory on the GPUs
m

Mark

08/02/2023, 5:49 PM
^ this is exactly what i ran into
actually it was the fact that i had 0 gpu's... added one, all good
just took me a while to realize
m

marah othman

08/02/2023, 5:53 PM
i am trying the models in this tutorial https://nixtla.github.io/neuralforecast/examples/longhorizon_with_transformers.html and i get KILLED after training a 200 epohcs
I mean autoformer and informer and Patch tst
m

Mark

08/02/2023, 5:56 PM
yes, what error are you getting
m

marah othman

08/02/2023, 5:56 PM
Killed
and stop training
it should run 600 step since i put 200 step for each model but after 200 step it give me Killed and finish
m

Mark

08/02/2023, 5:58 PM
seems like a hardware limitation
m

marah othman

08/02/2023, 5:59 PM
how can i know ?
m

Mark

08/02/2023, 5:59 PM
try a smaller data set, less num_samples, etc.
m

marah othman

08/02/2023, 6:00 PM
note : i am working on just cpu
m

Mark

08/02/2023, 6:00 PM
yeah just on CPU did not work for me with AutoTFT
m

marah othman

08/02/2023, 6:01 PM
you mean all transformer family?
m

Mark

08/02/2023, 6:01 PM
i only tried autotft
c

Cristian (Nixtla)

08/02/2023, 6:02 PM
@marah othman try using GPUs. Training these transformers on CPU is painfully slow
m

marah othman

08/02/2023, 6:04 PM
i have this gpu Intel Corporation CometLake-H GT2 [UHD Graphics] (rev 05) how can i make it work with my code?