Two main concerns: 1) train vs valid losses range ...
# neural-forecast
o
Two main concerns: 1) train vs valid losses range has absolutely different scale 2) valid loss seems to grow during training, is it overfitting?
k
By default the model trains with MAE, and you are evaluating with MSE, which explains the losses’ scale difference. And early stopping is one of the strongest regularizers with regressions and neural networks.
o
I've hardcoded
loss=MSE(),
valid_loss=MSE()
Is your previous explanation still valid? @Kin Gtz. Olivares
c
Hi @Oleksii Kaplenko! The validation loss is scaled back to the original scale of the data
while the train loss is normalized
o
Got it, thanks
r
hi @Oleksii Kaplenko just curious, how are you pulling your tensorboard plots?
o
@Rafael Correia Da Silva using fit() method creates lightning_logs folder, inside this folder lies tensorboard files for all runs, to see these charts I use command:
tensorboard --logdir ./lightning_logs
🔥 2
amazing 1
r
wow I was doing this stuff by hand 🤡 this is soo helpful, thanks!