https://github.com/nixtla logo
s

Syed Umair Hassan

06/01/2023, 8:20 AM
Is their a way to do transfer learning using neural forecast library?
k

Kin Gtz. Olivares

06/01/2023, 1:45 PM
Hey @Syed Umair Hassan, Thanks for using the library. Here is a tutorial on transfer learning with NeuralForecast: https://nixtla.github.io/neuralforecast/examples/transfer_learning.html
s

Syed Umair Hassan

06/01/2023, 1:51 PM
Sorry, I typed my question wrong, I have seen this. What I wanted to know if is their a way to unfreeze some of the layers and tune them to a given dataset?
k

Kin Gtz. Olivares

06/01/2023, 1:56 PM
We have not performed fine tune to the fullest extent, where we freeze the encoder and tune the last decoder layers. For the moment, like in the tutorial, we tune the whole network. If you are interested in the fine-tune approach here is an example: https://wandb.ai/wandb/wandb-lightning/reports/Transfer-Learning-Using-PyTorch-Lightning--VmlldzoyODk2MjA I think it should be easy to implement something similar on the NeuralForecast models too
👍 1
2 Views