Out of curiosity, have any of you tried some timeseries data augmentation techniques like the block bootstrap. I was thinking of Hyndman's Bagged ETS model.
https://otexts.com/fpp2/bootstrap.html#bagged-ets-forecasts
That got me thinking about having a bagged bootstrap timeseries loader for every batch that goes into one of your models.