I'm working with StatsForecast, MLForecast, and Ne...
# neural-forecast
b
I'm working with StatsForecast, MLForecast, and NeuralForecast. I'm using conformal prediction intervals for SF and MLF. I don't see that option in NF. Am I missing it? Is it possible? If not, do the PIs from NF models suffer from the same limitation as other models with regards to being uncalibrated and therefore less trustworthy?
I have not been able to find the answer in searching github pages (e.g., issues, discussions, or release notes) nor slack channels.
c
Hi @Brian Head! Very interesting question. Conformal prediction si currently only available in Stats and ML. We have plans to add it to NF in the future. All NF models have the option to produce probabilistic outputs simply by adjusting the training loss. For example, with the
MQLoss
to output multiple quantiles, or with the
DistributionLoss
class that assumes some underlying distribution. Both type of losses are viable options that will produce calibrated PI in most cases. This is the standard approach for deep-learning methods (for eg. refer to the DeepAR paper). Here are some tutorials: https://nixtla.github.io/neuralforecast/examples/uncertaintyintervals.html https://nixtla.github.io/neuralforecast/examples/longhorizon_probabilistic.html
❤️ 1