I think there are plenty of opportunities for conformal predictions to shine with neural nets, to fix their over confidence.

Yes, it would be great combo because generally they produce too narrow (overconfident) prediction intervals