We are currently fixing the same loss train and validation loss for all configurations in the same auto model (loss and valid_loss params are in the class, not in the config dictionary). You will need to have two different AutoDeepAR models with different losses and compare results afterwards.