During training, the ds column is only used for sorting the time-series, so it shouldn't fail with an error. However, the performance will be seriously affected as the lags will correspond to different times. Some methods and their parameters also assume regular time-series. For example, the val_size and test_size are in terms of number of time-stamps, so the splits wont be correct if series are irregular.