Good afternoon, I've noticed that the inference time varies from 10 seconds to 20 seconds given exactly the same payload, what could be causing this issue?

We use serverless infra and the cold start is 10-15s, so you're most likely experiencing that on the requests that take longer

I see, that make sense, thanks