Categories:

Social Share

Why is my Model inference slow?

Certain Model Inferences can take a long time for the first run (Warmup) and would get faster with the subsequent inferences. The time taken for the first run may also depend on the size of the model.