GLOSSARY · AI SECURITY
Inference
Inference is the phase in which a trained AI model is actually used: it receives an input and produces an output, as opposed to the training phase in which the model learns.
Inference is where operating cost, latency, and almost all security exposure live, because it is the phase attackers can reach.