Inference Engine Security

An inference engine boundary failure doesn’t require the model to escape anything — it only requires the component reading the model’s output to misjudge what that output is allowed to mean. The container is an obvious place to draw the security boundary around an inference workload. It is not necessarily the boundary where model output…