MMMWrapper.predict_stream#

MMMWrapper.predict_stream(context, model_input, params=None)#

Evaluates a pyfunc-compatible input and produces an iterator of output. For more information about the pyfunc input API, see the pyfunc-inference-api.

Args:
context: A PythonModelContext instance containing artifacts that the model

can use to perform inference.

model_input: A pyfunc-compatible input for the model to evaluate. params: Additional parameters to pass to the model for inference.