module

session

Defines the InferenceSession type that serves as an entry point to MAX Engine.

Structs

• ​InputSpec: Specifies a model's input shape and data type (required for TorchScript).
• ​SessionOptions: Configuration options for InferenceSession.
• ​InferenceSession: Holds the context for MAX Engine in which you can load and run models.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!
If you'd like to share more information, please report an issue on GitHub

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other