API Reference

Complete API documentation for ray-zerocopy.

• ModelWrapper
  • Overview
  • ModelWrapper Class
  • Basic Usage
  • Methods
  • Supported Model Types
  • Execution Modes
  • Advanced Usage
  • See Also

Quick Links

Main Wrappers

• ModelWrapper - nn.Module with Ray tasks or actors

• JITModelWrapper - TorchScript with Ray tasks or actors

Overview

ray-zerocopy provides wrapper classes for zero-copy model sharing:

1. ModelWrapper - Primary API for nn.Module models (supports both task and actor modes)

2. JITModelWrapper - Unified API for TorchScript (compiled) models (supports both task and actor modes)

Importing

# Primary API for nn.Module
from ray_zerocopy import ModelWrapper

# For TorchScript models
from ray_zerocopy import JITModelWrapper