ray-zerocopy

Contents

  • Getting Started
    • Installation
      • From PyPI
      • From Source
    • Requirements
    • Quick Start
      • Actor Mode (Recommended for Batch Inference)
      • Task Mode (Ad-hoc Inference)
    • Next Steps
  • ModelWrapper Guide
    • What is Zero-Copy?
    • Quick Start
      • Installation
    • Task Mode
      • Example: Task-Based Inference
    • Actor Mode
      • Example: Actor-Based Inference
    • Pipelines with Multiple Models
    • Device Placement
    • API Reference
      • ModelWrapper.from_model()
      • ModelWrapper.for_tasks()
      • model_wrapper.load()
    • When to Use What
    • Memory Savings
    • Next Steps
  • JIT Wrappers
    • Overview
    • API Reference
      • JITModelWrapper
        • Task Mode
        • Actor Mode
    • Usage Examples
      • Task Mode with Pipeline
      • Actor Mode with Ray Data
    • Comparison with ModelWrapper
  • API Reference
    • ModelWrapper
      • Overview
      • ModelWrapper Class
        • ModelWrapper
      • Basic Usage
        • Wrapping a Model
        • Using in Actors
        • Using for Tasks
      • Methods
        • from_model
        • for_tasks
        • load
      • Supported Model Types
        • Standalone nn.Module
        • Pipeline with Multiple Models
      • Execution Modes
        • Actor Mode
        • Task Mode
      • Advanced Usage
        • Conditional Fast Loading
        • Inspecting Wrapper State
      • See Also
    • Quick Links
      • Main Wrappers
    • Overview
    • Importing
ray-zerocopy
  • Index

Index

_ | D | F | I | L | M | S

_

  • __getstate__() (ray_zerocopy.model_wrappers.ModelWrapper method)
  • __init__() (ray_zerocopy.model_wrappers.ModelWrapper method)
  • __setstate__() (ray_zerocopy.model_wrappers.ModelWrapper method)

D

  • deserialize() (ray_zerocopy.model_wrappers.ModelWrapper class method)

F

  • for_tasks() (ray_zerocopy.model_wrappers.ModelWrapper class method)
  • from_model() (ray_zerocopy.model_wrappers.ModelWrapper class method)

I

  • is_standalone_module (ray_zerocopy.model_wrappers.ModelWrapper attribute)

L

  • load() (ray_zerocopy.model_wrappers.ModelWrapper method)

M

  • mode (ray_zerocopy.model_wrappers.ModelWrapper attribute)
  • model_info (ray_zerocopy.model_wrappers.ModelWrapper attribute)
  • model_refs (ray_zerocopy.model_wrappers.ModelWrapper attribute)
    • (ray_zerocopy.model_wrappers.ModelWrapper property)
  • ModelWrapper (class in ray_zerocopy.model_wrappers)

S

  • serialize() (ray_zerocopy.model_wrappers.ModelWrapper method)
  • skeleton (ray_zerocopy.model_wrappers.ModelWrapper attribute)

© Copyright 2025, Kit Lee.

Built with Sphinx using a theme provided by Read the Docs.