ray-zerocopy
Contents
Getting Started
Installation
From PyPI
From Source
Requirements
Quick Start
Actor Mode (Recommended for Batch Inference)
Task Mode (Ad-hoc Inference)
Next Steps
ModelWrapper Guide
What is Zero-Copy?
Quick Start
Installation
Task Mode
Example: Task-Based Inference
Actor Mode
Example: Actor-Based Inference
Pipelines with Multiple Models
Device Placement
API Reference
ModelWrapper.from_model()
ModelWrapper.for_tasks()
model_wrapper.load()
When to Use What
Memory Savings
Next Steps
JIT Wrappers
Overview
API Reference
JITModelWrapper
Task Mode
Actor Mode
Usage Examples
Task Mode with Pipeline
Actor Mode with Ray Data
Comparison with ModelWrapper
API Reference
ModelWrapper
Overview
ModelWrapper Class
ModelWrapper
Basic Usage
Wrapping a Model
Using in Actors
Using for Tasks
Methods
from_model
for_tasks
load
Supported Model Types
Standalone nn.Module
Pipeline with Multiple Models
Execution Modes
Actor Mode
Task Mode
Advanced Usage
Conditional Fast Loading
Inspecting Wrapper State
See Also
Quick Links
Main Wrappers
Overview
Importing
ray-zerocopy
Index
Index
_
|
D
|
F
|
I
|
L
|
M
|
S
_
__getstate__() (ray_zerocopy.model_wrappers.ModelWrapper method)
__init__() (ray_zerocopy.model_wrappers.ModelWrapper method)
__setstate__() (ray_zerocopy.model_wrappers.ModelWrapper method)
D
deserialize() (ray_zerocopy.model_wrappers.ModelWrapper class method)
F
for_tasks() (ray_zerocopy.model_wrappers.ModelWrapper class method)
from_model() (ray_zerocopy.model_wrappers.ModelWrapper class method)
I
is_standalone_module (ray_zerocopy.model_wrappers.ModelWrapper attribute)
L
load() (ray_zerocopy.model_wrappers.ModelWrapper method)
M
mode (ray_zerocopy.model_wrappers.ModelWrapper attribute)
model_info (ray_zerocopy.model_wrappers.ModelWrapper attribute)
model_refs (ray_zerocopy.model_wrappers.ModelWrapper attribute)
(ray_zerocopy.model_wrappers.ModelWrapper property)
ModelWrapper (class in ray_zerocopy.model_wrappers)
S
serialize() (ray_zerocopy.model_wrappers.ModelWrapper method)
skeleton (ray_zerocopy.model_wrappers.ModelWrapper attribute)