ColossalAI documentation

GETTING STARTED

• Setup
• Quick demo

CUSTOMIZE YOUR TRAINING

• Parallelization
• Define your own parallel model
• Build your engine & Customize your trainer
• Mixed Precision Training
• Zero Redundancy Optimizer and Zero Offload
• Add Your Own Parallelism
• Config file

API REFERENCE

• colossalai
  • colossalai.builder
  • colossalai.communication
  • colossalai.context
  • colossalai.engine
  • colossalai.logging
  • colossalai.nn
  • colossalai.registry
  • colossalai.trainer
  • colossalai.utils
  • colossalai.checkpointing
  • colossalai.constants
  • colossalai.core
  • colossalai.initialize

Indices and tables

• Index