What is Large Scale Generative AI?
AI Summary
- Growing demand for Generative AI (Gen AI).
- Gen AI algorithms require specialized hardware for running and training.
- Strategies to address these needs include:
- Batch-based Gen AI systems: Utilize content delivery networks for on-demand service through fill-in-the-blank sentences.
- Cache-based Generative AI: Cache common cases to reduce on-demand generation needs.
- Agentic architecture: Decompose large models into smaller, specialized ones that interact with each other.
- Model distillation: Extract information from a large model to train a smaller one that replicates its behavior.
- Student-teacher approach: A teacher model trains a student model to acquire new skills.
- These techniques aim to enhance scalability and usability of Gen AI algorithms.