An intro to key considerations when building gen AI solutions
AI Summary
In this video, Brett discusses the considerations for choosing between existing Generative AI (Gen) applications and building custom solutions. Key factors include:
- Use Cases: Determining if running Gen locally or on cloud infrastructure is more suitable.
- Needs & Resources: Evaluating the scale of the solution based on whether it serves individuals, teams, companies, or millions of customers.
- Customizability: Assessing the uniqueness of the solution and whether grounding, fine-tuning, or creating a new model is necessary.
- User Interaction: Considering factors like latency and connectivity based on how and when users will engage with the solution.
- Project Constraints: Analyzing available time, team size, and budget, as these will influence the decision-making process.
The lesson emphasizes understanding the different roles required at various stages of the Generative AI landscape.