Course Overview
- Course Title: Evaluating Generative Models: Methods, Metrics & Tools
- Instructor: Reza Mora
- Target Audience:
- AI Product Managers
- Data Scientists
- AI Ethicists
- Prerequisites:
- Basic Understanding of AI and Machine Learning
- Familiarity with Large Language Models
- Familiarity with Cloud Platforms
- No Programming Skills Required
Curriculum Highlights
- Key Topics Covered:
- Fundamentals of LLM Evaluation
- Vertex AI Evaluation Tools
- Advanced Evaluation Methods
- Evaluation of Non-Text Generative AI Models
- Fairness Evaluation Metrics
- Future AI Evaluation Trends
- Key Skills Learned:
- Hands-on experience with Google Cloud’s Vertex AI
- Use of Automatic Metrics for model output quality assessment
- Mastery of AutoSxS for model comparison
- Application of evaluation techniques to improve AI applications
- Understanding and ensuring fairness in AI systems
- Optimization of model selection and deployment strategies
Course Format
- Duration: 1 hour on-demand video
- Format: Self-paced online course
- Resources:
- 22 downloadable resources
- Access on mobile and TV
- Certificate of completion