Evaluating Generative Models: Methods, Metrics & Tools

Course Overview

• Course Title: Evaluating Generative Models: Methods, Metrics & Tools
• Instructor: Reza Mora
• Target Audience:
  • AI Product Managers
  • Data Scientists
  • AI Ethicists
• Prerequisites:
  • Basic Understanding of AI and Machine Learning
  • Familiarity with Large Language Models
  • Familiarity with Cloud Platforms
  • No Programming Skills Required

Curriculum Highlights

• Key Topics Covered:
  • Fundamentals of LLM Evaluation
  • Vertex AI Evaluation Tools
  • Advanced Evaluation Methods
  • Evaluation of Non-Text Generative AI Models
  • Fairness Evaluation Metrics
  • Future AI Evaluation Trends
• Key Skills Learned:
  • Hands-on experience with Google Cloud’s Vertex AI
  • Use of Automatic Metrics for model output quality assessment
  • Mastery of AutoSxS for model comparison
  • Application of evaluation techniques to improve AI applications
  • Understanding and ensuring fairness in AI systems
  • Optimization of model selection and deployment strategies

Course Format

• Duration: 1 hour on-demand video
• Format: Self-paced online course
• Resources:
  • 22 downloadable resources
  • Access on mobile and TV
  • Certificate of completion