Model Evaluation and Testing

Current Status
Not Enrolled
Included in Subscription
Get Started

This course digs into model evaluation and testing, providing insights into key evaluation concepts like the confusion matrix, Business / KPI evaluation, learning curves, ROC and AUC curves, and evaluating AI models vs. the heuristic. This is an intermediate level course geared towards project managers and those in a more technical role such as data scientists, data engineers, data analyst, or designer.

What Will I Learn?

  • Model Evaluation & Testing
  • The Confusion Matrix
  • Business / KPI evaluation
  • Model iteration
  • Performance Evaluation
  • Business evaluation
  • Model evaluation curves
  • Evaluating vs. the heuristic

Who is this Training For?

  • Project Manager
  • Product Manager
  • Capability Manager
  • Technical Manager
  • Acquisitions Manager
  • Procurement & Contracting Officers
  • Computer Systems Programmer
  • Developer
  • AI Research Associate
  • Data Scientist
  • AI / Machine Learning (ML) Engineer
  • AI Assurance Engineer
  • Test & Evaluation Engineer, System Engineer
  • Network Analyst
  • Data Analyst
  • Operations Research Analyst
  • Deployment Engineer
  • Knowledge Operations Manager
  • Network Infrastructure Engineer
  • Information Technician
  • Data engineer
  • Network operations
  • Information technician
  • Data technician
  • Program manager
  • Project manager
  • Supply program manager
  • Designers

Supported Learning Paths

  • Cognilytica: CPMAI Certification
  • DoD JAIC: Drive AI, Create AI, Embed AI, Facilitate AI
  • Edison DSF: Data Science Professionals (DSP04 -DSP09), Data Engineering & Management Professionals (DSP10-DSP16)

Learning Levels

  • DoD JAIC AI: Intermediate (Applied) Level
  • Edison DSF: Level 4-5
  • Category: Implementing AI