components Model Evaluation documentation

Model Evaluation

Components in this category

---

• compute_metrics

  Calculate model performance metrics, given ground truth and prediction data.

• evaluate_model

  Evaluate MLFlow models for supported task types.

• model_evaluation_pipeline

  Pipeline component for model evaluation for supported tasks. \ Generates predictions on a given model, followed by computing model performance metrics to score the model quality for supported tasks.

• model_prediction

  Generate predictions on a given mlflow model for supported tasks.

• model_prediction_with_container

  Optimized Distributed inference component for LLMs.

• validation_trigger_model_evaluation

  Component for enabling validation of model evaluation pipeline.