Do not plot running or early stopped trials in Scatter, ParallelCoord…

…inates

Summary: As titled. I noticed this made the parallel coordinates plot esp. look bad while working on tutorials, where it made bad parameterization that got early stopped look really bad (since they were not full fidelity readings)

Differential Revision: D70262111

ax/analysis/plotly/parallel_coordinates.py

@@ -79,6 +79,9 @@ def _prepare_data(experiment: Experiment, metric: str) -> pd.DataFrame:
         }
         for trial in experiment.trials.values()
         for arm in trial.arms
+        # Do not plot running or early stopped trials since their terminal point does
+        # not represent full fidelity.
+        if trial.status.is_terminal and not trial.status.is_early_stopped
     ]
 
     return pd.DataFrame.from_records(records).dropna()

ax/analysis/plotly/scatter.py

@@ -96,7 +96,14 @@ def _prepare_data(
 
     # Filter for only rows with the relevant metric names
     metric_name_mask = data["metric_name"].isin([x_metric_name, y_metric_name])
-    filtered = data[metric_name_mask][
+    # Do not plot running or early stopped trials since their terminal point does not
+    # represent full fidelity.
+    status_mask = (
+        data["trial_status"] == "COMPLETED"
+        or data["trial_status"] == "FAILED"
+        or data["trial_status"] == "ABANDONED"
+    )
+    filtered = data[metric_name_mask & status_mask][
         ["trial_index", "arm_name", "metric_name", "mean"]
     ]