diff --git a/features/package.feature b/features/package.feature
index 8cda511c0..4f9363721 100644
--- a/features/package.feature
+++ b/features/package.feature
@@ -56,3 +56,17 @@ Feature: Manage WP-CLI packages
 
     When I run `wp --require=bad-command.php package list`
     Then STDERR should be empty
+
+  Scenario: Run package commands without hitting Composer plugin errors in Phar files
+    Given an empty directory
+    And a new Phar with the same version
+
+    When I run `{PHAR_PATH} package list`
+    Then STDERR should not contain:
+      """
+      failed to open stream
+      """
+    And STDERR should not contain:
+      """
+      is not a file in phar
+      """