Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests.system.vertexai.test_tokenization.TestTokenization: many tests failed #4468

Open
flaky-bot bot opened this issue Sep 25, 2024 · 21 comments
Open
Assignees
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Sep 25, 2024

Many tests failed at the same time in this package.

  • I will close this issue when there are no more failures in this package and
    there is at least one pass.
  • No new issues will be filed for this package until this issue is closed.
  • If there are already issues for individual test cases, I will close them when
    the corresponding test passes. You can close them earlier, if you prefer, and
    I won't reopen them while this issue is still open.

Here are the tests that failed:

  • test_count_tokens_local[_get_tokenizer_for_model_preview-gemini-1.5-flash-002-udhr-udhr-STAGING_ENDPOINT]
  • test_count_tokens_local[_get_tokenizer_for_model_preview-gemini-1.5-flash-002-udhr-udhr-PROD_ENDPOINT]
  • test_count_tokens_local[_get_tokenizer_for_model_preview-gemini-1.5.pro-002-udhr-udhr-STAGING_ENDPOINT]
  • test_count_tokens_local[_get_tokenizer_for_model_preview-gemini-1.5.pro-002-udhr-udhr-PROD_ENDPOINT]
  • test_count_tokens_local[get_tokenizer_for_model-gemini-1.5-flash-002-udhr-udhr-STAGING_ENDPOINT]
  • test_count_tokens_local[get_tokenizer_for_model-gemini-1.5-flash-002-udhr-udhr-PROD_ENDPOINT]
  • test_count_tokens_local[get_tokenizer_for_model-gemini-1.5.pro-002-udhr-udhr-STAGING_ENDPOINT]
  • test_count_tokens_local[get_tokenizer_for_model-gemini-1.5.pro-002-udhr-udhr-PROD_ENDPOINT]
  • test_compute_tokens[_get_tokenizer_for_model_preview-gemini-1.5-flash-002-udhr-udhr-STAGING_ENDPOINT]
  • test_compute_tokens[_get_tokenizer_for_model_preview-gemini-1.5-flash-002-udhr-udhr-PROD_ENDPOINT]
  • test_compute_tokens[_get_tokenizer_for_model_preview-gemini-1.5.pro-002-udhr-udhr-STAGING_ENDPOINT]
  • test_compute_tokens[_get_tokenizer_for_model_preview-gemini-1.5.pro-002-udhr-udhr-PROD_ENDPOINT]
  • test_compute_tokens[get_tokenizer_for_model-gemini-1.5-flash-002-udhr-udhr-STAGING_ENDPOINT]
  • test_compute_tokens[get_tokenizer_for_model-gemini-1.5-flash-002-udhr-udhr-PROD_ENDPOINT]
  • test_compute_tokens[get_tokenizer_for_model-gemini-1.5.pro-002-udhr-udhr-STAGING_ENDPOINT]
  • test_compute_tokens[get_tokenizer_for_model-gemini-1.5.pro-002-udhr-udhr-PROD_ENDPOINT]
  • test_count_tokens_system_instruction[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_system_instruction[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction[gemini-1.5.pro-002-PROD_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_call[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_call[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_call[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_call[gemini-1.5.pro-002-PROD_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_response[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_response[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_response[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_system_instruction_is_function_response[gemini-1.5.pro-002-PROD_ENDPOINT]
  • test_count_tokens_tool_is_function_declaration[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_tool_is_function_declaration[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_tool_is_function_declaration[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_tool_is_function_declaration[gemini-1.5.pro-002-PROD_ENDPOINT]
  • test_count_tokens_content_is_function_call[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_content_is_function_call[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_content_is_function_call[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_content_is_function_call[gemini-1.5.pro-002-PROD_ENDPOINT]
  • test_count_tokens_content_is_function_response[gemini-1.5-flash-002-STAGING_ENDPOINT]
  • test_count_tokens_content_is_function_response[gemini-1.5-flash-002-PROD_ENDPOINT]
  • test_count_tokens_content_is_function_response[gemini-1.5.pro-002-STAGING_ENDPOINT]
  • test_count_tokens_content_is_function_response[gemini-1.5.pro-002-PROD_ENDPOINT]

commit: c442b92
buildURL: Build Status, Sponge
status: failed

@flaky-bot flaky-bot bot added flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Sep 25, 2024
@product-auto-label product-auto-label bot added the api: vertex-ai Issues related to the googleapis/python-aiplatform API. label Sep 25, 2024
Copy link
Author

flaky-bot bot commented Sep 25, 2024

40 tests failed in this package for commit 950fbbc (Build Status, Sponge).


commit: 950fbbc
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Sep 26, 2024

8 tests failed in this package for commit 44766a0 (Build Status, Sponge).


commit: 44766a0
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Sep 26, 2024

8 tests failed in this package for commit 29dec74 (Build Status, Sponge).


commit: 29dec74
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Sep 30, 2024

8 tests failed in this package for commit 3090812 (Build Status, Sponge).


commit: 3090812
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 1, 2024

8 tests failed in this package for commit f6e0a5a (Build Status, Sponge).


commit: f6e0a5a
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 1, 2024

8 tests failed in this package for commit 427bd75 (Build Status, Sponge).


commit: 427bd75
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 1, 2024

8 tests failed in this package for commit d591101 (Build Status, Sponge).


commit: d591101
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 1, 2024

8 tests failed in this package for commit cbb71cd (Build Status, Sponge).


commit: cbb71cd
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 2, 2024

8 tests failed in this package for commit f7fe2b0 (Build Status, Sponge).


commit: f7fe2b0
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 3, 2024

8 tests failed in this package for commit c670eeb (Build Status, Sponge).


commit: c670eeb
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 3, 2024

8 tests failed in this package for commit 2565a33 (Build Status, Sponge).


commit: 2565a33
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 4, 2024

8 tests failed in this package for commit 44df243 (Build Status, Sponge).


commit: 44df243
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 4, 2024

8 tests failed in this package for commit 85a8c41 (Build Status, Sponge).


commit: 85a8c41
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 4, 2024

9 tests failed in this package for commit 138dc1a (Build Status, Sponge).


commit: 138dc1a
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 7, 2024

8 tests failed in this package for commit 66572e0 (Build Status, Sponge).


commit: 66572e0
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 7, 2024

8 tests failed in this package for commit 09ea389 (Build Status, Sponge).


commit: 09ea389
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 8, 2024

8 tests failed in this package for commit 2b8ae76 (Build Status, Sponge).


commit: 2b8ae76
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 9, 2024

8 tests failed in this package for commit b1d5007 (Build Status, Sponge).


commit: b1d5007
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 9, 2024

8 tests failed in this package for commit 72b76d8 (Build Status, Sponge).


commit: 72b76d8
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 9, 2024

8 tests failed in this package for commit 218b05c (Build Status, Sponge).


commit: 218b05c
buildURL: Build Status, Sponge
status: failed

Copy link
Author

flaky-bot bot commented Oct 9, 2024

8 tests failed in this package for commit 5219868 (Build Status, Sponge).


commit: 5219868
buildURL: Build Status, Sponge
status: failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Development

No branches or pull requests

1 participant