Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Decoupled Async Execute #350

Merged
merged 14 commits into from
Apr 11, 2024
Merged

Decoupled Async Execute #350

merged 14 commits into from
Apr 11, 2024

Commits on Apr 2, 2024

  1. Add async decoupled execute

    @kthui
    kthui committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4159726 View commit details
    Browse the repository at this point in the history

  2. Enable decoupled bls async exec

    @kthui
    kthui committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    42ed090 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Improve handling for async execute future object

    @kthui
    kthui committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    985c5a2 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. Add docs for async execute for decoupled model

    @kthui
    kthui committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    11a63d6 View commit details
    Browse the repository at this point in the history

  2. Fix link on docs

    @kthui
    kthui committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    b26d5a0 View commit details
    Browse the repository at this point in the history

  3. Improve docs wording

    @kthui
    kthui committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    c50d0cc View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Improve destruction steps for async execute future object

    @kthui
    kthui committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    7558474 View commit details
    Browse the repository at this point in the history

  2. Piggy back on GIL for protection

    @kthui
    kthui committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    7a7aa5d View commit details
    Browse the repository at this point in the history

  3. Document model should not modify event loop

    @kthui
    kthui committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    00f0cb8 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Use Python add_done_callback

    @kthui
    kthui committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    68b4439 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:triton-inference-server/python_back… 

    …end into jacky-py-aio
    @kthui
    kthui committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    e8e0342 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Protect infer_payload_

    @kthui
    kthui committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    954222c View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Use traceback API that supports Python 3.8 and 3.9

    @kthui
    kthui committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e81386d View commit details
    Browse the repository at this point in the history

  2. Update docs

    @kthui
    kthui committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    2b387c5 View commit details
    Browse the repository at this point in the history