Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: Test and document histogram latency metrics #7694

Merged
merged 16 commits into from
Oct 23, 2024
Merged

test: Test and document histogram latency metrics #7694

merged 16 commits into from
Oct 23, 2024

Commits on Oct 11, 2024

  1. Add tests for histogram metrics (decoupled)

    @yinggeh
    yinggeh committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    892805f View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Update model without torch dependency

    @yinggeh
    yinggeh committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    7e946ae View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Update doc

    @yinggeh
    yinggeh committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    e084067 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Disable histograms by default

    @yinggeh
    yinggeh committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    40147f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Test histogram data of ensemble decoupled model

    @yinggeh
    yinggeh committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    056437f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:triton-inference-server/server into… 

    … DLIS-7383-yinggeh-metrics-standardization-TTFT
    @yinggeh
    yinggeh committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7d9696f View commit details
    Browse the repository at this point in the history

  3. Replace unittest with test_util

    @yinggeh
    yinggeh committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    87caf2c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:triton-inference-server/server into… 

    … DLIS-7383-yinggeh-metrics-standardization-TTFT
    @yinggeh
    yinggeh committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7331d4f View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Address comments

    @yinggeh
    yinggeh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    eff3ce1 View commit details
    Browse the repository at this point in the history

  2. Minor updates

    @yinggeh
    yinggeh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    1148209 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Allow multiple response per request. Add test for non-decoupled model… 

    … metrics.
    @yinggeh
    yinggeh committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    3c008c8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:triton-inference-server/server into… 

    … DLIS-7383-yinggeh-metrics-standardization-TTFT
    @yinggeh
    yinggeh committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    aa9ddc7 View commit details
    Browse the repository at this point in the history

  3. Simplify test models

    @yinggeh
    yinggeh committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    04d72cc View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Address comments

    @yinggeh
    yinggeh committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    4b326ed View commit details
    Browse the repository at this point in the history

  2. Remove time

    @yinggeh
    yinggeh committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    68c5d8e View commit details
    Browse the repository at this point in the history

  3. Update doc

    @yinggeh
    yinggeh committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    f08e051 View commit details
    Browse the repository at this point in the history