Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add authentication instructions to GenAI-Perf tutorial #170

Merged
merged 4 commits into from
Nov 8, 2024

Conversation

dyastremsky
Copy link
Contributor

Add instructions for benchmarking an actual OpenAI endpoint or any endpoint requiring authentication to the GenAI-Perf tutorial. This can be done by passing the token in via the HTTP headers.

@dyastremsky dyastremsky self-assigned this Nov 7, 2024
@dyastremsky dyastremsky changed the title Add authentication instructions to tutorial Add authentication instructions to GenAI-Perf tutorial Nov 7, 2024
@@ -163,6 +163,17 @@ Example output:
└───────────────────────────────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┘
```

### Running with Authentication
GenAI-Perf can benchmark secure endpoints such as OpenAI, which requires API
key authentication. To do so, you can add your API key directly in the command.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can -> must

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice suggestion, updated!


### Running with Authentication
GenAI-Perf can benchmark secure endpoints such as OpenAI, which requires API
key authentication. To do so, you can add your API key directly in the command.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can -> must

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice suggestion, updated.

@@ -163,6 +163,17 @@ Example output:
└───────────────────────────────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┘
```

### Running with Authentication
GenAI-Perf can benchmark secure endpoints such as OpenAI, which requires API
key authentication. To do so, you can add your API key directly in the command.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can -> must

@@ -201,3 +212,13 @@ Example output:
└───────────────────────────────────┴────────┴────────┴────────┴────────┴────────┴────────┘
```

### Running with Authentication
GenAI-Perf can benchmark secure endpoints such as OpenAI, which requires API
key authentication. To do so, you can add your API key directly in the command.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can -> must

genai-perf/docs/tutorial.md Outdated Show resolved Hide resolved
Use plural verb
Copy link
Contributor

@nv-hwoo nv-hwoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

@dyastremsky dyastremsky merged commit 0304415 into main Nov 8, 2024
6 checks passed
@dyastremsky dyastremsky deleted the dyas-authentication branch November 8, 2024 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants