Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: try-start model service API #1754

Merged
merged 13 commits into from
Feb 28, 2024
Merged

Conversation

kyujin-cho
Copy link
Member

@kyujin-cho kyujin-cho commented Dec 2, 2023

This PR introduces a new /services/_/try API.
Checklist: (if applicable)

  • Milestone metadata specifying the target backport version
  • Mention to the original issue
  • Documentation
  • API server-client counterparts (e.g., manager API -> client SDK)
  • Test case(s) to demonstrate the difference of before/after

@kyujin-cho kyujin-cho added this to the 24.03 milestone Dec 2, 2023
@kyujin-cho kyujin-cho self-assigned this Dec 2, 2023
@github-actions github-actions bot added comp:client Related to Client component comp:manager Related to Manager component size:XL 500~ LoC labels Dec 2, 2023
@kyujin-cho kyujin-cho requested a review from achimnol December 2, 2023 09:31
@lizable
Copy link
Contributor

lizable commented Jan 3, 2024

@kyujin-cho please resolve conflicts from main branch. Seems like there are lots of changes in api/service module.

| SessionTerminatedEvent
| ModelServiceStatusEvent,
) -> None:
await reporter.update(message=json.dumps({"event": event.name}))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kyujin-cho Could you add session_id on every event?

Copy link
Contributor

@lizable lizable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be useful to send session_id when every event is sent. Could you change message data according to comments above @kyujin-cho ?

case SessionTerminatedEvent() | SessionCancelledEvent():
terminated_event.set()
case ModelServiceStatusEvent():
await reporter.update(message=event.new_status.value)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here as well.

@lizable lizable self-requested a review January 18, 2024 09:40
Copy link
Contributor

@lizable lizable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@kyujin-cho kyujin-cho added this pull request to the merge queue Feb 24, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 24, 2024
@achimnol achimnol added this pull request to the merge queue Feb 28, 2024
Merged via the queue into main with commit 7621a09 Feb 28, 2024
27 checks passed
@achimnol achimnol deleted the feature/model-service-try-api branch February 28, 2024 02:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:client Related to Client component comp:manager Related to Manager component size:XL 500~ LoC
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants