Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] holistic design for supporting accelerators in ray core #38504

Closed
scv119 opened this issue Aug 16, 2023 · 3 comments
Closed

[Core] holistic design for supporting accelerators in ray core #38504

scv119 opened this issue Aug 16, 2023 · 3 comments
Assignees
@jjyao
Labels
core Issues that should be addressed in Ray Core core-hardware Hardware support in Ray core: e.g. accelerators enhancement Request for new feature and/or capability P0 Issues that should be fixed in short order ray-2.9 Issues targeting Ray 2.9 release (~Q4 CY2023) size-medium

Comments

@scv119
Copy link
Contributor

scv119 commented Aug 16, 2023 •
edited
Loading

Description

We have seen increasing demands for support accelerators in Ray core, including AWS neurons, TPUs, AMD GPUs and Intel accelerators. Currently we are doing it incrementally but we might lose the big picture. We should do a proper design after 2.7.

Use case

intel #38553
aws #37998
tpu #38669
amd ?

No response
@scv119 scv119 added enhancement Request for new feature and/or capability P0 Issues that should be fixed in short order triage Needs triage (eg: priority, bug/not-bug, and owning component) core Issues that should be addressed in Ray Core and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Aug 16, 2023
@scv119 scv119 added the ray-2.8 label Aug 16, 2023
@rkooo567 rkooo567 added the release-blocker P0 Issue that blocks the release label Aug 23, 2023
@scv119 scv119 removed the release-blocker P0 Issue that blocks the release label Aug 23, 2023
@jjyao jjyao mentioned this issue Aug 29, 2023
Merged
8 tasks
@scv119 scv119 mentioned this issue Sep 14, 2023
Merged
8 tasks
@jjyao jjyao added the core-hardware Hardware support in Ray core: e.g. accelerators label Sep 25, 2023
@xwu99
Copy link

xwu99 commented Oct 10, 2023 •
edited
Loading

Description

We have seen increasing demands for support accelerators in Ray core, including AWS neurons, TPUs, AMD GPUs and Intel accelerators. Currently we are doing it incrementally but we might lose the big picture. We should do a proper design after 2.7.

Use case

intel #38553 aws #37998 tpu #38669 amd ?

No response

Intel GPU: #38553
Intel Gaudi: #39759

@jjyao jjyao mentioned this issue Oct 12, 2023
Merged
8 tasks
@rkooo567 rkooo567 added ray-2.9 Issues targeting Ray 2.9 release (~Q4 CY2023) and removed ray-2.8 labels Oct 30, 2023
@anyscalesam
Copy link
Contributor

@jjyao @scv119 does the new abstraction layer implemented not address this or is there more we can do? cc @xieus

@jjyao
Copy link
Collaborator

jjyao commented Nov 3, 2023

Design is here: ray-project/enhancements#46

@jjyao jjyao closed this as completed Nov 3, 2023
@jerome-habana jerome-habana mentioned this issue May 15, 2024
Closed
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jjyao jjyao

Labels
core Issues that should be addressed in Ray Core core-hardware Hardware support in Ray core: e.g. accelerators enhancement Request for new feature and/or capability P0 Issues that should be fixed in short order ray-2.9 Issues targeting Ray 2.9 release (~Q4 CY2023) size-medium
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@scv119 @jjyao @rkooo567 @xwu99 @anyscalesam