Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[onert] Introduce NUM_THREADS config #13929

Merged
merged 1 commit into from
Sep 5, 2024
Merged

Conversation

hseok-oh
Copy link
Contributor

@hseok-oh hseok-oh commented Sep 4, 2024

This commit introduces NUM_THREADS.
NUM_THREADS replaces RUY_THREADS and XNNPACK_THREADS.

ONE-DCO-1.0-Signed-off-by: Hyeongseok Oh [email protected]


Related issue: #13909 (comment)

@hseok-oh hseok-oh added the PR/ready for review It is ready to review. Please review it. label Sep 4, 2024
@hseok-oh hseok-oh requested review from glistening and a team September 4, 2024 06:06
jyoungyun
jyoungyun previously approved these changes Sep 4, 2024
Copy link
Contributor

@jyoungyun jyoungyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

glistening
glistening previously approved these changes Sep 4, 2024
Copy link
Contributor

@glistening glistening left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM though I prefer NUM_THREADS. See #13929 (comment).

@@ -31,8 +31,7 @@ CONFIG(USE_SCHEDULER , bool , "0")
CONFIG(TRACING_MODE , bool , "0")
CONFIG(MINMAX_DUMP , bool , "0")
CONFIG(FP16_ENABLE , bool , "0")
CONFIG(RUY_THREADS , int , "-1")
CONFIG(XNNPACK_THREADS , int , "-1")
CONFIG(ONERT_THREADS , int , "-1")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(optional) What about removing ONERT_ as other variables? We may use NUM_THREADS.

Suggested change
CONFIG(ONERT_THREADS , int , "-1")
CONFIG(NUM_THREADS , int , "-1")

It seems our python code also uses the name of num_threads.

This commit introduces `NUM_THREADS`.
`NUM_THREADS` replaces `RUY_THREADS` and `XNNPACK_THREADS`.

ONE-DCO-1.0-Signed-off-by: Hyeongseok Oh <[email protected]>
@hseok-oh hseok-oh dismissed stale reviews from glistening and jyoungyun via 9d0c65a September 4, 2024 08:56
@hseok-oh hseok-oh changed the title [onert] Introduce ONERT_THREADS config [onert] Introduce NUM_THREADS config Sep 4, 2024
Copy link
Contributor

@glistening glistening left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@ragmani ragmani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hseok-oh hseok-oh merged commit 72349cc into Samsung:master Sep 5, 2024
9 checks passed
@hseok-oh hseok-oh deleted the onert_threads branch September 5, 2024 07:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PR/ready for review It is ready to review. Please review it.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants