-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
update layernorm #1570
base: develop
Are you sure you want to change the base?
update layernorm #1570
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- API naming issue, we can't have
layernorm2d_fwd_fp16
,layernorm2d_fwd_fp16
. Need have a single APIlayernorm2d_fwd
which is originally rocking version - need use
trait
to dispatch API. This PR completely remove this p_mean
,p_invStd
removed??
-> this PR need more change to merge to public
2. Move construction of tensor_view and tile_window to operator()
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nothing to do on docs side.
e50e331
to
abe875d
Compare
9b64545
to
47396e2
Compare
47396e2
to
02b9a7d
Compare
02b9a7d
to
5c736bc
Compare
No description provided.