Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GPU] Moved RMSFusion higher in pipeline and added output type fuse #27564

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Lyamin-Roman
Copy link
Contributor

@Lyamin-Roman Lyamin-Roman commented Nov 14, 2024

Details:

  • Moved RMSFusion higher in the transformation pipeline
  • Added added output type fuse for RMS in ConvertPrecision
  • Extended RMSFusion pattern
  • Change helps to get rid of unnecessary Converts

@Lyamin-Roman Lyamin-Roman added the category: GPU OpenVINO GPU plugin label Nov 14, 2024
@Lyamin-Roman Lyamin-Roman requested review from a team as code owners November 14, 2024 16:51
@Lyamin-Roman Lyamin-Roman requested review from itikhono and removed request for a team November 14, 2024 16:51
@github-actions github-actions bot added the category: transformations OpenVINO Runtime library - Transformations label Nov 14, 2024
@@ -465,7 +467,8 @@ bool ov::pass::ConvertPrecision::run_on_model(const std::shared_ptr<ov::Model>&
{ov::op::v0::PriorBox::get_type_info_static(), fuse_type_to_prior_box<ov::op::v0::PriorBox>},
{ov::op::v8::PriorBox::get_type_info_static(), fuse_type_to_prior_box<ov::op::v8::PriorBox>},
{ov::op::v0::PriorBoxClustered::get_type_info_static(), fuse_type_to_prior_box<ov::op::v0::PriorBoxClustered>},
{ov::op::v15::SearchSorted::get_type_info_static(), fuse_type_to_search_sorted_v15}};
{ov::op::v15::SearchSorted::get_type_info_static(), fuse_type_to_search_sorted_v15},
{ov::op::internal::RMS::get_type_info_static(), fuse_type_to_rms}};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. One question: does CPU plugin support this type fusion?

@@ -43,6 +43,12 @@ class TRANSFORMATIONS_API RMS : public ov::op::Op {
m_epsilon = epsilon;
}

void set_output_type(const element::Type& output_type) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rename this memeber to avoid masking base class member then
using Node::set_output_type;

should not be requried.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants