Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How does generator update? #10

Open
Jessielym66 opened this issue Jan 25, 2022 · 0 comments
Open

How does generator update? #10

Jessielym66 opened this issue Jan 25, 2022 · 0 comments

Comments

@Jessielym66
Copy link

I'm confused about the EM step in codes. The paper describes that the rule generator is updated by maximizing the log-likelyhood of the identified high-quality rules, while in the codes, rule generator computes loss between 'logits' and 'target'. I wonder that whether the 'logits' is the first term 'RNN(rule|r)' in Eq.(9)? And what does the 'target' mean? Why do you apply CrossEntropyLoss on them? Does it achieve the efficiency same as maximization? Or do I misunderstand the code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant