Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LayerSkip Code Checklist #1

Open
12 of 15 tasks
mostafaelhoushi opened this issue May 3, 2024 · 0 comments
Open
12 of 15 tasks

LayerSkip Code Checklist #1

mostafaelhoushi opened this issue May 3, 2024 · 0 comments
Assignees
@mostafaelhoushi

Comments

@mostafaelhoushi
Copy link
Contributor

mostafaelhoushi commented May 3, 2024 •
edited
Loading

Here is a list of tasks and ideas... they are not all necessary. Also not sure after which task to open source... we can opensource now.

  • Use HuggingFace datasets for CNN/DM, XSUM, HumanEval
  • Make num_shots, seeds become arguments
  • Add License
  • Add unit tests #7
  • Sweep on optimal early_exit_layer and num_speculations
  • Get correctness.py to Work
  • Implement sampling with temperature
  • Address minor TODO comments in code
  • Refactor arguments across scripts
  • Refactor generate.py
  • Clean up and review README #6
  • Implement Text Streaming for Output
  • Implement Text Correction Streaming for Self-Speculation
  • Implement training using Early Exit Loss
  • Implement training using Layer Dropout

Cc @AkshatSh
@mostafaelhoushi mostafaelhoushi self-assigned this May 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mostafaelhoushi mostafaelhoushi

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mostafaelhoushi