Skip to content

Issues: AnswerDotAI/ModernBERT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 46 Closed
37 Open 46 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Tokenizer training implementation
#207 opened Feb 26, 2025 by joanna-baran-allegro
1
HuggingFace loss implementation
#206 opened Feb 26, 2025 by megatron6000
IndexError: tuple index out of range in input_ids during pre-training
#199 opened Feb 13, 2025 by ebrarkiziloglu
3
BackendCompilerFailed
#198 opened Feb 12, 2025 by farrokhsiar
Question about MLDR Evaluation Metrics in ModernBERT Paper
#193 opened Jan 31, 2025 by WoutDeRijck
@bclavie
Can't find yamls/main/modernbert-base.yaml in repo
#192 opened Jan 28, 2025 by KennethEnevoldsen
1
2
contextual embeddings of individual words
#191 opened Jan 27, 2025 by Jinsong-Chen
2
TypeError: ModernBertForSequenceClassification.__init__() got an unexpected keyword argument 'compile'
#190 opened Jan 26, 2025 by amrzv
@ohmeow
3
How to Tag Entities/Keywords in ModernBert?
#188 opened Jan 24, 2025 by grahama1970
How to use a custom tokenizer for pre-training BERT from scratch
#187 opened Jan 22, 2025 by m3hm00d
4
How to Extract a Model from a Checkpoint
#186 opened Jan 21, 2025 by GamjaPower
3
ImportError: cannot import name 'StreamingDataset' from 'streaming'
#185 opened Jan 20, 2025 by dongdql
1
2
Are there minimum hardware requirements regarding pre-training?
#182 opened Jan 16, 2025 by lefterisloukas
2
ModernBert Encoder
#180 opened Jan 15, 2025 by buaa-luzhi
3
ModernBertPreTrainedModel for word-level prediction tasks
#179 opened Jan 15, 2025 by QXGeraldMo
8
Yaml used to train the ModernBert
#178 opened Jan 14, 2025 by darknight054
@NohTow
1
Unable to reproduce Table 7 from the paper
#176 opened Jan 9, 2025 by pawasthy
1
ModernBertModel works on the CPU but fails on the GPU
#174 opened Jan 8, 2025 by rudigunn
3
Request for code to quantize and convert ModernBERT Model to ONNX
#173 opened Jan 7, 2025 by DeepakSinghRawat
8
During pre-training, using FA2 consumes more memory than using SDPA
#172 opened Jan 6, 2025 by neavo
10
What's the difference among the different mode when initialize model from pretrained model?
#171 opened Jan 3, 2025 by Lynnzake
@warner-benjamin
Does not support multiple gpu training. Also, please post how to convert your pretrain results into hugging faces.
#169 opened Dec 31, 2024 by HaloKim
1
Missing model_max_length for tokeniser
#166 opened Dec 28, 2024 by orkenstein
@NohTow
3
MaskedLM nan training loss
#163 opened Dec 26, 2024 by yzimmermann
3
Example of GreedyBestFitSequencePacker with HuggingFace Trainer
#161 opened Dec 24, 2024 by bryonkucharski
ProTip! Find all open issues with in progress development work with linked:pr.