GPT-2 state and GPT-j-6B

[ghost]

I would like to ask about the state of the GPT-2 model. Will it arrive soon at huggingface?

I would also like to ask if you have the intention of train GPT-j-6B. Training this model for some people would be impossible due to its hardware requirements, but you have Mare Nostrum, the dataset and the previous version GPT-2.

[asier-gutierrez]

I would like to ask about the state of the GPT-2 model. Will it arrive soon at huggingface?

They will be published soon but I can not tell you when. Hope not later than this October.

I would also like to ask if you have the intention of train GPT-j-6B. Training this model for some people would be impossible due to its hardware requirements, but you have Mare Nostrum, the dataset and the previous version GPT-2.

In the short term we do not have plans to do so. However, we are continuously gathering corpora for this purpose.

I will keep this issue open in order to provide updates.

[asier-gutierrez]

I am pleased to announce that GPT-2 base and large are already available. I will let this thread open for the next steps.