CoLA: The Corpus of Linguistic Acceptability The Corpus of Linguistic Acceptability (CoLA) in its full form consists of 10657 sentences from 23 linguistics publications, expertly annotated for acceptability (grammaticality) by their original authors. We load data from hugging face, and train model with a small size with few trainig parameters, with good performace accuracy.