Possible use of r/ChangeMyView for Assertivity vs Certainty evaluation

[EMZEDI]

Not a dataset for misinformation but we can expand our experiments by expanding the context on which assertivity is examined.

Expected results

1. More assertive comments are more persuasive -> LLM-human interaction is similar to human-human interaction when it comes to assertiveness vs certainty comparison. (Just to verify what is mentioned in the human feedback is not gold standard paper)
2. Show the difference between distributions of certainty and assertiveness by integrating the LLM into the dataset.

ToDos

1. Figure out how to integrate LLM into the dataset. One proposed method could be feeding each post (OP + comments) to the LLM and similar to the misinfo case, ask it which comment is more likely to be the Delta comment and why and at the end to rate its certainty.