Predicting Cognitive Distortions from Reddit Posts by Using Supervised Machine Learning Methods
Name
Linda Katariina Grents
Abstract
Importance of mental health has gained great attention in modern societies. People have become more open about discussing their thoughts with the public, especially online. One platform that people are using it for is Reddit. The aim of this thesis is to predict cogni-tive distortions from the texts retrieved from the Anxiety sub-reddit. Cognitive distortions are important to detect as they can potentially have a negative impact on people’s lives. Predictions in this work are made by using supervised machine learning methods, such as logistic regression, support vector machine and fasttext (also with pre-trained word vec-tors). In addition, inter-annotator agreement between annotators is being assessed with Cohen’s Kappa and Krippendorff’s Alpha. The results show that predicting cognitive dis-tortions from the text is a challenge on its own, since the classifiers were not able to pro-duce satisfactory results. This corresponds to related works where predicting different types of distortions have not given very good results. It is assumed that it would be more reasonable to predict the existence of cognitive distortions from the text rather than pre-dicting different types of distortions, as this prediction shows better results. Predicting the existence of some distortion might be of more help to people suffering from anxiety or depression. It might also be useful to predict only the most prevalent distortions from the text, as some distortions are probably more prevalent than others. It is important to note that major constraint in this work is related to the dataset, as it is relatively small in size and noisy. If there is a need to predict different types of cognitive distortions, it is sug-gested to use a larger dataset of better quality. However, this remains a challenge on its own in natural language processing and clinical psychology research area.
Graduation Thesis language
English
Graduation Thesis type
Master - Data Science
Supervisor(s)
Kairit Sirts
Defence year
2022