Embeddings-Based Clustering for Target Specific Stances: The Case of a Polarized Turkey

19 May 2020  ·  Ammar Rashed, Mucahid Kutlu, Kareem Darwish, Tamer Elsayed, Cansin Bayrak ·

On June 24, 2018, Turkey conducted a highly consequential election in which the Turkish people elected their president and parliament in the first election under a new presidential system. During the election period, the Turkish people extensively shared their political opinions on Twitter. One aspect of polarization among the electorate was support for or opposition to the reelection of Recep Tayyip Erdo\u{g}an. In this paper, we present an unsupervised method for target-specific stance detection in a polarized setting, specifically Turkish politics, achieving 90% precision in identifying user stances, while maintaining more than 80% recall. The method involves representing users in an embedding space using Google's Convolutional Neural Network (CNN) based multilingual universal sentence encoder. The representations are then projected onto a lower dimensional space in a manner that reflects similarities and are consequently clustered. We show the effectiveness of our method in properly clustering users of divergent groups across multiple targets that include political figures, different groups, and parties. We perform our analysis on a large dataset of 108M Turkish election-related tweets along with the timeline tweets of 168k Turkish users, who authored 213M tweets. Given the resultant user stances, we are able to observe correlations between topics and compute topic polarization.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Stance Detection Trump Midterm Elections 2018 MUSE + UMAP (Unsupervised) Avg F1 0.86 # 1
Macro Precision 0.89 # 1
Macro Recall 0.84 # 1
Stance Detection Turkish Elections 2018 MUSE + UMAP (Unsupervised) Macro Precision 0.90 # 1
Macro Recall 0.79 # 1
Avg F1 0.84 # 1

Methods


No methods listed for this paper. Add relevant methods here