Logo image
A novel unsupervised ensemble framework using concept-based linguistic methods and machine learning for Twitter sentiment analysis
Journal article   Open access   Peer reviewed

A novel unsupervised ensemble framework using concept-based linguistic methods and machine learning for Twitter sentiment analysis

Maryum Bibi, Wajid Arshad Abbasi, Wajid Aziz, Sundus Khalil, Mueen Uddin, Celestine Iwendi and Thippa Reddy Gadekallu
Pattern Recognition Letters, Vol.158, pp.80-86
06/2022

Abstract

Concept-based sentiment analysis (CBSA) methods have gained prominence in natural language processing in recent years. These methods consider the underlying semantic meanings of text to perform different tasks such as Twitter sentiment analysis (assigning positive, negative, or neutral sentiment to Tweets). CBSA is superior to traditional statistical methods for accurately discovering sentiment labels. Due to a limited knowledge base, these methods are unable to identify the sentiment polarity of all kinds of text. Therefore, supervised learning techniques are mostly ensembled with CBSA methods to classify whole text. These techniques require labeled data. It is a tedious and time consuming task due to the manually labeling of large datasets (Such as Twitter datasets). Therefore, an unsupervised learning mechanism can be a better alternative to solve this problem. In this paper, a novel unsupervised learning framework based on Concept-based and hierarchical clustering is proposed for Twitter sentiment analysis. Popular hierarchical clustering methods including single linkage, complete linkage, and average linkage algorithms are ensembled serially. Two different feature representation methods including Boolean and Term frequency-inverse document frequency (TF-IDF) are investigated. We have also experimented with Well-known classifiers (Naïve Bayes, Neural Network) for a fair comparison. Accuracy measure (proportion of correct predictions) is used to evaluate the performance of understudied techniques. It is empirically shown that the performance of unsupervised learning techniques is comparable with supervised learning techniques.
pdf
A Novel Unsupervised Ensemble Framework using Concept-based (1).pdf474.48 kBDownloadView
AcceptedCC BY-NC-ND V4.0 Open Access
url
Link to Published VersionView
Published (Version of record)Publisher sites may require subscription to read contentIn Copyright All Rights Reserved Restricted

Metrics

66 File views/ downloads
21 Record Views
113 Times Cited - Scopus

Details

Logo image

Usage Policy