Logo image
A novel unsupervised ensemble framework using concept-based linguistic methods and machine learning for Twitter sentiment analysis
Journal article   Open access   Peer reviewed

A novel unsupervised ensemble framework using concept-based linguistic methods and machine learning for Twitter sentiment analysis

Maryum Bibi, Wajid Arshad Abbasi, Wajid Aziz, Sundus Khalil, Mueen Uddin, Celestine Iwendi and Thippa Reddy Gadekallu
Pattern Recognition Letters, Vol.158, pp.80-86
06/2022

Abstract

Concept-based sentiment analysis (CBSA) methods have gained prominence in natural language processing in recent years. These methods consider the underlying semantic meanings of text to perform different tasks such as Twitter sentiment analysis (assigning positive, negative, or neutral sentiment to Tweets). CBSA is superior to traditional statistical methods for accurately discovering sentiment labels. Due to a limited knowledge base, these methods are unable to identify the sentiment polarity of all kinds of text. Therefore, supervised learning techniques are mostly ensembled with CBSA methods to classify whole text. These techniques require labeled data. It is a tedious and time consuming task due to the manually labeling of large datasets (Such as Twitter datasets). Therefore, an unsupervised learning mechanism can be a better alternative to solve this problem. In this paper, a novel unsupervised learning framework based on Concept-based and hierarchical clustering is proposed for Twitter sentiment analysis. Popular hierarchical clustering methods including single linkage, complete linkage, and average linkage algorithms are ensembled serially. Two different feature representation methods including Boolean and Term frequency-inverse document frequency (TF-IDF) are investigated. We have also experimented with Well-known classifiers (Naïve Bayes, Neural Network) for a fair comparison. Accuracy measure (proportion of correct predictions) is used to evaluate the performance of understudied techniques. It is empirically shown that the performance of unsupervised learning techniques is comparable with supervised learning techniques.
pdf
A Novel Unsupervised Ensemble Framework using Concept-based (1).pdf474.48 kBDownloadView
Accepted Open Access CC BY-NC-ND V4.0  — This license enables reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only if attribution is given to the creator.
url
Link to Published VersionView
Published (Version of record) Publisher sites may require subscription to read content Restricted In Copyright All Rights Reserved  — This item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation (such as any Fair Dealing allowances allowed by copyright law). For other uses you need to obtain permission from the rights-holder(s).
url
https://ub-ir.bolton.ac.uk/view/delivery/44UOBO_INST/124026460008841/134259440008841View
Open

Metrics

156 File views/ downloads
21 Record Views
113 Times Cited - Scopus

Details

Logo image

Usage Policy