On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Evaluating others' reviews of products via helpfulness votes is a crucial aspect of purchase decision-making in online marketplaces. Previous work studied key determinant factors of review helpfulness, such as product metadata and review text. However, understanding the extent to which review helpfulness depends on product context, rather than the inherent textual value of a review, remains an open question. In this work, we study how genre, score and review text relate to the helpfulness of 319 017 video game reviews on Metacritic via correlational analyses and prediction experiments. We find significant, genre-dependent correlations between score and helpfulness. This underlies the strength of text vs. score features in our helpfulness prediction models, which achieve up to 0.64 F 1 . This work is thus a stepping stone towards causal disentanglement of product context from text in review helpfulness estimation.
Original languageEnglish
Title of host publication2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS)
PublisherIEEE Xplore
Pages75 - 82
ISBN (Electronic)978-1-7281-2946-4
DOIs
Publication statusPublished - 16 Dec 2019
Event2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS) - Granada, Spain
Duration: 22 Oct 201825 Oct 2019
http://emergingtechnet.org/SNAMS2019/

Conference

Conference2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS)
CountrySpain
CityGranada
Period22/10/1825/10/19
Internet address

Fingerprint

Metadata
Decision making
Experiments

Cite this

Kasper, P., Koncar, P., Teixeira dos Santos, T. F., & Gütl, C. (2019). On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic. In 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS) (pp. 75 - 82). IEEE Xplore. https://doi.org/10.1109/SNAMS.2019.8931866

On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic. / Kasper, Patrick; Koncar, Philipp; Teixeira dos Santos, Tiago Filipe; Gütl, Christian.

2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS). IEEE Xplore, 2019. p. 75 - 82.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Kasper, P, Koncar, P, Teixeira dos Santos, TF & Gütl, C 2019, On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic. in 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS). IEEE Xplore, pp. 75 - 82, 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), Granada, Spain, 22/10/18. https://doi.org/10.1109/SNAMS.2019.8931866
Kasper P, Koncar P, Teixeira dos Santos TF, Gütl C. On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic. In 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS). IEEE Xplore. 2019. p. 75 - 82 https://doi.org/10.1109/SNAMS.2019.8931866
Kasper, Patrick ; Koncar, Philipp ; Teixeira dos Santos, Tiago Filipe ; Gütl, Christian. / On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic. 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS). IEEE Xplore, 2019. pp. 75 - 82
@inproceedings{7715ec6b58b3455dbf199e51064522a4,
title = "On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic",
abstract = "Evaluating others' reviews of products via helpfulness votes is a crucial aspect of purchase decision-making in online marketplaces. Previous work studied key determinant factors of review helpfulness, such as product metadata and review text. However, understanding the extent to which review helpfulness depends on product context, rather than the inherent textual value of a review, remains an open question. In this work, we study how genre, score and review text relate to the helpfulness of 319 017 video game reviews on Metacritic via correlational analyses and prediction experiments. We find significant, genre-dependent correlations between score and helpfulness. This underlies the strength of text vs. score features in our helpfulness prediction models, which achieve up to 0.64 F 1 . This work is thus a stepping stone towards causal disentanglement of product context from text in review helpfulness estimation.",
author = "Patrick Kasper and Philipp Koncar and {Teixeira dos Santos}, {Tiago Filipe} and Christian G{\"u}tl",
year = "2019",
month = "12",
day = "16",
doi = "10.1109/SNAMS.2019.8931866",
language = "English",
pages = "75 -- 82",
booktitle = "2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS)",
publisher = "IEEE Xplore",

}

TY - GEN

T1 - On the Role of Score, Genre and Text in Helpfulness of Video Game Reviews on Metacritic

AU - Kasper, Patrick

AU - Koncar, Philipp

AU - Teixeira dos Santos, Tiago Filipe

AU - Gütl, Christian

PY - 2019/12/16

Y1 - 2019/12/16

N2 - Evaluating others' reviews of products via helpfulness votes is a crucial aspect of purchase decision-making in online marketplaces. Previous work studied key determinant factors of review helpfulness, such as product metadata and review text. However, understanding the extent to which review helpfulness depends on product context, rather than the inherent textual value of a review, remains an open question. In this work, we study how genre, score and review text relate to the helpfulness of 319 017 video game reviews on Metacritic via correlational analyses and prediction experiments. We find significant, genre-dependent correlations between score and helpfulness. This underlies the strength of text vs. score features in our helpfulness prediction models, which achieve up to 0.64 F 1 . This work is thus a stepping stone towards causal disentanglement of product context from text in review helpfulness estimation.

AB - Evaluating others' reviews of products via helpfulness votes is a crucial aspect of purchase decision-making in online marketplaces. Previous work studied key determinant factors of review helpfulness, such as product metadata and review text. However, understanding the extent to which review helpfulness depends on product context, rather than the inherent textual value of a review, remains an open question. In this work, we study how genre, score and review text relate to the helpfulness of 319 017 video game reviews on Metacritic via correlational analyses and prediction experiments. We find significant, genre-dependent correlations between score and helpfulness. This underlies the strength of text vs. score features in our helpfulness prediction models, which achieve up to 0.64 F 1 . This work is thus a stepping stone towards causal disentanglement of product context from text in review helpfulness estimation.

U2 - 10.1109/SNAMS.2019.8931866

DO - 10.1109/SNAMS.2019.8931866

M3 - Conference contribution

SP - 75

EP - 82

BT - 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS)

PB - IEEE Xplore

ER -