Using NLP to Detect Tradeoffs in Employee Reviews - Systematic Innovation Partnerships with Artificial Intelligence and Information Technology
Conference Papers Year : 2022

Using NLP to Detect Tradeoffs in Employee Reviews

Abstract

This paper presents a methodology to identify industry-specific tradeoffs using natural language processing (NLP) to analyze employee reviews from Glassdoor. The analysis is based on 400,000+ reviews from employees working in the financial sector between 2008 and 2020. For each review, the pros and cons sections are classified in a one-to-many approach in terms of the most prevalent topics in the sector. The most prevalent noun chunks within a representative sample of reviews are used as topics. The classification of reviews is based on the cosine similarity between the sentence embeddings of these topics and the sentence embeddings of the comment sections using a sentence-transformer model. Based on this classification, the count of pro-con topic pairs is tested for statistical significance against a control of randomly generated pairings from the same sample of classifications. The process is repeated 10,000 times and only pairs with a p-value < .05 (after Bonferroni-Holm correction) are considered. If both, a pro-con pair of topics and its opposite pairing are significantly frequent, this combination of topics qualifies as a tradeoff. Depending on whether the same pairing constitutes a significantly frequent pro-pro pair, it can be determined whether a solution for the tradeoff exists in the sector (at least within the limitations of this approach). Using 13 topic labels, 2 tradeoffs – work-life balance vs. opportunity (without solution in the sector) and work-life balance vs. management (with solution in the sector) – have been identified. In addition to that, 8 more pro-con pairs were identified as significant.
Embargoed file
Embargoed file
0 0 10
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04449786 , version 1 (15-02-2024)

Licence

Identifiers

Cite

Justus Schollmeyer. Using NLP to Detect Tradeoffs in Employee Reviews. 22th International TRIZ Future Conference (TFC), Sep 2022, Warsaw, Poland. pp.209-219, ⟨10.1007/978-3-031-17288-5_19⟩. ⟨hal-04449786⟩
27 View
2 Download

Altmetric

Share

More