A Comparative Study on Requirements Analysis Techniques using Natural Language Processing and Machine Learning (자연어처리와 기계학습을 이용한 요구사항 분석기술 비교 연구)

Byung-Sun Cho (조병선); Seok-Won Lee (이석원)

doi:10.9708/jksci.2020.25.07.027

A Comparative Study on Requirements Analysis Techniques using Natural Language Processing and Machine Learning

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2020, 25(7), pp.27-37
DOI : 10.9708/jksci.2020.25.07.027
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science
Received : February 10, 2020
Accepted : June 19, 2020
Published : July 31, 2020

Byung-Sun Cho ¹, Seok-Won Lee ¹

¹아주대학교

Accredited

ABSTRACT

In this paper, we propose the methodology based on data-driven approach using Natural Language Processing and Machine Learning for classifying requirements into functional requirements and non-functional requirements. Through the analysis of the results of the requirements classification, we have learned that the trained models derived from requirements classification with data-preprocessing and classification algorithm based on the characteristics and information of existing requirements that used term weights based on TF and IDF outperformed the results that used stemming and stop words to classify the requirements into functional and non-functional requirements. This observation also shows that the term weight calculated without removal of the stemming and stop words influenced the results positively. Furthermore, we investigate an optimized method for the study of classifying software requirements into functional and non-functional requirements.

KEYWORDS

Software Engineering, Requirements Engineering, Requirements Analysis, Machine Learning, Natural Language Processing

Citation status

* References for papers published after 2023 are currently being built.

[book] Bourque, Pierre / 2014 / Guide to the software engineering body of knowledge (SWEBOK (R)): Version 3.0 / IEEE Computer Society Press

[book] Kotonya, Gerald / 1998 / Requirements engineering:processes and techniques / Wiley Publishing

[book] Sommerville, Ian / 2011 / Software engineering

[other] Glinz, Martin / 2011 / A glossary of requirements engineering terminology / Standard Glossary of the Certified Professional for Requirements Engineering (CPRE) Studies and Exam, Version 1

[book] Van Lamsweerde, Axel / 2009 / Requirements engineering: From system goals to UML models to software. Vol. 10 / John Wiley & Sons

[confproc] Ernst, Neil A. / 2010 / On the perception of software quality requirements during the project lifecycle / International Working Conference on Requirements Engineering:Foundation for Software Quality / Springer

[confproc] Abad, Zahra Shakeri Hossein / 2015 / Using real options to manage technical debt in requirements engineering / 2015 IEEE 23rd International Requirements Engineering Conference (RE) / IEEE

[confproc] Abad, Zahra Shakeri Hossein / 2016 / What are practitioners asking about requirements engineering? an exploratory analysis of social q&a sites / 2016 IEEE 24th International Requirements Engineering Conference Workshops (REW) / IEEE

[confproc] Abad, Zahra Shakeri Hossein / 2017 / What works better? a study of classifying requirements / 2017 IEEE 25th International Requirements Engineering Conference (RE) / IEEE

[confproc] Hussain, Ishrar / 2008 / Using linguistic knowledge to classify non-functional requirements in SRS documents / International Conference on Application of Natural Language to Information Systems / Springer

[confproc] Dekhtyar, Alex / 2017 / RE data challenge:Requirements identification with Word2Vec and TensorFlow / 2017 IEEE 25th International Requirements Engineering Conference (RE) / IEEE

[confproc] Y. Kim / 2014 / Convolutional neural networks for sentence classification / Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 : 1746~1751

[confproc] Rashwan, Abderahman / 2013 / Ontology-based classification of non-functional requirements in software specifications: a new corpus and svm-based classifier / 2013 IEEE 37th Annual Computer Software and Applications Conference / IEEE

[confproc] Ferrari, Alessio / 2017 / PURE: A dataset of public requirements documents / 2017 IEEE 25th International Requirements Engineering Conference (RE) / IEEE

[other] Porter, Martin F. / 2001 / Snowball: A language for stemming algorithms

[confproc] Qiang, Guo / 2010 / An effective algorithm for improving the performance of Naive Bayes for text classification / 2010Second International Conference on Computer Research and Development

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Comparative Study on Requirements Analysis Techniques using Natural Language Processing and Machine Learning

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Comparative Study on Requirements Analysis Techniques using Natural Language Processing and Machine Learning

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (3)

REFERENCES (16) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.