Panel: Context-Dependent Evaluation of Tools for NL RE Tasks: Recall vs. Precision, and beyond

Berry, DM; Cleland-Huang, J; Ferrari, A; Maalej, W; Mylopoulos, J; Zowghi, D

Panel: Context-Dependent Evaluation of Tools for NL RE Tasks: Recall vs. Precision, and beyond

Berry, DM Cleland-Huang, J Ferrari, A Maalej, W Mylopoulos, J Zowghi, D

Permalink

Publication Type:: Conference Proceeding
Citation:: Proceedings - 2017 IEEE 25th International Requirements Engineering Conference, RE 2017, 2017, pp. 570 - 573
Issue Date:: 2017-09-22

Closed Access

	Filename	Description	Size
	08049186.pdf	Published version	148.89 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Berry, DM	en_US
dc.contributor.author	Cleland-Huang, J	en_US
dc.contributor.author	Ferrari, A	en_US
dc.contributor.author	Maalej, W	en_US
dc.contributor.author	Mylopoulos, J	en_US
dc.contributor.author	Zowghi, D https://orcid.org/0000-0002-6051-0155	en_US
dc.date.issued	2017-09-22	en_US
dc.identifier.citation	Proceedings - 2017 IEEE 25th International Requirements Engineering Conference, RE 2017, 2017, pp. 570 - 573	en_US
dc.identifier.isbn	9781538631911	en_US
dc.identifier.uri	http://hdl.handle.net/10453/127482
dc.description.abstract	© 2017 IEEE. Context and Motivation Natural language processing has been used since the 1980s to construct tools for performing natural language (NL) requirements engineering (RE) tasks. The RE field has often adopted information retrieval (IR) algorithms for use in implementing these NL RE tools. Problem Traditionally, the methods for evaluating an NL RE tool have been inherited from the IR field without adapting them to the requirements of the RE context in which the NL RE tool is used. Principal Ideas This panel discusses the problem and considers the evaluation of tools for a number of NL RE tasks in a number of contexts. Contribution The discussion is aimed at helping the RE field begin to consistently evaluate each of its tools according to the requirements of the tool's task.	en_US
dc.relation.ispartof	Proceedings - 2017 IEEE 25th International Requirements Engineering Conference, RE 2017	en_US
dc.relation.isbasedon	10.1109/RE.2017.64	en_US
dc.title	Panel: Context-Dependent Evaluation of Tools for NL RE Tasks: Recall vs. Precision, and beyond	en_US
dc.type	Conference Proceeding
utslib.for	0806 Information Systems	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/DVC (Research)
pubs.organisational-group	/University of Technology Sydney/DVC (Research)/Graduate Research School
pubs.organisational-group	/University of Technology Sydney/Strength - HCTD - Human Centred Technology Design
pubs.organisational-group	/University of Technology Sydney/Strength - STEM Education Futures
utslib.copyright.status	closed_access
pubs.publication-status	Published	en_US

Abstract:

© 2017 IEEE. Context and Motivation Natural language processing has been used since the 1980s to construct tools for performing natural language (NL) requirements engineering (RE) tasks. The RE field has often adopted information retrieval (IR) algorithms for use in implementing these NL RE tools. Problem Traditionally, the methods for evaluating an NL RE tool have been inherited from the IR field without adapting them to the requirements of the RE context in which the NL RE tool is used. Principal Ideas This panel discusses the problem and considers the evaluation of tools for a number of NL RE tasks in a number of contexts. Contribution The discussion is aimed at helping the RE field begin to consistently evaluate each of its tools according to the requirements of the tool's task.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/127482