Replication in computing education research: Researcher attitudes and experiences

Ahadi, A; Hellas, A; Ihantola, P; Korhonen, A; Petersen, A

Replication in computing education research: Researcher attitudes and experiences

Ahadi, A

Hellas, A Ihantola, P Korhonen, A Petersen, A

Permalink

Publication Type:: Conference Proceeding
Citation:: ACM International Conference Proceeding Series, 2016, pp. 2 - 11
Issue Date:: 2016-11-24

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Accepted ManuscriptAdobe PDF (392.59 kB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Ahadi, A https://orcid.org/0000-0002-2018-3065	en_US
dc.contributor.author	Hellas, A	en_US
dc.contributor.author	Ihantola, P	en_US
dc.contributor.author	Korhonen, A	en_US
dc.contributor.author	Petersen, A	en_US
dc.date.available	2020-05-25T19:19:19Z
dc.date.issued	2016-11-24	en_US
dc.identifier.citation	ACM International Conference Proceeding Series, 2016, pp. 2 - 11	en_US
dc.identifier.isbn	9781450347709	en_US
dc.identifier.uri	http://hdl.handle.net/10453/78996
dc.description.abstract	© 2016 ACM. Replicability is a core principle of the scientific method. However, several scientific disciplines have suffered crises in confidence caused, in large part, by attitudes toward replication. This work reports on the value the computing education research community associates with studies that aim to replicate, reproduce or repeat earlier research. The results were obtained from a survey of 73 computing education researchers. An analysis of the responses confirms that researchers in our field hold many of the same biases as those in other fields experiencing a crisis in replication. In particular, researchers agree that original works - novel works that report new phenomena - have more impact and are more prestigious. They also agree that originality is an important criteria for accepting a paper, making such work more likely to be published. Furthermore, while the respondents agree that published work should be verifiable, they doubt this standard is widely met in the computing education field and are not eager to perform the work of verifying others' work themselves.	en_US
dc.relation.ispartof	ACM International Conference Proceeding Series	en_US
dc.relation.isbasedon	10.1145/2999541.2999554	en_US
dc.title	Replication in computing education research: Researcher attitudes and experiences	en_US
dc.type	Conference Proceeding
utslib.for	1399 Other Education	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
utslib.copyright.status	open_access
pubs.publication-status	Published	en_US

Abstract:

© 2016 ACM. Replicability is a core principle of the scientific method. However, several scientific disciplines have suffered crises in confidence caused, in large part, by attitudes toward replication. This work reports on the value the computing education research community associates with studies that aim to replicate, reproduce or repeat earlier research. The results were obtained from a survey of 73 computing education researchers. An analysis of the responses confirms that researchers in our field hold many of the same biases as those in other fields experiencing a crisis in replication. In particular, researchers agree that original works - novel works that report new phenomena - have more impact and are more prestigious. They also agree that originality is an important criteria for accepting a paper, making such work more likely to be published. Furthermore, while the respondents agree that published work should be verifiable, they doubt this standard is widely met in the computing education field and are not eager to perform the work of verifying others' work themselves.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/78996