CPL - Chalmers Publication Library
| Utbildning | Forskning | Styrkeområden | Om Chalmers | In English In English Ej inloggad.

Outliers and Replication in Software Engineering

Erik Lindqvist (Institutionen för data- och informationsteknik (Chalmers)) ; Henrik Larsson (Institutionen för data- och informationsteknik (Chalmers)) ; Richard Torkar
Proceedings The 21st Asia-Pacific Software Engineering Conference (1530-1362). p. 207-214. (2014)
[Konferensbidrag, refereegranskat]

Empirical software engineering is a research field of growing interest. Studies within this field handles an increasing amount of data. In order to replicate a study the data needs to be accessible and all processing of this data needs to be reproducible. Specifically, the handling of deviating data points, also known as outliers, needs to be documented in order for a study to be replicated. This study investigated the data availability for recently published studies within empirical software engineering. Furthermore, it also investigated if outliers are documented in the same research field. Papers were reviewed using a literature review and the presence of outliers was investigated using an unsupervised outlier detection method. Only 37% of the papers reviewed had their data accessible. Furthermore, in many cases outliers were present in the reviewed studies but 63% of the papers studies did not mention how outliers were handled. The data availability within empirical software engineering research is low and is hindering replication of studies. Additionally, the lack of documentation regarding how outliers are handled is hindering replication.

Nyckelord: Outliers; Replication; Reproducibility.; Software engineering, Data handling; Statistics, Data availability; Empirical Software Engineering; Literature reviews; Outlier Detection

Denna post skapades 2014-09-22. Senast ändrad 2016-11-30.
CPL Pubid: 203113


Läs direkt!

Länk till annan sajt (kan kräva inloggning)

Institutioner (Chalmers)

Institutionen för data- och informationsteknik (Chalmers)
Institutionen för data- och informationsteknik (GU) (GU)



Chalmers infrastruktur