Testing computer vision applications an experience report on introducing code coverage analysis in the field

Iulia Nica, Franz Wotawa, Gerhard Jakob, Kathrin Juhart

Publikation: KonferenzbeitragPaperForschungBegutachtung

Abstract

In this paper we present our work in progress in defining a suitable testing and validation methodology to be used within computer vision (CV) projects. Typical quality assurance (QA) measures, targeting the applicability in real-world scenarios, are meant here to complement the research on specific computer vision methods. While inspecting the existing literature in the domain of CV performance evaluation, we first identified the main challenges the CV researchers have to deal with. Second, as every vision algorithm eventually takes the form of a software program, we followed the classic software development process and performed an in depth code coverage analysis in order to assure the quality of our test suites and pinpoint code areas that need to be reviewed. This further leaves us with the questions of which test coverage tool to prefer in our situation and whether we can introduce some specific evaluation criteria for identifying the right tool to be used within a CV project. In this article we also contribute to answering these questions.

Originalspracheenglisch
Seiten15-21
Seitenumfang7
PublikationsstatusVeröffentlicht - 2016
VeranstaltungJoint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, - TU Graz, Graz, Österreich
Dauer: 18 Okt 201119 Jan 2017

Workshop

WorkshopJoint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems,
LandÖsterreich
OrtGraz
Zeitraum18/10/1119/01/17

Fingerprint

Computer vision
Testing
Quality assurance
Software engineering

ASJC Scopus subject areas

  • !!Computer Science(all)

Fields of Expertise

  • Information, Communication & Computing

Treatment code (Nähere Zuordnung)

  • Application

Dies zitieren

Nica, I., Wotawa, F., Jakob, G., & Juhart, K. (2016). Testing computer vision applications an experience report on introducing code coverage analysis in the field. 15-21. Beitrag in Joint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, , Graz, Österreich.

Testing computer vision applications an experience report on introducing code coverage analysis in the field. / Nica, Iulia; Wotawa, Franz; Jakob, Gerhard; Juhart, Kathrin.

2016. 15-21 Beitrag in Joint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, , Graz, Österreich.

Publikation: KonferenzbeitragPaperForschungBegutachtung

Nica, I, Wotawa, F, Jakob, G & Juhart, K 2016, 'Testing computer vision applications an experience report on introducing code coverage analysis in the field' Beitrag in, Graz, Österreich, 18/10/11 - 19/01/17, S. 15-21.
Nica I, Wotawa F, Jakob G, Juhart K. Testing computer vision applications an experience report on introducing code coverage analysis in the field. 2016. Beitrag in Joint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, , Graz, Österreich.
Nica, Iulia ; Wotawa, Franz ; Jakob, Gerhard ; Juhart, Kathrin. / Testing computer vision applications an experience report on introducing code coverage analysis in the field. Beitrag in Joint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, , Graz, Österreich.7 S.
@conference{4ee14fbc2aa44dcd8ce801773a8a2e1c,
title = "Testing computer vision applications an experience report on introducing code coverage analysis in the field",
abstract = "In this paper we present our work in progress in defining a suitable testing and validation methodology to be used within computer vision (CV) projects. Typical quality assurance (QA) measures, targeting the applicability in real-world scenarios, are meant here to complement the research on specific computer vision methods. While inspecting the existing literature in the domain of CV performance evaluation, we first identified the main challenges the CV researchers have to deal with. Second, as every vision algorithm eventually takes the form of a software program, we followed the classic software development process and performed an in depth code coverage analysis in order to assure the quality of our test suites and pinpoint code areas that need to be reviewed. This further leaves us with the questions of which test coverage tool to prefer in our situation and whether we can introduce some specific evaluation criteria for identifying the right tool to be used within a CV project. In this article we also contribute to answering these questions.",
author = "Iulia Nica and Franz Wotawa and Gerhard Jakob and Kathrin Juhart",
year = "2016",
language = "English",
pages = "15--21",
note = "Joint International Workshop on Quality Assurance in Computer Vision and the International Workshop on Digital Eco-Systems, ; Conference date: 18-10-2011 Through 19-01-2017",

}

TY - CONF

T1 - Testing computer vision applications an experience report on introducing code coverage analysis in the field

AU - Nica, Iulia

AU - Wotawa, Franz

AU - Jakob, Gerhard

AU - Juhart, Kathrin

PY - 2016

Y1 - 2016

N2 - In this paper we present our work in progress in defining a suitable testing and validation methodology to be used within computer vision (CV) projects. Typical quality assurance (QA) measures, targeting the applicability in real-world scenarios, are meant here to complement the research on specific computer vision methods. While inspecting the existing literature in the domain of CV performance evaluation, we first identified the main challenges the CV researchers have to deal with. Second, as every vision algorithm eventually takes the form of a software program, we followed the classic software development process and performed an in depth code coverage analysis in order to assure the quality of our test suites and pinpoint code areas that need to be reviewed. This further leaves us with the questions of which test coverage tool to prefer in our situation and whether we can introduce some specific evaluation criteria for identifying the right tool to be used within a CV project. In this article we also contribute to answering these questions.

AB - In this paper we present our work in progress in defining a suitable testing and validation methodology to be used within computer vision (CV) projects. Typical quality assurance (QA) measures, targeting the applicability in real-world scenarios, are meant here to complement the research on specific computer vision methods. While inspecting the existing literature in the domain of CV performance evaluation, we first identified the main challenges the CV researchers have to deal with. Second, as every vision algorithm eventually takes the form of a software program, we followed the classic software development process and performed an in depth code coverage analysis in order to assure the quality of our test suites and pinpoint code areas that need to be reviewed. This further leaves us with the questions of which test coverage tool to prefer in our situation and whether we can introduce some specific evaluation criteria for identifying the right tool to be used within a CV project. In this article we also contribute to answering these questions.

UR - http://www.scopus.com/inward/record.url?scp=84996865631&partnerID=8YFLogxK

M3 - Paper

SP - 15

EP - 21

ER -