Regression Test Selection Tool for Python in Continuous Integration Process

Show full item record



Permalink

http://hdl.handle.net/10138/333461

Citation

Kauhanen , E O , Nurminen , J K , Mikkonen , T & Pashkovskiy , M 2021 , Regression Test Selection Tool for Python in Continuous Integration Process . in 4th International Workshop on Validation, Analysis and Evolution of Software Tests (VST’2021) co-located with SANER 2021 . IEEE , pp. 618 - 621 , IEEE International Conference on Software Analysis, Evolution and Reengineering , Honolulu , United States , 09/03/2021 . https://doi.org/10.1109/SANER50967.2021.00077

Title: Regression Test Selection Tool for Python in Continuous Integration Process
Author: Kauhanen, Eero Olavi; Nurminen, Jukka K; Mikkonen, Tommi; Pashkovskiy, Matvey
Contributor: University of Helsinki, Department of Computer Science
University of Helsinki, Department of Computer Science
University of Helsinki, Empirical Software Engineering research group / Tomi Männistö
Publisher: IEEE
Date: 2021-03
Language: eng
Number of pages: 4
Belongs to series: 4th International Workshop on Validation, Analysis and Evolution of Software Tests (VST’2021) co-located with SANER 2021
ISBN: 978-1-7281-9630-5
URI: http://hdl.handle.net/10138/333461
Abstract: In this paper, we present a coverage-based regression test selection (RTS) approach and a developed tool for Python. The tool can be used either on a developer's machine or on build servers. A special characteristic of the tool is the attention to easy integration to continuous integration and deployment. To evaluate the performance of the proposed approach, mutation testing is applied to three open-source projects, and the results of the execution of full test suites are compared to the execution of a set of tests selected by the tool. The missed fault rate of the test selection varies between 0-2% at file-level granularity and 16-24% at line-level granularity. The high missed fault rate at the line-level granularity is related to the selected basic mutation approach and the result could be improved with advanced mutation techniques. Depending on the target optimization metric (time or precision) in DevOps/MLOps process the error rate could be acceptable or further improved by using file-level granularity based test selection.
Subject: 113 Computer and information sciences
Regression test selection
test automation
continuous integration
mutation testing
software engineering
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
Smart_test_selection_VTS_2021_2_.pdf 164.4Kb PDF View/Open

This item appears in the following Collection(s)

Show full item record