Black-box testing using flowgraphs: an experimental assessment of effectiveness and automation potential
S. Edwards. Software Testing, Verification and Reliability, 10 (4):
249--262(January 2001)MR: Aus dem Text: Testing 'to contract' is at the heart of specification based testing. Es wird gezeigt wie ein Anzatz von Zweben1992 (der leider nicht auffindbar ist) sich praktisch umsetzen lässt. Dabei spielen die Contracts für die Generierung der Test(ein/aus)gabedaten grundlegende Rolle. Die getesteten Komponenten werden als Flowgraphs dargestellt, womit sie große Analogie zu Aktivitätsdiagrammen besitzen. Obwohl noch Probleme bei der Auswahl der Testdaten (infeasable paths) existieren, wurde gezeigt, dass dieser Ansatz großen Potential besitzt. Für das Experiment wurde Fehlerinjektionsmethoden angewendet (Mutation)..
DOI: 10.1002/1099-1689(200012)10:4<249::AID-STVR215>3.0.CO;2-C
Abstract
A black-box testing strategy based on Zweben et al.'s specification-based test data adequacy criteria is explored. The approach focuses on generating a flowgraph from a component's specification and applying analogues of white-box strategies to it. An experimental assessment of the fault-detecting ability of test sets generated using this approach was performed for three of Zweben et al.'s criteria using mutation analysis. By using precondition, postcondition and invariant checking wrappers around the component under test, fault detection ratios competitive with white-box techniques were achieved. Experience with a prototype test set generator used in the experiment suggests that practical automation may be feasible.
MR: Aus dem Text: Testing 'to contract' is at the heart of specification based testing. Es wird gezeigt wie ein Anzatz von Zweben1992 (der leider nicht auffindbar ist) sich praktisch umsetzen lässt. Dabei spielen die Contracts für die Generierung der Test(ein/aus)gabedaten grundlegende Rolle. Die getesteten Komponenten werden als Flowgraphs dargestellt, womit sie große Analogie zu Aktivitätsdiagrammen besitzen. Obwohl noch Probleme bei der Auswahl der Testdaten (infeasable paths) existieren, wurde gezeigt, dass dieser Ansatz großen Potential besitzt. Für das Experiment wurde Fehlerinjektionsmethoden angewendet (Mutation).
%0 Journal Article
%1 Edwards2000
%A Edwards, Stephen H.
%D 2001
%J Software Testing, Verification and Reliability
%K automated black-box contracts fault-injection flowgraph oracle path sensitization specification-based testdata testing
%N 4
%P 249--262
%R 10.1002/1099-1689(200012)10:4<249::AID-STVR215>3.0.CO;2-C
%T Black-box testing using flowgraphs: an experimental assessment of effectiveness and automation potential
%U http://dx.doi.org/10.1002/1099-1689(200012)10:4\%3C249::AID-STVR215\%3E3.0.CO;2-C
%V 10
%X A black-box testing strategy based on Zweben et al.'s specification-based test data adequacy criteria is explored. The approach focuses on generating a flowgraph from a component's specification and applying analogues of white-box strategies to it. An experimental assessment of the fault-detecting ability of test sets generated using this approach was performed for three of Zweben et al.'s criteria using mutation analysis. By using precondition, postcondition and invariant checking wrappers around the component under test, fault detection ratios competitive with white-box techniques were achieved. Experience with a prototype test set generator used in the experiment suggests that practical automation may be feasible.
@article{Edwards2000,
abstract = {A black-box testing strategy based on Zweben et al.'s specification-based test data adequacy criteria is explored. The approach focuses on generating a flowgraph from a component's specification and applying analogues of white-box strategies to it. An experimental assessment of the fault-detecting ability of test sets generated using this approach was performed for three of Zweben et al.'s criteria using mutation analysis. By using precondition, postcondition and invariant checking wrappers around the component under test, fault detection ratios competitive with white-box techniques were achieved. Experience with a prototype test set generator used in the experiment suggests that practical automation may be feasible.},
added-at = {2008-09-03T09:01:58.000+0200},
author = {Edwards, Stephen H.},
biburl = {https://www.bibsonomy.org/bibtex/2a45a856d10b02b17f280190fcd86e042/ist_spl},
doi = {10.1002/1099-1689(200012)10:4<249::AID-STVR215>3.0.CO;2-C},
interhash = {e2acb29b0b7abf32458d4f1a81592ded},
intrahash = {a45a856d10b02b17f280190fcd86e042},
issn = {1099-1689},
journal = {Software Testing, Verification and Reliability},
keywords = {automated black-box contracts fault-injection flowgraph oracle path sensitization specification-based testdata testing},
month = {January},
note = {MR: Aus dem Text: Testing 'to contract' is at the heart of specification based testing. Es wird gezeigt wie ein Anzatz von [Zweben1992] (der leider nicht auffindbar ist) sich praktisch umsetzen lässt. Dabei spielen die Contracts für die Generierung der Test(ein/aus)gabedaten grundlegende Rolle. Die getesteten Komponenten werden als Flowgraphs dargestellt, womit sie große Analogie zu Aktivitätsdiagrammen besitzen. Obwohl noch Probleme bei der Auswahl der Testdaten (infeasable paths) existieren, wurde gezeigt, dass dieser Ansatz großen Potential besitzt. Für das Experiment wurde Fehlerinjektionsmethoden angewendet (Mutation).},
number = 4,
pages = {249--262},
posted_at = {2005-02-07 17:23:44},
priority = {2},
timestamp = {2008-09-03T09:01:59.000+0200},
title = {Black-box testing using flowgraphs: an experimental assessment of effectiveness and automation potential},
url = {http://dx.doi.org/10.1002/1099-1689(200012)10:4\%3C249::AID-STVR215\%3E3.0.CO;2-C},
volume = 10,
year = 2001
}