Journal of Systems and Software 84 (4): 603-619 (2011) |
Lijun Mei 2 , W.K. Chan 3 , T.H. Tse 2 , and Robert G. Merkel 4
ABSTRACT |
A web service may evolve autonomously,
making peer web services in the same service composition uncertain as to
whether the evolved behaviors are compatible with its original
collaborative agreement.
Although peer services may wish to
conduct regression testing to verify the agreed collaboration,
the source code of the former service may be inaccessible to
them.
Owing to the black-box nature of peer services,
traditional code-based approaches to regression testing are inapplicable.
In addition, traditional techniques assume that a regression test suite
for verifying a web service is available.
The location
to store a regression test suite is also a problem.
On the other hand,
we note that the rich interface specifications of a web
service provide peer services with a means to formulate black-box
testing strategies.
In this paper,
we provide a strategy for
black-box service-oriented testing.
We also formulate new test case prioritization strategies using tags
embedded in XML
messages to reorder regression test cases,
and reveal how the test cases use the interface specifications of web services.
We experimentally evaluate the effectiveness of these black-box
strategies in revealing regression faults in modified WS-BPEL programs.
The results show that the new techniques can have a high chance of
outperforming random ordering.
Moreover, our experiment shows that prioritizing test cases based
on WSDL tag coverage can achieve a smaller variance than that based
on the number of tags in XML messages in regression test cases,
even though their overall fault detection rates are similar.
Keywords: test case prioritization; black-box regression testing; WS-BPEL; service testing; service-oriented testing |
|
EVERY VISITOR COUNTS: |