WebTest
WebTest Functional Selftests    Tests started at Tue Jul 19 17:34:51 CEST 2016

Result Summary

WebTests#%Graph
ok26597
x83
Sum 273 100 
Steps#%Graph
ok147999
x81
o00
Sum 1487 100 

Server Roundtrip Timing Profile

Secs#%Histogram
Sum 503 100 
Avg     128 ms
0 - 149699
1 - 331
3 - 520
5 - 1020
10 - 3000
> 3000

Test Scenario Overview (00:01:04)

#ResultName# StepsTiming profileFailing step
Duration%Graph
1oktest request.csv report5 / 500:00:058
2okstoreProperty: test for the existence and/or value of a dynamic property7 / 10470
3x[Should fail] JavaScript error: JS error in setTimeout task make step fail1 / 25771
clickButton
4okJavaScript error: JS error in setTimeout but it is ignored2 / 2570
5okbrowser version: default is IE66 / 65121
6okbrowser version: configure FF36 / 61440
7okbrowser version: configure IE66 / 61720
8okbrowser version: configure IE76 / 61290
9okbrowser version: configure FF3.6 with custom User-Agent header6 / 61200
10oksampleUse: Show how to use Canoo WebTest plainly16 / 168271
11okinvoke: normal invocation2 / 32230
12okinvoke: shows that invoke accepts a complete url ignoring config settings2 / 2580
13okinvoke: access protected resource4 / 52960
14okinvoke: shows REST-like web service request6 / 62870
15okinvoke: shows SOAP web service request4 / 41290
16okdescription: this webtest has a description attribute which value should appear in the report1 / 11300
17oktestInfo: simple usage scenario
someInfo displayed in overview as type='summary'
someOtherInfo displayed in overview as well
7 / 7840
18okverifyText: Show how to test against arbitrary text on the page4 / 61300
19okverifyText: Show how to use regular expressions on the whole page5 / 51340
20okverifyText: Try table locator8 / 92030
21okverifyElementText: Show how to find text within a specified html element12 / 171420
22oktableLocator: Locating cells in tables11 / 141060
23oktableLocator: test deprecated id attribute3 / 3460
24okverifyElement: Show how arbitrary html elements can be tested8 / 12880
25okverifyTitle: Show how title tag can be tested3 / 3600
26okverifyCheckbox: Check simple states4 / 61770
27okverifyCheckbox: Check checkboxes with non-unique name but different values6 / 7910
28okverifyCheckbox: Check checkboxes with non-unique name and identical values3 / 3660
29okverifyCheckbox: Check checkboxes with non-unique name and identical values3 / 3680
30okverifyXPath: test xpath usage11 / 141890
31okverifyXPath: test WebTest xpath functions8 / 8850
32okverifyXPath: test xpath usage3 / 3460
33okverifyLinks: linkcheck11 / 1315202
34okverifyImages: image check4 / 51980
35okverifyImages: currentResponse unchanged4 / 41030
36okverifyProperty: test for the existence and/or value of a dynamic property12 / 14250
37okverifyProperty: test for the existence and/or value of an ant property5 / 7240
38okverifyProperty: test normal and late property expansion6 / 6130
39okverifyProperty: set up dynamic property for dynamic scope test1 / 120
40okverifyProperty: test property in different webtest1 / 240
41okverifyProperty: set up ant property for ant scope test1 / 110
42okverifyProperty: test property in different webtest1 / 120
43okverifyDialogs: test simple dialog coming from a function started by setTimeout6 / 631795
44okverifyDialogs: test simple dialog form validation example using legacy steps24 / 272260
45okverifyDialogs: test mock HardDiskErase but don't expect enough responses9 / 121960
46okverifyDialogs: test mock HardDiskErase but prepare too many responses8 / 9920
47okverifyDialogs: test mock HardDiskErase27 / 271660
48okverifyDialogs: test mock HardDiskErase but with incorrect dialog type15 / 181820
49okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using saveProperty7 / 8900
50okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes9 / 101100
51okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes8 / 910602
52okverifyLinkedContent: testVerifyLinkedContentWithError2 / 32040
53okverifyLinkedContent: testVerifyLinkedContentWithoutLink2 / 2750
54okverifyLinkedContent: testVerifyLinkedContentWithoutLink2 / 21680
55okverifyDocumentURL: Show how to test against arbitrary text in the document URL3 / 4690
56okverifyDocumentURL: Show how to use regular expressions on the document URL3 / 3630
57okverifyDocumentURL: Show that redirected pages work (via sendRedirect())2 / 2530
58okverifyDocumentURL: Show that redirected pages work (via Meta-equiv refresh)2 / 2900
59oksetCheckbox: Check setting simple states4 / 41410
60oksetCheckbox: Check setting multiple checkboxes6 / 61080
61oksetCheckbox: Check setting checkboxes with values11 / 141820
62oksetCheckbox: Check multivalue checkboxes (same name but different values).6 / 61540
63oksetCheckbox: Check multivalue checkboxes without specifying value works with first4 / 41060
64oksetCheckbox: Check preservation of already checked checkboxes6 / 61080
65oksetCheckbox: Reset a checked checkbox7 / 71040
66oksetCheckbox: Try to set or reset non existing checkbox6 / 10660
67oksetCheckbox: Try to use htmlId for heading2 / 3510
68oksetCheckbox: Tests related to checkbox with JavaScript21 / 2111832
69oksetCheckbox: Tests related to checkbox with JavaScript16 / 161770
70oksetSelectField: Show usage of setSelectField and test it22 / 283231
71oksetSelectField: Show usage of setSelectField with a combobox13 / 192840
72oksetSelectField: onchange loads an iframe4 / 41260
73oksetSelectField: Test various edge cases4 / 6480
74oksetFileField: Show usage of setFileField using 'name' and related attributes15 / 165831
75oksetFileField: Show usage of setFileField using 'htmlId' attribute7 / 9760
76okautoSelectForm: check that JavaScript can submit upon select change4 / 4700
77okautoSelectForm: check again with custom config-based saveResponse name4 / 4650
78okautoSelectForm: check again with custom step-based saveResponse name4 / 4550
79oknewFormSteps: Tests the new form steps29 / 311950
80oknewFormSteps: Tests the new form steps with xpath19 / 193050
81oknewFormSteps: Try to use htmlId for heading2 / 3640
82okradioButton: Try to use htmlId for heading2 / 3410
83okradioButton: Tests access with xpath to radio buttons10 / 111310
84okradioButton: Tests related to radio buttons with JavaScript20 / 203291
85okradioButton: Tests related to radio buttons without JavaScript18 / 181660
86okselectForm: Test selectForm usage and error cases22 / 24940
87okforceHiddenInputField: Show forceHiddenInputField fails if field doesn't exist2 / 3350
88okforceHiddenInputField: Show working javascript example that sets hidden field5 / 5400
89okforceHiddenInputField: Show usage of forceHiddenInputField step for non-working javascript9 / 9940
90okclickLink: Show how to click on hyperlinks in a page10 / 111360
91okclickLink: Clicklink with Target10 / 10860
92okclickButton: Locating submit buttons and submitting the respective forms52 / 5312162
93okclickButton: ClickButton with javascript3 / 3460
94okclickButton: ClickButton with Target3 / 3570
95okclickButton: ClickButton with button element3 / 3530
96okclickButton: Clicks a button in a frame and checks that the frameset is always there10 / 102310
97okclickButton: check that we can locate button when form is left out (non-compliant)6 / 6790
98okclickButton: click button to form with JS error3 / 4520
99okclickButton: click button to form with JS error with ThrowExceptionOnScriptError set to false3 / 3540
100okclickElement: Click Table Cell20 / 21890
101okclickElement: only 'visible' elements are clickable6 / 8660
102okmultiplePostsAndPreviousResponse: Show POST usage with multiple forms and back navigation33 / 342880
103okfollowFrame: Show how to follow frames in a page15 / 161670
104okmouseOver & mouseOut11 / 11580
105okpdfPreviousResponse: Previous Response should work with trailing PDF steps7 / 79882
106okpdfBookmarks: confirm existence of PDF bookmarks6 / 82930
107okpdfBookmarks: confirm verifyContent extracting bookmarks4 / 41780
108okpdfLinks: confirm existence of PDF links8 / 1218073
109okpdfLinks: confirm verifyContent extracting links4 / 41130
110okpdfFonts: confirm existence of PDF fonts9 / 13780
111okpdfFonts: confirm verifyContent extracting font information4 / 4960
112okpdfText: confirm verifyContent extracting text10 / 101710
113okpdfPermissions: confirm PDF document permissions6 / 6780
114okexcel: sample usage16 / 167141
115okexcel: find row7 / 71180
116okexcel: select sheet9 / 91480
117okexcel: store cell value7 / 7680
118okexcel: verify cell value18 / 181330
119okexcel: verify cell sum7 / 7890
120okexcel: verify cell format469 / 4697291
121okexcel: structure filter w/ compare to expected4 / 42150
122okexcel: structure filter w/ apply filters5 / 5970
123okexcel: test crystal excel file2 / 2340
124okautorefresh meta-equiv refresh with delay 0 failing when using default config2 / 26931
125okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=-12 / 2530
126okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=false2 / 2620
127okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=true2 / 23301
128okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=02 / 2630
129okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=52 / 2640
130okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=-12 / 2360
131okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=false2 / 2530
132okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=12 / 2330
133okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=true2 / 2550
134okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=22 / 2590
135okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=52 / 2570
136okredirect: test various server-side Redirect methods8 / 81880
137okconfiguration: test that wt.config.* properties are used1 / 1490
138okconfiguration: test timeout value3 / 400:00:0711
139okconfiguration: Webtest sets version1 / 110
140xconfiguration: Expected to fail without breaking the build.0 / 1450
invoke invoking an unknown page will not work
141xconfiguration: Report an Error without stopping the build0 / 100clickButton intentionally bad attributes
142xconfiguration: fail without breaking build and set property.1 / 3550
invoke invoking an unknown page will not work
143okconfiguration: check the failure property was set as expected.1 / 110
144xconfiguration: error without breaking build and set property.1 / 340
clickButton intentionally bad attributes
145okconfiguration: check the error property was set as expected.1 / 110
146okconfiguration: test storing properties with defaultPropertyType set to 'dynamic'3 / 350
147okconfiguration: test storing properties with defaultPropertyType set to 'ant'3 / 350
148okconfiguration: test storing properties with defaultPropertyType set to 'antstrict'3 / 360
149okconfiguration: Show warnings for invalid HTML1 / 1870
150okconfiguration: try bad option name1 / 1220
151okconfiguration: try bad option value1 / 1360
152okconfiguration: test default values for resultpath and resultfile1 / 1420
153okantWrapper: Test use of <antcall ...> to externalize steps for reuse17 / 351580
154okantWrapper: Test use of <ant file=...> to externalize steps for reuse9 / 91750
155okantWrapper: test antWrapper step22 / 221150
156okantWrapper: test antWrapper with antcall21 / 391280
157okantWrapper: test antWrapper with antcall for coverage7 / 16590
158okantWrapper: test antWrapper with macros19 / 19470
159okantWrapper: test use of macro with Webtest step in a repeat15 / 15210
160okwrappedSteps: Test AntWrapper4 / 4710
161okwrappedSteps: Test AntWrapper with macro6 / 8850
162okwrappedSteps: Test macro without AntWrapper5 / 7670
163okwrappedSteps: Test nested macros6 / 8890
164okcookie: Show usage of verifyCookie and test it5 / 62740
165okcookie: Show usage of verifyCookie and test it5 / 6770
166okcookie: Show usage of storeCookie and test it9 / 10710
167okcookie: visit count test example14 / 143561
168okcookie: revisit count test example6 / 7610
169okcookie: revisit count test example with initial cookie value set4 / 4370
170okhttpHeader: default value for Accept-Language http header3 / 3280
171okhttpHeader: confirm custom setting of http headers3 / 3270
172okhttpHeader: test common user agent settings - default case (IE6)2 / 2290
173okhttpHeader: test common user agent settings - legacy Netscape2 / 2230
174okhttpHeader: test common user agent settings - recent Mozilla/Firefox2 / 2230
175okhttpHeader: confirm usage of storeHeader (re-load image test)29 / 291110
176okhttpResponseCode: confirm successful page3 / 3300
177okhttpResponseCode: confirm error page3 / 3460
178okstore: Show usage of storeRegEx and test it4 / 4460
179okstore: Show usage of storeXPath and test it13 / 14990
180okstore: storeXPath without a document - let's you use XPath for manipulating values6 / 6130
181okstore: store to ant properties1 / 130
182okstore: verify properties stored previously2 / 250
183okstoreLinkParameter: invalid usage of storeLinkParameter3 / 5330
184okstoreLinkParameter: Show usage of storeLinkParameter and test it5 / 5330
185okstoreElementAttribute: Click Table Cell with errors7 / 9940
186okstoreRandom: Show how to use storeRandom step126 / 14510972
187okstoreDigest: Show how to use storeDigest step7 / 7820
188okstoreDigest: storeDigest step with regex replacement12 / 123341
189okstoreLength: Simple usage4 / 4780
190okstoreLength: Applied to content filtered with regex replace filter12 / 121480
191okstoreLength: Applied to content selected with table selector11 / 14410
192okstoreLength: Applied to content selected with XPath4 / 4870
193okstoreLength: Applied to content selected with htmlId4 / 41050
194okinputFieldAttribute: Show storeInputFieldAttribute fails if inputField doesn't exist2 / 3330
195okinputFieldAttribute: Show usage of storeInputFieldAttribute step using disabled attribute9 / 9590
196okinputFieldAttribute: Show usage of forceInputFieldAttribute step using disabled attribute18 / 19950
197okinputFieldAttribute: Show usage of storeInputFieldAttribute tests using checked attribute13 / 13960
198okinputFieldAttribute: test tricky form cases5 / 5350
199okverifyContent: Show simple usage of verifyContent step12 / 152080
200okverifyContent: verifyContent of xpath selection3 / 3770
201okverifyContent: verifyContent of htmlId selection3 / 3570
202okverifyContent: verifyContent with regex replace10 / 101680
203okverifyContent: check that it works correctly when more than one window is used (WT-293)10 / 1011432
204okverifyContent: show usage of regexPerLine mode4 / 5610
205okapplyFilters: confirm applyFilters changes response8 / 82010
206okapplyFilters: confirm applyFilters changes response with default save set to off8 / 9700
207oknot: Show how NOT can be used to assert the absence of page properties16 / 281970
208okrepeat: test property extension (WT-239)20 / 203951
209okrepeat: Show usage of the repeat step26 / 272010
210okrepeat: repeat step using ant for defaultPropertyType5 / 5390
211okrepeat: repeat step using antstrict for defaultPropertyType5 / 5260
212okrepeat: WT-153, repeat step with embedded group9 / 91830
213okrepeat: test repeat with XPath (WT-239)10 / 111170
214okgroup: Show how to use the group step14 / 17540
215okgroup: Check that description expands properly2 / 210
216oktimedGroup: Show how to use the timedGroup step19 / 231620
217okiframeTest5 / 5630
218okifstep: test and illustrate if step usage26 / 393150
219okifstep: test and illustrate if step usage12 / 261330
220okifstep: test that when a macro used in condition fails, the test doesn't fail (WT-317)1 / 530
221okretry: illustrate RETRY of nested steps until they succeed10 / 1431015
222okretry: test RETRY nested steps fail scenarios7 / 1521103
223okretry: test property extension (WT-249)4 / 6370
224okproblemCases: Reset parameter cache bug5 / 5570
225okproblemCases: test for bad html - form in table not properly nested in td tags2 / 2510
226okjavascript: simple script using document.write()2 / 2290
227okjavascript: DOM manipulation script called by onLoad2 / 2470
228okjavascript: complex moveTo function call will fail if various JavaScript functionality is not supported2 / 2350
229okjavascript: script changes action attribute of form on button click6 / 6980
230okjavascript: test javascript containing an error fails (save case)1 / 2320
231okjavascript: test javascript containing an error fails (no save case)1 / 2300
232okjavascript: test config option to ignore javascript errors3 / 4440
233okjavascript: test javascript enabled (default)2 / 2300
234okjavascript: test javascript disabled using config setting3 / 4320
235okjavascript: test javascript disabled using enableJavaScript step7 / 8600
236okcloseWindow: show how closing the current window brings back to the previous one10 / 10550
237okselectWindow: Show how to select a popup window11 / 12550
238okselectWindow: Show how to select a popup window using the html document's title14 / 16570
239okselectWindow: Test whether a previous response restores a popup window10 / 11560
240okselectWindow: test selectWindow in the presence of frames2 / 39862
241okselectWindow: Show how to select a popup window using the window index14 / 16620
242okselectWebClient: Show how to switch the web client26 / 263451
243oktest Load a page through proxy configured by standard <setproxy../> task3 / 31190
244okhttps: Call https with untrusted self signed certificate AND accept it2 / 213812
245okhttps: https: Call Https with client cert using new config options for client auth. and useInsecureSSL.2 / 21140
246okdeprecated: test for storing to a dynamic property using legacy step name2 / 220
247okdeprecated: test that the webtest step can be called with its legacy step name: testSpec2 / 2290
248okgroovy: test that the binding is reused among steps of a webtest3 / 3960
249okgroovy: test Groovy Code from file8 / 94931
250okgroovy: test Groovy step with inlined Script7 / 71420
251okgroovy: test Groovy Assertion Error1 / 2930
252okgroovy: test that properties are replaced in Groovy script when configured for it10 / 101410
253okscriptStep: test scriptStep with inlined groovy Script4 / 41000
254okscriptStep: test scriptStep with groovy assert failure2 / 31390
255okscriptStep: test scriptStep with inlined JavaScript script4 / 46611
256okscriptStep: test scriptStep with inlined JavaScript script10 / 101040
257okscriptStep: test fictitious order page with inlined JavaScript script5 / 63741
258okscriptStep: test fictitious order page with inlined Groovy script2 / 24641
259okscriptStep: test Groovy Code from file13 / 153331
260okscriptStep: test Groovy Scripting after load of XML file3 / 31760
261okscriptStep: test Groovy Scripting after load of gif2 / 2930
262okscriptStep: test scriptStep with groovy assert failure using macrodef3 / 51070
263oklinkReporting8 / 82000
264oksiteReporting17 / 231470
265okforceInputFieldAttribute: Show forceInputFieldAttribute fails if field doesn't exist3 / 4410
266okforceInputFieldAttribute: Show usage of forceInputFieldAttribute step for non-working javascript18 / 181670
267okshowI18n: Show internalization with WebTest6 / 6550
268xreporting: Links from failing steps (should fail!)7 / 8640
not Generates an error!
> verifyTitle
269x[should fail] verify that a webtest written in Groovy throws an exception when failing (1)1 / 2180
verifyTitle
270x[should fail] verify that a webtest written in Groovy throws an exception when failing (2)0 / 110
notExistingStep
271oktest as Groovy code: Show how to use closure for the Groovy step10 / 12560
272okExample of WebTest as GroovyTestCase3 / 3300
273oksampleUse as Groovy code: Show how to use Canoo WebTest plainly as unit test in Groovy13 / 131370

Created using Canoo Webtest (development). Report created at 19.07.2016 17:36WebTest is an Open Source project founded and hosted by Canoo