WebTest
WebTest Functional Selftests    Tests started at Mon Sep 05 12:11:15 CEST 2011

Result Summary

WebTests#%Graph
ok26497
x83
Sum 272 100 
Steps#%Graph
ok147799
x81
o00
Sum 1485 100 

Server Roundtrip Timing Profile

Secs#%Histogram
Sum 503 100 
Avg     348 ms
0 - 148196
1 - 3163
3 - 531
5 - 1020
10 - 3010
> 3000

Test Scenario Overview (00:02:54)

#ResultName# StepsTiming profileFailing step
Duration%Graph
1oktest request.csv report5 / 500:00:148
2okstoreProperty: test for the existence and/or value of a dynamic property7 / 101170
3x[Should fail] JavaScript error: JS error in setTimeout task make step fail1 / 218891
clickButton
4okJavaScript error: JS error in setTimeout but it is ignored2 / 24410
5okbrowser version: default is IE66 / 627262
6okbrowser version: configure FF36 / 64230
7okbrowser version: configure IE66 / 63890
8okbrowser version: configure IE76 / 64170
9okbrowser version: configure FF3.6 with custom User-Agent header6 / 63150
10oksampleUse: Show how to use Canoo WebTest plainly16 / 1613801
11okinvoke: normal invocation2 / 35180
12okinvoke: shows that invoke accepts a complete url ignoring config settings2 / 22960
13okinvoke: access protected resource4 / 54770
14okinvoke: shows REST-like web service request6 / 69101
15okinvoke: shows SOAP web service request4 / 42770
16okdescription: this webtest has a description attribute which value should appear in the report1 / 11260
17oktestInfo: simple usage scenario
someInfo displayed in overview as type='summary'
someOtherInfo displayed in overview as well
7 / 7770
18okverifyText: Show how to test against arbitrary text on the page4 / 6650
19okverifyText: Show how to use regular expressions on the whole page5 / 51250
20okverifyText: Try table locator8 / 93410
21okverifyElementText: Show how to find text within a specified html element12 / 171500
22oktableLocator: Locating cells in tables11 / 14740
23oktableLocator: test deprecated id attribute3 / 3910
24okverifyElement: Show how arbitrary html elements can be tested8 / 121860
25okverifyTitle: Show how title tag can be tested3 / 31190
26okverifyCheckbox: Check simple states4 / 61710
27okverifyCheckbox: Check checkboxes with non-unique name but different values6 / 72360
28okverifyCheckbox: Check checkboxes with non-unique name and identical values3 / 33190
29okverifyCheckbox: Check checkboxes with non-unique name and identical values3 / 33430
30okverifyXPath: test xpath usage11 / 145680
31okverifyXPath: test WebTest xpath functions8 / 83430
32okverifyXPath: test xpath usage3 / 3950
33okverifyLinks: linkcheck11 / 1300:00:074
34okverifyImages: image check4 / 57090
35okverifyImages: currentResponse unchanged4 / 42170
36okverifyProperty: test for the existence and/or value of a dynamic property12 / 14890
37okverifyProperty: test for the existence and/or value of an ant property5 / 7510
38okverifyProperty: test normal and late property expansion6 / 64880
39okverifyProperty: set up dynamic property for dynamic scope test1 / 1220
40okverifyProperty: test property in different webtest1 / 2230
41okverifyProperty: set up ant property for ant scope test1 / 140
42okverifyProperty: test property in different webtest1 / 140
43okverifyDialogs: test simple dialog coming from a function started by setTimeout6 / 634092
44okverifyDialogs: test simple dialog form validation example using legacy steps24 / 277220
45okverifyDialogs: test mock HardDiskErase but don't expect enough responses9 / 124880
46okverifyDialogs: test mock HardDiskErase but prepare too many responses8 / 95640
47okverifyDialogs: test mock HardDiskErase27 / 271980
48okverifyDialogs: test mock HardDiskErase but with incorrect dialog type15 / 182500
49okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using saveProperty7 / 81020
50okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes9 / 101020
51okverifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes8 / 926232
52okverifyLinkedContent: testVerifyLinkedContentWithError2 / 36560
53okverifyLinkedContent: testVerifyLinkedContentWithoutLink2 / 21850
54okverifyLinkedContent: testVerifyLinkedContentWithoutLink2 / 22920
55okverifyDocumentURL: Show how to test against arbitrary text in the document URL3 / 41290
56okverifyDocumentURL: Show how to use regular expressions on the document URL3 / 3870
57okverifyDocumentURL: Show that redirected pages work (via sendRedirect())2 / 21080
58okverifyDocumentURL: Show that redirected pages work (via Meta-equiv refresh)2 / 21690
59oksetCheckbox: Check setting simple states4 / 44550
60oksetCheckbox: Check setting multiple checkboxes6 / 64190
61oksetCheckbox: Check setting checkboxes with values11 / 145300
62oksetCheckbox: Check multivalue checkboxes (same name but different values).6 / 64620
63oksetCheckbox: Check multivalue checkboxes without specifying value works with first4 / 42710
64oksetCheckbox: Check preservation of already checked checkboxes6 / 62140
65oksetCheckbox: Reset a checked checkbox7 / 73170
66oksetCheckbox: Try to set or reset non existing checkbox6 / 10860
67oksetCheckbox: Try to use htmlId for heading2 / 31160
68oksetCheckbox: Tests related to checkbox with JavaScript21 / 2124011
69oksetCheckbox: Tests related to checkbox with JavaScript16 / 164280
70oksetSelectField: Show usage of setSelectField and test it22 / 286310
71oksetSelectField: Show usage of setSelectField with a combobox13 / 192230
72oksetSelectField: onchange loads an iframe4 / 42670
73oksetSelectField: Test various edge cases4 / 61220
74oksetFileField: Show usage of setFileField using 'name' and related attributes15 / 1613501
75oksetFileField: Show usage of setFileField using 'htmlId' attribute7 / 93200
76okautoSelectForm: check that JavaScript can submit upon select change4 / 41900
77okautoSelectForm: check again with custom config-based saveResponse name4 / 42500
78okautoSelectForm: check again with custom step-based saveResponse name4 / 41020
79oknewFormSteps: Tests the new form steps29 / 316990
80oknewFormSteps: Tests the new form steps with xpath19 / 1911041
81oknewFormSteps: Try to use htmlId for heading2 / 31650
82okradioButton: Try to use htmlId for heading2 / 32630
83okradioButton: Tests access with xpath to radio buttons10 / 114760
84okradioButton: Tests related to radio buttons with JavaScript20 / 2016501
85okradioButton: Tests related to radio buttons without JavaScript18 / 1822121
86okselectForm: Test selectForm usage and error cases22 / 244730
87okforceHiddenInputField: Show forceHiddenInputField fails if field doesn't exist2 / 3510
88okforceHiddenInputField: Show working javascript example that sets hidden field5 / 51550
89okforceHiddenInputField: Show usage of forceHiddenInputField step for non-working javascript9 / 92500
90okclickLink: Show how to click on hyperlinks in a page10 / 114450
91okclickLink: Clicklink with Target10 / 105210
92okclickButton: Locating submit buttons and submitting the respective forms52 / 5300:00:074
93okclickButton: ClickButton with javascript3 / 32040
94okclickButton: ClickButton with Target3 / 31920
95okclickButton: ClickButton with button element3 / 31400
96okclickButton: Clicks a button in a frame and checks that the frameset is always there10 / 109951
97okclickButton: check that we can locate button when form is left out (non-compliant)6 / 62780
98okclickButton: click button to form with JS error3 / 41530
99okclickButton: click button to form with JS error with ThrowExceptionOnScriptError set to false3 / 32630
100okclickElement: Click Table Cell20 / 2112441
101okclickElement: only 'visible' elements are clickable6 / 83220
102okmultiplePostsAndPreviousResponse: Show POST usage with multiple forms and back navigation33 / 3413481
103okfollowFrame: Show how to follow frames in a page15 / 165620
104okmouseOver & mouseOut11 / 112060
105okpdfPreviousResponse: Previous Response should work with trailing PDF steps7 / 700:00:074
106okpdfBookmarks: confirm existence of PDF bookmarks6 / 89811
107okpdfBookmarks: confirm verifyContent extracting bookmarks4 / 43990
108okpdfLinks: confirm existence of PDF links8 / 1200:00:127
109okpdfLinks: confirm verifyContent extracting links4 / 43400
110okpdfFonts: confirm existence of PDF fonts9 / 133170
111okpdfFonts: confirm verifyContent extracting font information4 / 42010
112okpdfText: confirm verifyContent extracting text10 / 107150
113okpdfPermissions: confirm PDF document permissions6 / 62000
114okexcel: sample usage16 / 1622981
115okexcel: find row7 / 73130
116okexcel: select sheet9 / 94820
117okexcel: store cell value7 / 72650
118okexcel: verify cell value18 / 185090
119okexcel: verify cell sum7 / 76380
120okexcel: verify cell format469 / 46932962
121okexcel: structure filter w/ compare to expected4 / 42430
122okexcel: structure filter w/ apply filters5 / 51790
123okexcel: test crystal excel file2 / 2490
124okautorefresh meta-equiv refresh with delay 0 failing when using default config2 / 214071
125okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=-12 / 2320
126okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=false2 / 2300
127okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=true2 / 228362
128okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=02 / 21430
129okautorefresh: meta-equiv refresh with delay 0 working using config autorefresh=52 / 2860
130okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=-12 / 2310
131okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=false2 / 2330
132okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=12 / 2290
133okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=true2 / 21770
134okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=22 / 2940
135okautorefresh: meta-equiv refresh with delay 2 working using config autorefresh=52 / 21020
136okredirect: test various server-side Redirect methods8 / 82890
137okconfiguration: test that wt.config.* properties are used1 / 110411
138okconfiguration: test timeout value3 / 400:00:074
139okconfiguration: Webtest sets version1 / 110
140xconfiguration: Expected to fail without breaking the build.0 / 1650
invoke invoking an unknown page will not work
141xconfiguration: Report an Error without stopping the build0 / 120
clickButton intentionally bad attributes
142xconfiguration: fail without breaking build and set property.1 / 31500
invoke invoking an unknown page will not work
143okconfiguration: check the failure property was set as expected.1 / 120
144xconfiguration: error without breaking build and set property.1 / 340
clickButton intentionally bad attributes
145okconfiguration: check the error property was set as expected.1 / 120
146okconfiguration: test storing properties with defaultPropertyType set to 'dynamic'3 / 3330
147okconfiguration: test storing properties with defaultPropertyType set to 'ant'3 / 3210
148okconfiguration: test storing properties with defaultPropertyType set to 'antstrict'3 / 380
149okconfiguration: Show warnings for invalid HTML1 / 11140
150okconfiguration: try bad option name1 / 1560
151okconfiguration: try bad option value1 / 1940
152okconfiguration: test default values for resultpath and resultfile1 / 11840
153okantWrapper: Test use of <antcall ...> to externalize steps for reuse17 / 357190
154okantWrapper: Test use of <ant file=...> to externalize steps for reuse9 / 96590
155okantWrapper: test antWrapper step22 / 221970
156okantWrapper: test antWrapper with antcall21 / 393860
157okantWrapper: test antWrapper with antcall for coverage7 / 161020
158okantWrapper: test antWrapper with macros19 / 191950
159okantWrapper: test use of macro with Webtest step in a repeat15 / 151070
160okwrappedSteps: Test AntWrapper4 / 42660
161okwrappedSteps: Test AntWrapper with macro6 / 82700
162okwrappedSteps: Test macro without AntWrapper5 / 72420
163okwrappedSteps: Test nested macros6 / 82200
164okcookie: Show usage of verifyCookie and test it5 / 614231
165okcookie: Show usage of verifyCookie and test it5 / 64050
166okcookie: Show usage of storeCookie and test it9 / 101200
167okcookie: visit count test example14 / 1415891
168okcookie: revisit count test example6 / 7640
169okcookie: revisit count test example with initial cookie value set4 / 41200
170okhttpHeader: default value for Accept-Language http header3 / 3810
171okhttpHeader: confirm custom setting of http headers3 / 3370
172okhttpHeader: test common user agent settings - default case (IE6)2 / 2630
173okhttpHeader: test common user agent settings - legacy Netscape2 / 2770
174okhttpHeader: test common user agent settings - recent Mozilla/Firefox2 / 2410
175okhttpHeader: confirm usage of storeHeader (re-load image test)29 / 293020
176okhttpResponseCode: confirm successful page3 / 3270
177okhttpResponseCode: confirm error page3 / 3690
178okstore: Show usage of storeRegEx and test it4 / 4940
179okstore: Show usage of storeXPath and test it13 / 1418711
180okstore: storeXPath without a document - let's you use XPath for manipulating values6 / 6260
181okstore: store to ant properties1 / 170
182okstore: verify properties stored previously2 / 2130
183okstoreLinkParameter: invalid usage of storeLinkParameter3 / 5990
184okstoreLinkParameter: Show usage of storeLinkParameter and test it5 / 51200
185okstoreElementAttribute: Click Table Cell with errors7 / 91130
186okstoreRandom: Show how to use storeRandom step126 / 14519491
187okstoreDigest: Show how to use storeDigest step7 / 74800
188okstoreDigest: storeDigest step with regex replacement12 / 1211291
189okstoreLength: Simple usage4 / 44750
190okstoreLength: Applied to content filtered with regex replace filter12 / 126720
191okstoreLength: Applied to content selected with table selector11 / 142080
192okstoreLength: Applied to content selected with XPath4 / 42890
193okstoreLength: Applied to content selected with htmlId4 / 42350
194okinputFieldAttribute: Show storeInputFieldAttribute fails if inputField doesn't exist2 / 3770
195okinputFieldAttribute: Show usage of storeInputFieldAttribute step using disabled attribute9 / 92880
196okinputFieldAttribute: Show usage of forceInputFieldAttribute step using disabled attribute18 / 196000
197okinputFieldAttribute: Show usage of storeInputFieldAttribute tests using checked attribute13 / 131910
198okinputFieldAttribute: test tricky form cases5 / 51200
199okverifyContent: Show simple usage of verifyContent step12 / 155300
200okverifyContent: verifyContent of xpath selection3 / 31400
201okverifyContent: verifyContent of htmlId selection3 / 3940
202okverifyContent: verifyContent with regex replace10 / 104600
203okverifyContent: check that it works correctly when more than one window is used (WT-293)10 / 103380
204okverifyContent: show usage of regexPerLine mode4 / 51380
205okapplyFilters: confirm applyFilters changes response8 / 81270
206okapplyFilters: confirm applyFilters changes response with default save set to off8 / 99521
207oknot: Show how NOT can be used to assert the absence of page properties16 / 284660
208okrepeat: test property extension (WT-239)20 / 208070
209okrepeat: Show usage of the repeat step26 / 2710461
210okrepeat: repeat step using ant for defaultPropertyType5 / 51160
211okrepeat: repeat step using antstrict for defaultPropertyType5 / 5890
212okrepeat: WT-153, repeat step with embedded group9 / 92610
213okrepeat: test repeat with XPath (WT-239)10 / 111940
214okgroup: Show how to use the group step14 / 17810
215okgroup: Check that description expands properly2 / 250
216oktimedGroup: Show how to use the timedGroup step19 / 233640
217okiframeTest5 / 52160
218okifstep: test and illustrate if step usage26 / 3911521
219okifstep: test and illustrate if step usage12 / 261670
220okifstep: test that when a macro used in condition fails, the test doesn't fail (WT-317)1 / 580
221okretry: illustrate RETRY of nested steps until they succeed10 / 1431682
222okretry: test RETRY nested steps fail scenarios7 / 1521861
223okretry: test property extension (WT-249)4 / 6710
224okproblemCases: Reset parameter cache bug5 / 52080
225okproblemCases: test for bad html - form in table not properly nested in td tags2 / 21890
226okjavascript: simple script using document.write()2 / 21040
227okjavascript: DOM manipulation script called by onLoad2 / 21060
228okjavascript: complex moveTo function call will fail if various JavaScript functionality is not supported2 / 21500
229okjavascript: script changes action attribute of form on button click6 / 62380
230okjavascript: test javascript containing an error fails (save case)1 / 2830
231okjavascript: test javascript containing an error fails (no save case)1 / 2310
232okjavascript: test config option to ignore javascript errors3 / 4520
233okjavascript: test javascript enabled (default)2 / 22060
234okjavascript: test javascript disabled using config setting3 / 4470
235okjavascript: test javascript disabled using enableJavaScript step7 / 8900
236okcloseWindow: show how closing the current window brings back to the previous one10 / 101900
237okselectWindow: Show how to select a popup window11 / 121480
238okselectWindow: Show how to select a popup window using the html document's title14 / 161210
239okselectWindow: Test whether a previous response restores a popup window10 / 112670
240okselectWindow: test selectWindow in the presence of frames2 / 316031
241okselectWindow: Show how to select a popup window using the window index14 / 162720
242okselectWebClient: Show how to switch the web client26 / 2626432
243oktest Load a page through proxy configured by standard <setproxy../> task3 / 31380
244okhttps: Call https with untrusted self signed certificate AND accept it2 / 244233
245okdeprecated: test for storing to a dynamic property using legacy step name2 / 230
246okdeprecated: test that the webtest step can be called with its legacy step name: testSpec2 / 2900
247okgroovy: test that the binding is reused among steps of a webtest3 / 35910
248okgroovy: test Groovy Code from file8 / 912341
249okgroovy: test Groovy step with inlined Script7 / 73490
250okgroovy: test Groovy Assertion Error1 / 21000
251okgroovy: test that properties are replaced in Groovy script when configured for it10 / 104570
252okscriptStep: test scriptStep with inlined groovy Script4 / 41680
253okscriptStep: test scriptStep with groovy assert failure2 / 34700
254okscriptStep: test scriptStep with inlined JavaScript script4 / 414591
255okscriptStep: test scriptStep with inlined JavaScript script10 / 102230
256okscriptStep: test fictitious order page with inlined JavaScript script5 / 611691
257okscriptStep: test fictitious order page with inlined Groovy script2 / 28440
258okscriptStep: test Groovy Code from file13 / 157350
259okscriptStep: test Groovy Scripting after load of XML file3 / 33530
260okscriptStep: test Groovy Scripting after load of gif2 / 22480
261okscriptStep: test scriptStep with groovy assert failure using macrodef3 / 52350
262oklinkReporting8 / 84320
263oksiteReporting17 / 234680
264okforceInputFieldAttribute: Show forceInputFieldAttribute fails if field doesn't exist3 / 41620
265okforceInputFieldAttribute: Show usage of forceInputFieldAttribute step for non-working javascript18 / 182860
266okshowI18n: Show internalization with WebTest6 / 6720
267xreporting: Links from failing steps (should fail!)7 / 83880
not Generates an error!
> verifyTitle
268x[should fail] verify that a webtest written in Groovy throws an exception when failing (1)1 / 2770
verifyTitle
269x[should fail] verify that a webtest written in Groovy throws an exception when failing (2)0 / 170
notExistingStep
270oktest as Groovy code: Show how to use closure for the Groovy step10 / 122150
271okExample of WebTest as GroovyTestCase3 / 31010
272oksampleUse as Groovy code: Show how to use Canoo WebTest plainly as unit test in Groovy13 / 134300

Created using Canoo Webtest (R_1812). Report created at 05.09.2011 12:15WebTest is an Open Source project founded and hosted by Canoo