WebTest Functional Selftests - Test Result Overview

Result Summary

WebTests	#	%	Graph
	274	97
	9	3
Sum	283	100
Steps	#	%	Graph
	1529	99
	9	1
	0	0
Sum	1538	100

Server Roundtrip Timing Profile

Secs	#	%	Histogram
Sum	521	100
Avg			258 ms
0 - 1	513	98
1 - 3	5	1
3 - 5	2	0
5 - 10	1	0
10 - 30	0	0
> 30	0	0

Test Scenario Overview (00:02:14)

#	Result	Name	# Steps	Timing profile			Failing step
#	Result	Name	# Steps	Duration	%	Graph	Failing step
1		storeProperty: test for the existence and/or value of a dynamic property	7 / 10	38	0
2		[Should fail] JavaScript error: JS error in setTimeout task make step fail	1 / 2	4081	3		clickButton
3		JavaScript error: JS error in setTimeout but it is ignored	2 / 2	170	0
4		browser version: default is IE6	6 / 6	2645	2
5		browser version: configure FF2	6 / 6	383	0
6		browser version: configure FF3	6 / 6	344	0
7		browser version: configure IE6	6 / 6	147	0
8		browser version: configure IE7	6 / 6	349	0
9		browser version: configure FF2 with custom User-Agent header	6 / 6	754	1
10		sampleUse: Show how to use Canoo WebTest plainly	16 / 16	924	1
11		invoke: normal invocation	2 / 3	268	0
12		invoke: shows that invoke accepts a complete url ignoring config settings	2 / 2	76	0
13		invoke: access protected resource	4 / 5	303	0
14		invoke: shows REST-like web service request	6 / 6	321	0
15		invoke: shows SOAP web service request	4 / 4	155	0
16		description: this webtest has a description attribute which value should appear in the report	1 / 1	112	0
17		testInfo: simple usage scenario someInfo displayed in overview as type='summary' someOtherInfo displayed in overview as well	7 / 7	82	0
18		verifyText: Show how to test against arbitrary text on the page	4 / 6	98	0
19		verifyText: Show how to use regular expressions on the whole page	5 / 5	79	0
20		verifyText: Try table locator	8 / 9	176	0
21		verifyElementText: Show how to find text within a specified html element	12 / 17	137	0
22		tableLocator: Locating cells in tables	11 / 14	460	0
23		tableLocator: test deprecated id attribute	3 / 3	87	0
24		verifyElement: Show how arbitrary html elements can be tested	8 / 12	69	0
25		verifyTitle: Show how title tag can be tested	3 / 3	129	0
26		verifyCheckbox: Check simple states	4 / 6	92	0
27		verifyCheckbox: Check checkboxes with non-unique name but different values	6 / 7	119	0
28		verifyCheckbox: Check checkboxes with non-unique name and identical values	3 / 3	74	0
29		verifyCheckbox: Check checkboxes with non-unique name and identical values	3 / 3	83	0
30		verifyXPath: test xpath usage	11 / 14	148	0
31		verifyXPath: test WebTest xpath functions	8 / 8	77	0
32		verifyXPath: test xpath usage	3 / 3	44	0
33		verifyLinks: linkcheck	11 / 13	3071	2
34		verifyImages: image check	4 / 5	228	0
35		verifyImages: currentResponse unchanged	4 / 4	124	0
36		verifyProperty: test for the existence and/or value of a dynamic property	12 / 14	124	0
37		verifyProperty: test for the existence and/or value of an ant property	5 / 7	20	0
38		verifyProperty: test normal and late property expansion	6 / 6	13	0
39		verifyProperty: set up dynamic property for dynamic scope test	1 / 1	1	0
40		verifyProperty: test property in different webtest	1 / 2	88	0
41		verifyProperty: set up ant property for ant scope test	1 / 1	2	0
42		verifyProperty: test property in different webtest	1 / 1	2	0
43		verifyDialogs: test simple dialog coming from a function started by setTimeout	6 / 6	3304	2
44		verifyDialogs: test simple dialog form validation example using legacy steps	24 / 27	273	0
45		verifyDialogs: test mock HardDiskErase but don't expect enough responses	9 / 12	125	0
46		verifyDialogs: test mock HardDiskErase but prepare too many responses	8 / 9	61	0
47		verifyDialogs: test mock HardDiskErase	27 / 27	175	0
48		verifyDialogs: test mock HardDiskErase but with incorrect dialog type	15 / 18	113	0
49		verifyDialogs: test mock HardDiskErase but with incorrect dialog text using saveProperty	7 / 8	55	0
50		verifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes	9 / 10	83	0
51		verifyDialogs: test mock HardDiskErase but with incorrect dialog text using inline attributes	8 / 9	1012	1
52		verifyLinkedContent: testVerifyLinkedContentWithError	2 / 3	265	0
53		verifyLinkedContent: testVerifyLinkedContentWithoutLink	2 / 2	34	0
54		verifyLinkedContent: testVerifyLinkedContentWithoutLink	2 / 2	173	0
55		verifyDocumentURL: Show how to test against arbitrary text in the document URL	3 / 4	41	0
56		verifyDocumentURL: Show how to use regular expressions on the document URL	3 / 3	38	0
57		verifyDocumentURL: Show that redirected pages work (via sendRedirect())	2 / 2	39	0
58		verifyDocumentURL: Show that redirected pages work (via Meta-equiv refresh)	2 / 2	79	0
59		setCheckbox: Check setting simple states	4 / 4	107	0
60		setCheckbox: Check setting multiple checkboxes	6 / 6	207	0
61		setCheckbox: Check setting checkboxes with values	11 / 14	289	0
62		setCheckbox: Check multivalue checkboxes (same name but different values).	6 / 6	110	0
63		setCheckbox: Check multivalue checkboxes without specifying value works with first	4 / 4	102	0
64		setCheckbox: Check preservation of already checked checkboxes	6 / 6	98	0
65		setCheckbox: Reset a checked checkbox	7 / 7	150	0
66		setCheckbox: Try to set or reset non existing checkbox	6 / 10	61	0
67		setCheckbox: Try to use htmlId for heading	2 / 3	76	0
68		setCheckbox: Tests related to checkbox with JavaScript	21 / 21	1962	1
69		setCheckbox: Tests related to checkbox with JavaScript	16 / 16	170	0
70		setSelectField: Show usage of setSelectField and test it	22 / 28	345	0
71		setSelectField: Show usage of setSelectField with a combobox	13 / 19	227	0
72		setSelectField: onchange loads an iframe	4 / 4	158	0
73		setSelectField: Test various edge cases	4 / 6	44	0
74		setFileField: Show usage of setFileField using 'name' and related attributes	21 / 22	1323	1
75		setFileField: Show usage of setFileField using 'htmlId' attribute	7 / 9	304	0
76		autoSelectForm: check that JavaScript can submit upon select change	4 / 4	242	0
77		autoSelectForm: check again with custom config-based saveResponse name	4 / 4	126	0
78		autoSelectForm: check again with custom step-based saveResponse name	4 / 4	176	0
79		newFormSteps: Tests the new form steps	29 / 31	377	0
80		newFormSteps: Tests the new form steps with xpath	19 / 19	374	0
81		newFormSteps: Try to use htmlId for heading	2 / 3	87	0
82		radioButton: Try to use htmlId for heading	2 / 3	591	0
83		radioButton: Tests access with xpath to radio buttons	10 / 11	120	0
84		radioButton: Tests related to radio buttons with JavaScript	20 / 20	370	0
85		radioButton: Tests related to radio buttons without JavaScript	18 / 18	156	0
86		selectForm: Test selectForm usage and error cases	22 / 24	132	0
87		forceHiddenInputField: Show forceHiddenInputField fails if field doesn't exist	2 / 3	80	0
88		forceHiddenInputField: Show working javascript example that sets hidden field	5 / 5	50	0
89		forceHiddenInputField: Show usage of forceHiddenInputField step for non-working javascript	9 / 9	182	0
90		clickLink: Show how to click on hyperlinks in a page	10 / 11	375	0
91		clickLink: Clicklink with Target	10 / 10	191	0
92		clickButton: Locating submit buttons and submitting the respective forms	52 / 53	2440	2
93		clickButton: ClickButton with javascript	3 / 3	74	0
94		clickButton: ClickButton with Target	3 / 3	80	0
95		clickButton: ClickButton with button element	3 / 3	74	0
96		clickButton: Clicks a button in a frame and checks that the frameset is always there	10 / 10	1511	1
97		clickButton: check that we can locate button when form is left out (non-compliant)	6 / 6	96	0
98		clickButton: click button to form with JS error	3 / 4	58	0
99		clickButton: click button to form with JS error with ThrowExceptionOnScriptError set to false	3 / 3	53	0
100		clickElement: Click Table Cell	20 / 21	224	0
101		clickElement: only 'visible' elements are clickable	6 / 8	124	0
102		multiplePostsAndPreviousResponse: Show POST usage with multiple forms and back navigation	33 / 34	610	0
103		followFrame: Show how to follow frames in a page	15 / 16	270	0
104		mouseOver & mouseOut	11 / 11	75	0
105		pdfPreviousResponse: Previous Response should work with trailing PDF steps	7 / 7	2604	2
106		pdfBookmarks: confirm existence of PDF bookmarks	6 / 8	297	0
107		pdfBookmarks: confirm verifyContent extracting bookmarks	4 / 4	179	0
108		pdfLinks: confirm existence of PDF links	8 / 12	1798	1
109		pdfLinks: confirm verifyContent extracting links	4 / 4	116	0
110		pdfFonts: confirm existence of PDF fonts	9 / 13	70	0
111		pdfFonts: confirm verifyContent extracting font information	4 / 4	96	0
112		pdfText: confirm verifyContent extracting text	10 / 10	247	0
113		pdfPermissions: confirm PDF document permissions	6 / 6	135	0
114		excel: sample usage	16 / 16	663	0
115		excel: find row	7 / 7	127	0
116		excel: select sheet	9 / 9	167	0
117		excel: store cell value	7 / 7	96	0
118		excel: verify cell value	18 / 18	144	0
119		excel: verify cell sum	7 / 7	59	0
120		excel: verify cell format	469 / 469	861	1
121		excel: structure filter w/ compare to expected	4 / 4	142	0
122		excel: structure filter w/ apply filters	5 / 5	100	0
123		excel: test crystal excel file	2 / 2	28	0
124		autorefresh meta-equiv refresh with delay 0 failing when using default config	2 / 2	794	1
125		autorefresh: meta-equiv refresh with delay 0 working using config autorefresh=-1	2 / 2	41	0
126		autorefresh: meta-equiv refresh with delay 0 working using config autorefresh=false	2 / 2	29	0
127		autorefresh: meta-equiv refresh with delay 0 working using config autorefresh=true	2 / 2	405	0
128		autorefresh: meta-equiv refresh with delay 0 working using config autorefresh=0	2 / 2	39	0
129		autorefresh: meta-equiv refresh with delay 0 working using config autorefresh=5	2 / 2	57	0
130		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=-1	2 / 2	92	0
131		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=false	2 / 2	27	0
132		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=1	2 / 2	21	0
133		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=true	2 / 2	65	0
134		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=2	2 / 2	102	0
135		autorefresh: meta-equiv refresh with delay 2 working using config autorefresh=5	2 / 2	49	0
136		redirect: test various server-side Redirect methods	8 / 8	149	0
137		configuration: test that wt.config.* properties are used	1 / 1	93	0
138		configuration: test timeout value	3 / 4	00:00:07	5
139		configuration: Webtest sets version	1 / 1	2	0
140		configuration: Expected to fail without breaking the build.	0 / 1	54	0		invoke invoking an unknown page will not work
141		configuration: Report an Error without stopping the build	0 / 1	1	0		clickButton intentionally bad attributes
142		configuration: fail without breaking build and set property.	1 / 3	32	0		invoke invoking an unknown page will not work
143		configuration: check the failure property was set as expected.	1 / 1	0	0
144		configuration: error without breaking build and set property.	1 / 3	4	0		clickButton intentionally bad attributes
145		configuration: check the error property was set as expected.	1 / 1	1	0
146		configuration: test storing properties with defaultPropertyType set to 'dynamic'	3 / 3	5	0
147		configuration: test storing properties with defaultPropertyType set to 'ant'	3 / 3	7	0
148		configuration: test storing properties with defaultPropertyType set to 'antstrict'	3 / 3	8	0
149		configuration: Show warnings for invalid HTML	1 / 1	40	0
150		configuration: try bad option name	1 / 1	22	0
151		configuration: try bad option value	1 / 1	13	0
152		configuration: test default values for resultpath and resultfile	1 / 1	29	0
153		antWrapper: Test use of <antcall ...> to externalize steps for reuse	17 / 35	231	0
154		antWrapper: Test use of <ant file=...> to externalize steps for reuse	9 / 9	216	0
155		antWrapper: test antWrapper step	22 / 22	109	0
156		antWrapper: test antWrapper with antcall	21 / 39	150	0
157		antWrapper: test antWrapper with antcall for coverage	7 / 16	71	0
158		antWrapper: test antWrapper with macros	19 / 19	38	0
159		antWrapper: test use of macro with Webtest step in a repeat	15 / 15	25	0
160		wrappedSteps: Test AntWrapper	4 / 4	83	0
161		wrappedSteps: Test AntWrapper with macro	6 / 8	80	0
162		wrappedSteps: Test macro without AntWrapper	5 / 7	109	0
163		wrappedSteps: Test nested macros	6 / 8	83	0
164		cookie: Show usage of verifyCookie and test it	5 / 6	668	0
165		cookie: Show usage of verifyCookie and test it	5 / 6	92	0
166		cookie: Show usage of storeCookie and test it	9 / 10	71	0
167		cookie: visit count test example	14 / 14	749	1
168		cookie: revisit count test example	6 / 7	37	0
169		cookie: revisit count test example with initial cookie value set	4 / 4	54	0
170		httpHeader: default value for Accept-Language http header	3 / 3	99	0
171		httpHeader: confirm custom setting of http headers	3 / 3	126	0
172		httpHeader: test common user agent settings - default case (IE6)	2 / 2	14	0
173		httpHeader: test common user agent settings - legacy Netscape	2 / 2	98	0
174		httpHeader: test common user agent settings - recent Mozilla/Firefox	2 / 2	135	0
175		httpHeader: confirm usage of storeHeader (re-load image test)	29 / 29	136	0
176		httpResponseCode: confirm successful page	3 / 3	23	0
177		httpResponseCode: confirm error page	3 / 3	591	0
178		store: Show usage of storeRegEx and test it	4 / 4	57	0
179		store: Show usage of storeXPath and test it	13 / 14	156	0
180		store: storeXPath without a document - let's you use XPath for manipulating values	6 / 6	17	0
181		store: store to ant properties	1 / 1	3	0
182		store: verify properties stored previously	2 / 2	5	0
183		storeLinkParameter: invalid usage of storeLinkParameter	3 / 5	74	0
184		storeLinkParameter: Show usage of storeLinkParameter and test it	5 / 5	30	0
185		storeElementAttribute: Click Table Cell with errors	7 / 9	78	0
186		storeRandom: Show how to use storeRandom step	126 / 145	1145	1
187		storeDigest: Show how to use storeDigest step	7 / 7	63	0
188		storeDigest: storeDigest step with regex replacement	12 / 12	188	0
189		storeLength: Simple usage	4 / 4	32	0
190		storeLength: Applied to content filtered with regex replace filter	12 / 12	100	0
191		storeLength: Applied to content selected with table selector	11 / 14	94	0
192		storeLength: Applied to content selected with XPath	4 / 4	59	0
193		storeLength: Applied to content selected with htmlId	4 / 4	101	0
194		inputFieldAttribute: Show storeInputFieldAttribute fails if inputField doesn't exist	2 / 3	38	0
195		inputFieldAttribute: Show usage of storeInputFieldAttribute step using disabled attribute	9 / 9	134	0
196		inputFieldAttribute: Show usage of forceInputFieldAttribute step using disabled attribute	18 / 19	368	0
197		inputFieldAttribute: Show usage of storeInputFieldAttribute tests using checked attribute	13 / 13	68	0
198		inputFieldAttribute: test tricky form cases	5 / 5	28	0
199		verifyContent: Show simple usage of verifyContent step	12 / 15	212	0
200		verifyContent: verifyContent of xpath selection	3 / 3	95	0
201		verifyContent: verifyContent of htmlId selection	3 / 3	46	0
202		verifyContent: verifyContent with regex replace	10 / 10	293	0
203		verifyContent: check that it works correctly when more than one window is used (WT-293)	10 / 10	157	0
204		verifyContent: show usage of regexPerLine mode	4 / 5	799	1
205		applyFilters: confirm applyFilters changes response	8 / 8	112	0
206		applyFilters: confirm applyFilters changes response with default save set to off	8 / 9	76	0
207		not: Show how NOT can be used to assert the absence of page properties	16 / 28	190	0
208		repeat: test property extension (WT-239)	20 / 20	637	0
209		repeat: Show usage of the repeat step	26 / 27	306	0
210		repeat: repeat step using ant for defaultPropertyType	5 / 5	30	0
211		repeat: repeat step using antstrict for defaultPropertyType	5 / 5	30	0
212		repeat: WT-153, repeat step with embedded group	9 / 9	255	0
213		repeat: test repeat with XPath (WT-239)	10 / 11	178	0
214		group: Show how to use the group step	14 / 17	73	0
215		group: Check that description expands properly	2 / 2	3	0
216		timedGroup: Show how to use the timedGroup step	19 / 23	205	0
217		iframeTest	5 / 5	250	0
218		ifstep: test and illustrate if step usage	26 / 39	592	0
219		ifstep: test and illustrate if step usage	12 / 26	123	0
220		ifstep: test that when a macro used in condition fails, the test doesn't fail (WT-317)	1 / 5	6	0
221		retry: illustrate RETRY of nested steps until they succeed	10 / 14	3133	2
222		retry: test RETRY nested steps fail scenarios	7 / 15	2105	2
223		retry: test property extension (WT-249)	4 / 6	31	0
224		problemCases: Reset parameter cache bug	5 / 5	120	0
225		problemCases: test for bad html - form in table not properly nested in td tags	2 / 2	47	0
226		javascript: simple script using document.write()	2 / 2	31	0
227		javascript: DOM manipulation script called by onLoad	2 / 2	47	0
228		javascript: complex moveTo function call will fail if various JavaScript functionality is not supported	2 / 2	37	0
229		javascript: script changes action attribute of form on button click	6 / 6	171	0
230		javascript: test javascript containing an error fails (save case)	1 / 2	43	0
231		javascript: test javascript containing an error fails (no save case)	1 / 2	24	0
232		javascript: test config option to ignore javascript errors	3 / 4	53	0
233		javascript: test javascript enabled (default)	2 / 2	31	0
234		javascript: test javascript disabled using config setting	3 / 4	30	0
235		javascript: test javascript disabled using enableJavaScript step	7 / 8	80	0
236		closeWindow: show how closing the current window brings back to the previous one	10 / 10	106	0
237		selectWindow: Show how to select a popup window	11 / 12	99	0
238		selectWindow: Show how to select a popup window using the html document's title	14 / 16	118	0
239		selectWindow: Test whether a previous response restores a popup window	10 / 11	779	1
240		selectWindow: test selectWindow in the presence of frames	2 / 3	226	0
241		selectWindow: Show how to select a popup window using the window index	14 / 16	110	0
242		selectWebClient: Show how to switch the web client	26 / 26	497	0
243		test Load a page through proxy configured by standard <setproxy../> task	3 / 3	103	0
244		appletRunner: Report an error when the scenario is missing	1 / 2	1119	1		appletRunner
245		appletRunner: start with complex location path	5 / 5	4280	3
246		appletRunner: start awt applet	5 / 6	4633	3
247		appletRunner: start swing applet	5 / 6	00:00:05	4
248		appletRunner: start swing object	8 / 10	2719	2
249		appletRunner: start scenario with wait	3 / 3	3007	2
250		appletRunner: start scenario with wait and target	3 / 3	3188	2
251		appletRunner: start applet with cookie (http)	6 / 10	3445	3
252		appletRunner: start applet with cookie (https)	6 / 10	00:00:05	4
253		appletRunner: start applet with parameter	11 / 15	00:00:20	15
254		https: Call https with untrusted self signed certificate AND accept it	2 / 2	256	0
255		https: https: Call Https using com.canoo.webtest.security.SunJsseClientAuthConnectionInitializer	2 / 2	37	0
256		deprecated: test for storing to a dynamic property using legacy step name	2 / 2	3	0
257		deprecated: test that the webtest step can be called with its legacy step name: testSpec	2 / 2	57	0
258		groovy: test that the binding is reused among steps of a webtest	3 / 3	218	0
259		groovy: test Groovy Code from file	8 / 9	709	1
260		groovy: test Groovy step with inlined Script	7 / 7	227	0
261		groovy: test Groovy Assertion Error	1 / 2	158	0
262		groovy: test that properties are replaced in Groovy script when configured for it	10 / 10	273	0
263		scriptStep: test scriptStep with inlined groovy Script	4 / 4	297	0
264		scriptStep: test scriptStep with groovy assert failure	2 / 3	250	0
265		scriptStep: test scriptStep with inlined JavaScript script	4 / 4	1003	1
266		scriptStep: test scriptStep with inlined JavaScript script	10 / 10	87	0
267		scriptStep: test fictitious order page with inlined JavaScript script	5 / 6	195	0
268		scriptStep: test fictitious order page with inlined Groovy script	2 / 2	579	0
269		scriptStep: test Groovy Code from file	13 / 15	452	0
270		scriptStep: test Groovy Scripting after load of XML file	3 / 3	185	0
271		scriptStep: test Groovy Scripting after load of gif	2 / 2	66	0
272		scriptStep: test scriptStep with groovy assert failure using macrodef	3 / 5	149	0
273		linkReporting	8 / 8	149	0
274		siteReporting	17 / 23	158	0
275		forceInputFieldAttribute: Show forceInputFieldAttribute fails if field doesn't exist	3 / 4	81	0
276		forceInputFieldAttribute: Show usage of forceInputFieldAttribute step for non-working javascript	18 / 18	121	0
277		showI18n: Show internalization with WebTest	6 / 6	48	0
278		reporting: Links from failing steps (should fail!)	7 / 8	111	0		not Generates an error! > verifyTitle
279		[should fail] verify that a webtest written in Groovy throws an exception when failing (1)	1 / 2	23	0		verifyTitle
280		[should fail] verify that a webtest written in Groovy throws an exception when failing (2)	0 / 1	1	0		notExistingStep
281		test as Groovy code: Show how to use closure for the Groovy step	10 / 12	76	0
282		Example of WebTest as GroovyTestCase	3 / 3	27	0
283		sampleUse as Groovy code: Show how to use Canoo WebTest plainly as unit test in Groovy	13 / 13	322	0

Created using Canoo Webtest (R_1803). Report created at 17.02.2010 09:57

is an Open Source project founded and hosted by