The Reluctant Web Tester

1
The Reluctant Web Tester

• Joe McMahon
• March 16, 2006

2
ytester
3

nameseq.more_within_site namenum_min value2/ namequery valueperl/ formatyahoo_search_html_us classyahoo_search_html_us namequery valuequery/
nameaction my status1
my num_more0 my num_minCONTEXT-ge
tval(num_min) my query
CONTEXT-getval(query) my
webresults DOC-webresults
4

nameseq.more_within_site namenum_min value2/ namequery valueperl/ formatyahoo_search_html_us classyahoo_search_html_us namequery valuequery/
nameaction my status1
my num_more0 my num_minCONTEXT-ge
tval(num_min) my query
CONTEXT-getval(query) my
webresults DOC-webresults
5

nobody understands it
6

Non-US search
Not tested
Ad placement
Not tested

Safesearch
Not tested
Subscriptions
Not tested
New features
Not tested
7

replace it
8

but with what?
9

WWWMechanize
10

Perl-controlled browser
(almost)
11

testing?
12

mech-status()
mech-success()
mech-content()
13

WWWMechanizeCached
WWWMechanizedSleepy
14

mech1 new WWWMechanizeSleepy
mech2 new WWWMechanizedCached
mech1 not cached mech2 not sleepy
15

WWWMechanizePluggable
16

independent plugins
17

WWWMechanizePluginCache
WWWMechanizePluginYahooLogin
WWWMechanizePluginSnapshot
18

TestMore
19

ok boolean, comment is string1, string2,
comment like string, regex, comment
20

use TestMore tests2 use WWWMechanizePlugg
able my mech new WWWMechanizePluggable
mech-get(some_url) ok mech-success(), got
the URL like mech-content, qr/Yahoo/, brand
present
21

1..2 ok 1 - got page ok 2 - brand present
22

TestWWWSimple
23

use TestMore tests1 use TestWWWSimple pa
ge_like some_url, qr/Yahoo/, brand present
24

simple_scan
25

URL
regex
Y or N
comment
26

http//yahoo.com /Yahoo!/ Y brand present
27

use TestMore tests1 use TestWWWSimple me
ch-agent_alias(Windows IE 6) my
_at_accent page_like http//yahoo.com,
qr/Yahoo/, qq(brand
present http//yahoo.com /Yahoo! should
match)
28

nobody is too busy to write one line
29

release staging beta query flowers
hiking http//.search.yahoo.com/search?p
/Shortcut/ Y shortcut
30

1..4 ok 1 - shortcut http//beta/search?pflower
s/shortcut/ should match ok 2 - shortcut
http//beta/search?phiking/shortcut/ should
match not ok 3 - Fetch of http//staging/search?
pflowers failed 500 Cant connect to
staging.search.yahoo.com80 (Bad hostname
staging) not ok 4 - Fetch of http//staging/sear
ch?phiking failed 500 Cant connect to
staging.search.yahoo.com80 (Bad hostname
staging) Looks like you failed 2 tests of 4.
31

http//yahoo.com /UltraSearch/ SN proposed feature
http//yahoo.com /Answers/ TY upcoming feature
32

AppSimpleScan
33

Forget
Snapshot
Retry
Plaintext
Linkcheck
YahooLogin
34

simple_report
35

simple_scan tests.in simple_report
MyTest MyTest tests45, ok41, failed2,
skipped1, todo1
36

simple_scan -snap_dir /tmp/snaps
\ -snap_prefixhttp//myserver/snaps/ \ -snapshot
error tests.in simple_report -v MyTest MyTest
tests45, ok41, failed2, skipped1, todo1
(1 UNEXPECTEDLY SUCCEEDED) F 18 match check
url /regex/ - should match See snapshot
http//myserver/snaps/ F 32 no-match check
url /regex/ - shouldnt match See snapshot
http//myserver/snaps/ T 42 not ready url
/regex/ - shouldnt match See snapshot
http//myserver/snaps/
37

Where to put these?
38

TWiki
39

twiki_simple_scan
40

41

42

43

long-running tests
44
Spinoff script
parent
fork and wait
child
fork and exit
grandchild
run script
45

whats it doing?
46

-status
47

starting at processing yadda yadda 20
done 40 done 60 done 80 done 100
done yadda yadda tests5 failed0 . All
tests complete. ended at
48
Resources

• simple_scan
• cpan install BundleSimpleScan
• Me
• email mcmahon_at_yahoo-inc.com
• IM joemcmahon000 on AIM Yahoo!