#ИМЯ?

1
Cross Platform UI testing using Sikuli

• -Amit Dixit
• -Dipesh Bhatewara

2
Objective

• Testing of mobile based application
• Current platform specific tools
• Challenges
• Generic Solution For All The Platforms

3
Mobile Platforms And Testing Tools

4
Android

• Android Instrumentation
• Instrumentation framework based on JUINT3
• Framework supports activities , toasts , context
  menus etc.
• Robotium
• Extends Android Instrumentation Framework
• Can develop powerful test cases 
• Can handle multiple activities 
• Blazing fast test execution
• Runs on a device
• Selenium droid
• Runs in android browser
• Use native touch events to emulate user
  interaction
• Paid Tool
• See Test

5
iOS

• UI Automation
• Tests in JavaScript
• Allows you to write test scripts to exercise your
  applications user interface elements
• Runs on a connected device / simulator
• FoneMoneky
• FoneMonkey is a functional testing tool for the
  iPhone providing for the interactive creation,
  editing and playback of automation scripts
• Easily incorporated into continuous integration
• Frank
• Provide support for automating functional testing
  of an iOS app.
• Integrate with BDD tools like cucumber
• Works on device and simulator

6
Challenges

• Generic Challenge
• Diversity of devices /platforms
• Application complexity
• Technical Challenge
• Large no of test cases
• Verification of UI

7
Solution

• Test Automation
• Generic Way for Test Automation on multiple
  platforms(Use tools like Sikuli). This will solve
  maintenance problem.
• Build Reliable and comprehensive test framework
• Benefits
• Cost Reduction
• Increased productivity
• Better application Quality

8
Nature of Mobile Applications
(xcode objective C)
Calculator(XCODE Objective C)
(webos JS/CSS)

• (java android SDK)

Application (Calculator)
Calculator (webos JS/CSS)
Calculator (java- android SDK)
9
Approach to solve the problem

• Image based test automation
• Automate user operations eg. Click, type,
  drag-drop, mouse actions etc.
• Visual verification of the expected output
• Not dependent on platform underneath
• Can be used to automate emulator as well as
  device.

10
Advantages of the approach

• Can accurately test GUI and rendering of
  applications.
• Write test outside the device
• Can be used to automate multiple devices without
  getting into details of each platform technology
• Can perform actions on Emulator (Virtual Boxes)
• Easy to automate.

11
Limitations of the approach

• Highly depends on the Resolution.
• Can not run in background.
• Dynamic paths are tricky to automate.

12
What is Sikuli?

• Visual technology to automate GUI using images.
• MIT research project. Open Source license.
• Sikuli IDE
• Sikuli Script API
• Automates anything on screen without internal
  API's support
• Works on Windows, Mac, Linux.

13
Sample Sikuli Script
14
DEMO
15
Solution proposed in demo to test Calculator

• Use Java for test Project, Use Junit
• Import Sikuli Script API
• Write single test which will use an interface for
  calculator operations
• Implement interface for Android and Iphone with
  different set of images required for automation
• Run same test by changing the configuration on
  multiple emulators/devices
• Can see the device on your machine using VNC and
  use that view to run your test on.

16
Q A