solving mobile test automation challenges with testcomplete - nick olivo | falafelcon 2014

Solving  Mobile  Test  Automa3on  Challenges  with  TestComplete

Tradi3onal  Test  Automa3on

• Workflow  • Valida-on  • Record  &  Replay  •  Scrip-ng  

What  Challenges    Do  Mobile  Devices  

Present?

Challenges

•  Inputs  •  Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Inputs

Gestures

•  Swipes  •  Taps  • Pinches  • More  complex  ac-ons    

Approaches  I’ll  take

• Gesture  Recorder  

Orienta3ons

Approaches  I’ll  take

•  Set/GetOrienta-on  Commands  

Challenges

ü Inputs  •  Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Fragmenta3on

Fragmenta3on

Graphic  courtesy  of  PCMag  

½  of  1%  of  18,796  =    94  devices  

Different  Flavors  of  Android

Approaches  I’ll  Take

•  Standard  Eclipse  Emulator  

Challenges

ü Inputs  ü Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Interrupts

Interrupt  Tes3ng

•  Texts  • Calls  • No-fica-ons  

Approaches  I’ll  take

• Calls  &  Texts  =  Skype  • Wifi  =  use  Windows  as  Hotspot  •  System  Prompt  =  Low  BaXery  

Skype  Interrup3on  System  Prep

•  Skype4COM  •  2  Skype  accounts  

Wifi  Interrup3on  System  Prep

• Configure  Windows  as  a  hotspot  •  Toggle  it  on/off  as  part  of  test  • Requires  a  wired  and  a  wireless  internet  connec-on  

Low  BaLery  Interrup3on  System  Prep

• Use  an  emulator  •  Send  Android  Shell  Commands  •  Telnet  

Telnet  System  Prep

•  Installed  separately  • Using  DotNetTelnet  from  hXp://dotneXelnet.sourceforge.net/  

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Power  Consump3on

BaLery  Tes3ng

• Monitor  Power  Levels  • Adjust  Power  Levels  

Approaches  I’ll  Take

•  Special  TC  commands  to  get  power  level  

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Connec3vity

Connec3vity  Tes3ng

• Dropped  Cellular  • Dropped  Wifi  • Dropped  Bluetooth  

Approaches  I’ll  take

• Cellular  –  Airplane  Mode  • Wifi  &  Bluetooth  –  special  TC  commands  

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  ü Connec-vity  • Geoloca-on  Informa-on  

Geoloca3on  Data

Geoloca3on  Tes3ng

• GPS  Awareness  • GPS  Mocking  

TestComplete  Addresses

ü Tradi-onal  Workflows  ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  ü Connec-vity  ü Geoloca-on  Informa-on