automated testing in virtual labs

21

Upload: amittambe0005335

Post on 28-Apr-2015

21 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Automated Testing in Virtual Labs
Page 2: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

2

Virtual machines or Virtual PC’s are software like VMware that emulates real computers. By using virtual machines in your QA testing, you can emulate different computers with different OS’s on a single physical computer or create a whole virtual lab, with several differently configured virtual machines. These virtual com-puters work independently from each other and you can launch two or more virtual platforms simultaneously on one computer, saving the cost of having to purchase more hardware just to run your QA tests.

Page 3: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

3

Automated Testing with Virtual Machines ................................................. 4$Q�$IIRUGDEOH��6WDEOH��6\VWHP�&RQ¿JXUDWLRQ�IRU�4$�7HVWLQJ ............................ 59LUWXDO�7HVWLQJ�/DEV�RQ�D�6LQJOH�&RPSXWHU ....................................................... 56HFXUH�4$�7HVWLQJ�LQ�D�9LUWXDO�/DE�ZLWK�LWV�2ZQ�1HWZRUN ................................. 6/RFNLQJ�&RPSXWHUV�LQ�<RXU�9LUWXDO�/DE ............................................................. 6$XWRPDWLQJ�7HVWV�RQ�D�9LUWXDO�0DFKLQH ............................................................. 7

$XWRPDWLQJ�7HVWV�8VLQJ�7HVW&RPSOHWH ...................................................... 7$XWRPDWLQJ�7HVWV�8VLQJ�$XWRPDWHG�%XLOG�6WXGLR ....................................... 8

Running Automated Tests in Virtual Labs with TestComplete ........ 123UHSDULQJ�9LUWXDO�/DEV�IRU�$XWRPDWHG�7HVWLQJ ................................................. 12,QVWDOOLQJ�DQ�$XWRPDWHG�7HVWLQJ�7RRO ............................................................... 13&RQWUROOLQJ�$XWRPDWHG�7HVWV�LQ�9LUWXDO�/DEV ................................................... 13

9LUWXDO�PDFKLQHV�UHVLGLQJ�RQ�D�ORFDO�FRPSXWHU ........................................ 149LUWXDO�PDFKLQHV�UHVLGLQJ�RQ�D�UHPRWH�FRPSXWHU ..................................... 14

2UJDQL]LQJ�WKH�DSSOLFDWLRQ¶V�GLVWULEXWHG�WHVWLQJ ............................................... 15$XWRPDWHG�7HVWLQJ�LQ�D�9LUWXDO�/DE���6FKHPH ................................................. 16'HWHUPLQLQJ�WKH�7\SH�RI�9LUWXDO�0DFKLQH�LQ�$XWRPDWHG�7HVWV ......................... 17

Distributed Testing in Virtual Labs with TestComplete ...................... 18

Testing Web Applications in a Virtual Lab with TestComplete ........ 19

Virtual Machine Limitations .......................................................................... 20

Conclusion ............................................................................................................ 21

Table of Contents

Page 4: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

4

8VLQJ�YLUWXDO�PDFKLQHV�WR�FUHDWH�YLUWXDO�WHVWLQJ�ODEV�LV�D�FRPPRQ�VRIW�ZDUH�WHVWLQJ�SUDFWLFH��,W�DOORZV�4$�WHDPV�WR�VDYH�PRQH\�E\�UXQQLQJ�D�QXPEHU�RI�YLUWXDO�PDFKLQHV�RQ�IHZHU�FRPSXWHUV��RU�WR�WDNH�DGYDQWDJH�RI�UHVRXUFHV�DYDLODEOH�LQ�WKH�&ORXG��+RZHYHU��WKH�HI¿FLHQF\�RI�WHVWLQJ�LQ�YLUWXDO�ODEV�LQFUHDVHV�ZKHQ�\RX�DXWRPDWH�WKH�WHVWLQJ�SURFHVV�ZLWK�DQ�DXWRPDWHG�WHVWLQJ�WRRO�OLNH�7HVW&RPSOHWH�

7HVW&RPSOHWH�LV�D�FRPSUHKHQVLYH�DXWRPDWHG�WHVWLQJ�WRRO�ZLWK�H[WHQGHG�IHDWXUHV�IRU�WHVWLQJ�DSSOLFDWLRQV�UXQQLQJ�RQ�YLUWXDO�PDFKLQHV�DQG�LW�VXS�SRUWV�DQ\�NLQG�RI�4$�WHVWLQJ�PHWKRGRORJ\��XQLW�WHVWLQJ��UHJUHVVLRQ�WHVW�LQJ��*8,�WHVWLQJ��:HE�WHVWLQJ��GLVWULEXWHG�WHVWLQJ�DQG�PDQ\�RWKHUV�

$SSOLFDWLRQV�UXQQLQJ�RQ�D�YLUWXDO�PDFKLQH�EHKDYH�DV�LI�WKH\�ZHUH�UXQ�QLQJ�RQ�WKHLU�RZQ�SK\VLFDO�V\VWHP��7KLV�LV�YHU\�XVHIXO�IRU�WHVWLQJ�DSSOLFD�WLRQV�DQG�DOORZV�WHVWHUV�WR�WHVW�WKHLU�DSSOLFDWLRQ�XQGHU�YDULRXV�SODWIRUPV�XVLQJ�D�VLQJOH�FRPSXWHU��,W�FDQ�DOVR�EH�KHOSIXO�IRU�WHVWLQJ�ZHE�DSSOLFD�WLRQV�VLQFH�\RX�FDQ�VLPXOWDQHRXVO\�WHVW�\RXU�ZHE�DSSOLFDWLRQ�LQ�PXOWLSOH�EURZVHUV�UXQQLQJ�LQGHSHQGHQWO\�IURP�HDFK�RWKHU�XQGHU�GLIIHUHQW�YLUWXDO�PDFKLQHV��DJDLQ��ZLWKRXW�WKH�FRVW�RI�SXUFKDVLQJ�PRUH�KDUGZDUH�IRU�\RXU�WHVWLQJ�QHHGV�

7HVWLQJ�DSSOLFDWLRQV�RQ�YLUWXDO�PDFKLQHV�FDQ�KDYH�GLIIHUHQW�SXUSRVHV��<RX�FDQ�XVH�LW�IRU�GLVWULEXWHG�WHVWLQJ�RI�FOLHQW�VHUYHU�DSSOLFDWLRQV��IXQF�WLRQDO�WHVWLQJ�RU�LQ�UHJUHVVLRQ�WHVWLQJ��%XW��QR�PDWWHU�ZKLFK�NLQG�RI�4$�WHVWLQJ�\RX�XVH��LW�ZLOO�EH�PRUH�HIIHFWLYH�LI�DXWRPDWHG�DQG�DQ\�NLQG�RI�WHVWLQJ�LQ�YLUWXDO�ODEV�FDQ�EH�HDVLO\�DXWRPDWHG�ZLWK�7HVW&RPSOHWH�

7R�UXQ�\RXU�WHVWV�RQ�YLUWXDO�PDFKLQHV�XVLQJ�7HVW&RPSOHWH��\RX�FDQ�EX\�WKH�)ORDWLQJ�8VHU�OLFHQVH�RI�7HVW&RPSOHWH��DFWLYDWH�LW�RQ�D�SK\VL�FDO�PDFKLQH�DQG�WKHQ�LQVWDOO�7HVW&RPSOHWH�RQ�YLUWXDO�PDFKLQHV�RQ�\RXU�QHWZRUN�DQG�XVH�LW�WR�UXQ�WKH�WHVWV��)RU�PRUH�LQIRUPDWLRQ��VHH�8VLQJ�7HVW&RPSOHWH�RQ�9LUWXDO�0DFKLQHV�

%HVLGHV�YLUWXDO�PDFKLQHV��\RX�FDQ�DOVR�XVH�FORXG�FRPSXWHUV�IRU�DSSOLFD�

Automated Testing with Virtual Machines

Page 5: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

5

WLRQ�WHVWLQJ��)RU�PRUH�LQIRUPDWLRQ�RQ�UXQQLQJ�DXWRPDWHG�WHVWV�RQ�FORXG�FRPSXWHUV��VHH�&ORXG�7HVWLQJ�:LWK�7HVW&RPSOHWH�

An Affordable, Stable, System Configuration for QA Testing

$�FRPSXWHU�V\VWHP�LV�D�G\QDPLF�V\VWHP�DQG�RSHUDWLQJ�V\VWHP�FRQ¿JX�UDWLRQV�FRQWLQXRXVO\�FKDQJH��,QVWDOOLQJ�RU�XSGDWLQJ�VRIWZDUH�DQG�KDUG�ZDUH�GULYHUV�KDSSHQV�IUHTXHQWO\�DQG�LQVWDOOLQJ�GLIIHUHQW�YHUVLRQV�RI�DQ�DSSOLFDWLRQ�DIIHFWV�WKH�V\VWHP¶V�LQWHUQDO�VWUXFWXUH��WKH�UHJLVWU\�DQG�RWKHU�FUXFLDO�FRPSRQHQWV�WKDW�SHUVXDGH�WHVWLQJ�UHVXOWV��:KLOH�EX\LQJ�PXOWLSOH�FRPSXWHUV�WR�VXSSRUW�YDULRXV�SODWIRUPV�LV�DQ�RSWLRQ�IRU�VRPH��LW�LV�RIWHQ�WRR�H[SHQVLYH�IRU�PRVW�WHVWLQJ�ODEV�

6LQFH�FRPSXWHU�V\VWHPV�DUH�HYHU�FKDQJLQJ��LW�FDXVHV�D�SUREOHP�IRU�4$�WHVWLQJ��:H�FDQQRW�IXOO\�XQGHUVWDQG�WHVWLQJ�UHVXOWV�ZKHQ�WHVWLQJ�LV�SHUIRUPHG�RQ�GLIIHUHQW�FRQ¿JXUDWLRQV��,Q�RWKHU�ZRUGV��LI�RXU�DSSOLFDWLRQ�GRHV�QRW�ZRUN�SURSHUO\��LW�LV�PRUH�GLI¿FXOW�WR�GHWHUPLQH�WKH�UHDVRQ�LQ�D�FRQVWDQWO\�FKDQJLQJ�V\VWHP��$QRWKHU�SUREOHP�LV�WKDW�LW�LV�GLI¿FXOW�WR�WHVW�GLIIHUHQW�DSSOLFDWLRQ�EXLOGV�LQVWDOOHG�RQ�D�VLQJOH�RSHUDWLQJ�V\VWHP��,W�FDQ�FDXVH�FRQÀLFWV�DQG�PD\�HYHQ�SURYRNH�V\VWHP�FUDVKHV�

)RUWXQDWHO\��YLUWXDO�PDFKLQHV�DUH�D�ZRUNDURXQG�IRU�WKHVH�SUREOHPV�DQG�DUH�D�ORW�PRUH�FRVW�HIIHFWLYH��2QFH�\RX�KDYH�FUHDWHG�DQG�FRQ¿JXUHG�D�YLUWXDO�PDFKLQH�RU�D�IXOO�ODE�RI�YLUWXDO�PDFKLQHV��\RX�ZLOO�KDYH�D�VWDEOH�V\VWHP�FRQ¿JXUDWLRQ��ZKLFK�LV�YHU\�LPSRUWDQW�ZKHQ�WHVWLQJ�DSSOLFDWLRQV�

Benefits of Virtual Testing Labs on a Single Computer

9LUWXDO�PDFKLQHV�FDQ�ZRUN�LQGHSHQGHQWO\�IURP�HDFK�RWKHU�RQ�D�VLQJOH�SK\VLFDO�FRPSXWHU��FUHDWLQJ�D�YLUWXDO�WHVWLQJ�ODE�RQ�RQH�FRPSXWHU��7KLV�LV�D�KXJH�EHQH¿W�ZKLFK�LV�RIWHQ�XVHG�LQ�4$�WHVWLQJ�

)RU�H[DPSOH��\RX�FDQ�XVH�RQH�FRPSXWHU�WR�WHVW�\RXU�DSSOLFDWLRQ�XQGHU�:LQGRZV�;3��:LQGRZV�9LVWD�DQG�:LQGRZV����,Q�YLUWXDO�ODEV��WKHUH�LV�QR�QHHG�IRU�WKUHH�GLIIHUHQW�FRPSXWHUV�WR�H[HFXWH�WHVWV�VLPXOWDQHRXVO\��\RX�FDQ�MXVW�VHTXHQWLDOO\�H[HFXWH�WHVWV�RQ�D�VLQJOH�FRPSXWHU�ZLWK�WKUHH�GLIIHUHQW�YLUWXDO�FRQ¿JXUDWLRQV��+RZHYHU��\RX�PD\�QHHG�D�PRUH�SRZHUIXO�

Page 6: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

6

FRPSXWHU�WR�UXQ�VHYHUDO�YLUWXDO�PDFKLQHV�RQ�RQH�FRPSXWHU�DW�RQFH��EXW�WKLV�LV�RIWHQ�FKHDSHU�WKDQ�EX\LQJ�WKUHH�SK\VLFDO�FRPSXWHUV�

Create Complex Test Environments

6RPHWLPHV�WHVWLQJ�DSSOLFDWLRQV�LV�DQ�XQSUHGLFWDEOH�SURFHVV�±�D�WHVWHG�DSSOLFDWLRQ�PD\�KDQJ�WKH�RSHUDWLQJ�V\VWHP��SURYRNH�D�V\VWHP�FUDVK�DQG�HQGDQJHU�WKH�FRUSRUDWH�QHWZRUN¶V�VHFXULW\��7R�LVRODWH�\RXU�WHVWLQJ�ODE��\RX�FDQ�MRLQ�\RXU�YLUWXDO�ODEV�LQWR�D�VXEQHW�ZLWKLQ�\RXU�QHWZRUN�DQG�WKHQ�LVRODWH�LW�IURP�WKH�UHVW�RI�WKH�FRPSXWHUV�LQ�\RXU�FRPSDQ\��<RX�JHW�D�YLUWXDO�ODE�QHWZRUN�IXOO\�LVRODWHG�IURP�\RXU�FRPSDQ\¶V�FRPSXWHUV�WKDW�ZLOO�LQFUHDVH�WKH�VHFXULW\�OHYHO�RI�\RXU�WHVWLQJ�SURFHVV�

,VRODWLQJ�\RXU�YLUWXDO�ODE�RQ�LWV�RZQ�QHWZRUN�GRHV�QRW�GHWHUPLQH�WKH�W\SH�RI�VRIWZDUH�WHVWLQJ�\RX�SHUIRUP��\RX�FDQ�VWLOO�SHUIRUP�GLVWULEXWHG�WHVWLQJ��*8,�WHVWLQJ��ZHE�WHVWLQJ�DQG�DQ\�RWKHU�NLQG�RI�WHVWLQJ��<RX�FDQ�DOVR�UHPRWHO\�ODXQFK�DXWRPDWHG�WHVWV�RQ�YLUWXDO�PDFKLQHV�DQG�XVH�DQ\�DXWRPDWHG�WHVWLQJ�WHFKQLTXH�SURYLGHG�E\�7HVW&RPSOHWH�

Locking Computers in Your Virtual Lab

4$�WHVWLQJ�WHDPV�PD\�ZDQW�WR�H[HFXWH�WKHLU�DXWRPDWHG�VRIWZDUH�WHVWV�RQ�ORFNHG�FRPSXWHUV�ZKHQ�UXQQLQJ�WHVWV�RYHUQLJKW��6RIWZDUH�WHVWV�WKDW�GRQ¶W�LQWHUDFW�ZLWK�WKH�*8,�FDQ�EH�UXQ�RQ�ORFNHG�FRPSXWHUV��*8,�WHVWV�RU�IXQFWLRQDO�WHVWV�WKDW�VLPXODWH�XVHU�DFWLRQV�FDQQRW�EH�UXQ�RQ�ORFNHG�FRPSXWHUV��VLQFH�WKH�XVHU�VHVVLRQ�LV�IUR]HQ��QR�ZLQGRZV�FDQ�EH�VKRZQ��DQG�WKH�DXWRPDWHG�WHVWLQJ�WRRO�FDQQRW�VLPXODWH�XVHU�DFWLRQV�

9LUWXDO�PDFKLQH�VRIWZDUH�DOORZV�\RX�WR�UXQ�*8,�DQG�IXQFWLRQDO�WHVWV�RQ�ORFNHG�FRPSXWHUV�ZLWK�7HVW&RPSOHWH��7R�GR�WKLV�

¡ ,QVWDOO�7HVW&RPSOHWH�DQG�\RXU�DSSOLFDWLRQ�RQ�D�YLUWXDO�PDFKLQH��$OVR��FRS\�DOO�¿OHV�WKDW�\RXU�DSSOLFDWLRQ�DQG�7HVW&RPSOHWH�SURMHFW�PD\�UHTXLUH�IRU�WHVWLQJ�

¡ /RFN�WKH�YLUWXDO�PDFKLQH¶V�KRVW�FRPSXWHU�

¡ /RJ�RQWR�WKH�YLUWXDO�PDFKLQH�IURP�DQ\�RWKHU�FRPSXWHU�

Page 7: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

7

¡ 6WDUW�H[HFXWLQJ�WHVWV�

1RWH�WKDW�\RX�FDQ�HDVLO\�DXWRPDWH�WKLV�SURFHVV�XVLQJ�$XWRPDWHG�%XLOG�6WXGLR��)RU�PRUH�LQIRUPDWLRQ��VHH�WKH�$XWRPDWLQJ�7HVWV�8VLQJ�$XWRPDW�HG�%XLOG�6WXGLR�VHFWLRQ�EHORZ�

7HVW&RPSOHWH�ZLOO�UXQ�WHVWV�RQ�WKH�YLUWXDO�PDFKLQH�GHVSLWH�WKH�KRVW�EH�LQJ�ORFNHG��+RZHYHU��LI�\RX�GLVFRQQHFW�IURP�WKH�YLUWXDO�PDFKLQH�ZKLOH�UXQQLQJ�*8,�WHVWV��WKH�DXWRPDWHG�WHVWV�ZLOO�IDLO�

Automating Tests on a Virtual Machine

7KHUH�DUH�YDULRXV�DSSURDFKHV�WKDW�OHW�\RX�DXWRPDWH�WKH�WHVW�UXQV�RQ�WKH�YLUWXDO�PDFKLQHV��7KH�VHFWLRQV�EHORZ�GHVFULEH�WZR�RI�WKHP�

Manage Virtual Machines with Custom Scripts

8VXDOO\�YLUWXDO�PDFKLQH�VRIWZDUH�SURYLGHV�D�VSHFLDO�&20�$3,�WKDW�\RX�FDQ�XVH�WR�PDQDJH�YLUWXDO�FRPSXWHUV��,W�LV�HDV\�WR�ZRUN�ZLWK�&20�REMHFWV�IURP�7HVW&RPSOHWH��VR�\RX�FDQ�XVH�WKLV�&20�$3,�WR�DXWRPDWH�WHVWLQJ�RYHU�YLUWXDO�PDFKLQHV�GLUHFWO\�IURP�\RXU�YLUWXDO�WHVWLQJ�ODE�

7KH�IROORZLQJ�FRGH�VDPSOH��9%6FULSW��GHPRQVWUDWHV�KRZ�WR�DXWRPDWH�WKH�UXQQLQJ�DQG�VWRSSLQJ�RI�D�90ZDUH�YLUWXDO�PDFKLQH�GLUHFWO\�IURP�DQ�DXWRPDWHG�WHVW�VFULSW��:H�XVH�D��1(7�ZUDSSHU�IRU�9,;�&20�$3,�WR�SRZHU�RQ�DQG�WKHQ�WR�SRZHU�RII�D�YLUWXDO�3&��7KLV�VFULSW�URXWLQH�ZRUNV�ZLWK�WKH�90ZDUH�:RUNVWDWLRQ�LQVWDOOHG�RQ�WKH�FRPSXWHU�ZKHUH�WKH�URX�WLQH�LV�ODXQFKHG�

7KH�GRW1(7�REMHFW�LV�D�VSHFLDO�7HVW&RPSOHWH�REMHFW�WKDW�\RX�FDQ�XVH�WR�FDOO�URXWLQHV�DQG�PHWKRGV�WKDW�UHVLGH�LQ�DQ\��1(7�DVVHPEO\�IURP�\RXU�DXWRPDWHG�WHVWV�

Page 8: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

8

VBScript:

Manage Virtual Machines with Automated Build Studio

%HVLGHV�XVLQJ�&20�WR�DXWRPDWH�WHVWV�IURP�7HVW&RPSOHWH��\RX�FDQ�DOVR�XVH�$XWRPDWHG�%XLOG�6WXGLR�IRU�PDQDJLQJ�YLUWXDO�PDFKLQHV��8VLQJ�$XWR�PDWHG�%XLOG�6WXGLR�LV�WKH�HDVLHVW�ZD\�WR�DXWRPDWH�DFWLRQV�RYHU�YLUWXDO�SODWIRUPV��,W�FRQWDLQV�D�ORW�RI�KLJK�OHYHO�RSHUDWLRQV�LQWHQGHG�IRU�ZRUNLQJ�ZLWK�GLIIHUHQW�90�VRIWZDUH��$OVR��LW�LV�QRW�QHFHVVDU\�WR�ZULWH�VFULSWV�RU�SHUIRUP�RWKHU�VSHFL¿F�WDVNV��,Q�RWKHU�ZRUGV��FUHDWLQJ�D�VDPSOH�PDFUR�GRHV�QRW�UHTXLUH�D�XVHU�WR�KDYH�DQ\�SURJUDPPLQJ�EDFNJURXQG�

2QH�PRUH�DGYDQWDJH�LV�WKDW�$XWRPDWHG�%XLOG�6WXGLR�OHWV�\RX�FUHDWH�PDFURV�LQ�WKH�YLVXDO�HGLWRU�

)LJXUH����7KH�RSHUDWLRQV�RI�$XWRPDWHG�%XLOG�6WXGLR�

Page 9: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

9

$OVR��LW�LV�UHDOO\�HDV\�WR�VSHFLI\�RSHUDWLRQ�SDUDPHWHUV�DV�\RX�GR�WKLV�LQ�WXLWLYHO\�YLD�VSHFLDO�ZL]DUGV�DQG�GLDORJV��)RU�LQVWDQFH��WR�UHERRW�D�YLUWXDO�PDFKLQH�IURP�DQ�$XWRPDWHG�%XLOG�6WXGLR�PDFUR�\RX�FDQ�MXVW�DGG�WKH�DSSURSULDWH�RSHUDWLRQ�WR�WKH�PDFUR�DQG�VSHFLI\�DOO�WKH�UHTXLUHG�SDUDP�HWHUV�LQ�WKH�HQGXLQJ�GLDORJ��7KHQ��IRU�LQVWDQFH��\RX�FDQ�VFKHGXOH�WKH�PDFUR�H[HFXWLRQ�WR�UXQ�\RXU�YLUWXDO�PDFKLQH�DW�D�VSHFL¿F�WLPH�

6R��$XWRPDWHG�%XLOG�6WXGLR�PDFUR�FDQ�VWDUW�WKH�YLUWXDO�PDFKLQH��ODXQFK�7HVW&RPSOHWH�DQG�WKHQ�FORVH�WKH�PDFKLQH�ZKHQ�WKH�WHVW�UXQ�LV�RYHU��%HORZ��WKHUH�LV�D�VDPSOH�PDFUR�FUHDWHG�IRU�WKH�SXUSRVHV�GHVFULEHG�DERYH�

)LJXUH����7KH�VDPSOH�PDFUR�

7KLV�PDFUR�UXQV�WKH�QHHGHG�YLUWXDO�PDFKLQH�XVLQJ�WKH�Run Virtual Machine (Virtual PC) RSHUDWLRQ��ZDLWV�XQWLO�WKH�RSHUDWLQJ�V\VWHP�RI�WKH�PDFKLQH�LV�ORDGHG�FRPSOHWHO\�DQG�WKHQ�UXQV�7HVW&RPSOHWH�DV�D�SURFHVV�XVLQJ�WKH Run Process (WMI)�RSHUDWLRQ�

Page 10: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

10

,W�LV�HDVLHU�WR�SHUIRUP�VRPH�RI�WKH�WDVNV�PHQWLRQHG�DERYH�YLD�7HVW&RP�SOHWH�FRPPDQG�OLQH��)RU�H[DPSOH��WR�ODXQFK�7HVW&RPSOHWH�DQG�PDNH�LW�UXQ�WKH�GHVLUHG�WHVW�DXWRPDWLFDOO\��XVH�WKH�/project:project_name /test:test_name FRPPDQG�OLQH�DUJXPHQW��<RX�FDQ�DOVR�PDNH�7HVW&RP�SOHWH�WR�FORVH�ULJKW�DIWHU�WKH�WHVW�H[HFXWLRQ�LV�RYHU��)RU�WKLV�SXUSRVH��XVH�WKH /e�FRPPDQG�OLQH�NH\��)RU�PRUH�LQIRUPDWLRQ�RQ�UXQQLQJ�7HVW&RP�SOHWH�WHVWV�IURP�D�FRPPDQG�OLQH��VHH�7HVW&RPSOHWH�&RPPDQG�/LQH.

$IWHU�WKDW��$XWRPDWHG�%XLOG�6WXGLR�FKHFNV�ZKHWKHU�WKH�7HVW&RPSOHWH�LV�UXQQLQJ��<RX�FDQ�FKHFN�WKH�YDOXH�RI�WKH�YDULDEOH�WKDW�VWRUHV�WKH�UHVXOWV�RI�WKH�,I Process Is Running (WMI) RSHUDWLRQ�LQ�WKH�While Loop and VHW�D�GHOD\�HDFK�WLPH�ZKHQ�WKLV�YDOXH�HTXDOV�WR�7UXH�

:KHQ�7HVW&RPSOHWH�VWRSV�UXQQLQJ��$XWRPDWHG�%XLOG�6WXGLR�FORVHV�WKH�YLUWXDO�PDFKLQH�DQG�VWRSV�WKH�PDFUR�H[HFXWLRQ�

$XWRPDWHG�%XLOG�6WXGLR�DOVR�LQFOXGHV�VSHFLDO�7HVW&RPSOHWH�DQG�7HVW([HFXWH�RSHUDWLRQV�IRU�UXQQLQJ�DXWRPDWHG�WHVWV�ZLWK�7HVW&RPSOHWH�RU�7HVW([HFXWH�IURP�ZLWKLQ�\RXU�%XLOG�6WXGLR�PDFURV��7KH�RSHUDWLRQV¶�SURSHUWLHV�VSHFLI\�WKH�SURMHFW��WHVW�LWHP�RU�LQGLYLGXDO�VFULSW�URXWLQH�WR�EH�H[HFXWHG��7KH�RSHUDWLRQV�ZDLW�XQWLO�WKH�WHVWLQJ�LV�RYHU�DQG�WKHQ�VDYH�WHVW�UHVXOWV�WR�D�¿OH�RU�SRVW�WKHP�WR�WKH�PDFUR�ORJ�

)LJXUH����7HVW&RPSOHWH�2SHUDWLRQ�

Page 11: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

11

7KH�EHVW�SUDFWLFH�LV�WR�XVH�$XWRPDWHG�%XLOG�6WXGLR�DQG�7HVW&RPSOHWH�WRJHWKHU��7KLV�DOORZV�\RX�WR�DXWRPDWH�ERWK�YLUWXDO�PDFKLQHV�DQG�DXWR�PDWHG�WHVWV�LQ�D�YLUWXDO�ODE�HDVLO\�

2QFH�\RX�KDYH�FUHDWHG�DXWRPDWHG�WHVWV�ZLWK�7HVW&RPSOHWH��\RX�VKRXOG�FRQ¿JXUH�WKH�QHHGHG�YLUWXDO�PDFKLQHV�LQ�\RXU�YLUWXDO�ODE��7R�SUHSDUH�YLUWXDO�PDFKLQHV�IRU�WHVWLQJ��GHWHUPLQH�WKH�IROORZLQJ�UHTXLUHPHQWV�

¡ :KLFK�WHVWLQJ�SODWIRUPV�GR�\RX�QHHG"

¡ :KLFK�90�VRIWZDUH�VKRXOG�\RX�FKRRVH"

¡ :KLFK�DXWRPDWHG�WHVWLQJ�WRRO�GR�,�QHHG�WR�LQVWDOO�RQ�YLUWXDO�PDFKLQHV"

7KHVH�UHTXLUHPHQWV�DUH�LPSRUWDQW�IRU�VRIWZDUH�WHVWLQJ�DQG�\RX�DUH�IUHH�WR�FKRRVH�DQ\�SODWIRUP�DQG�XVH�7HVW&RPSOHWH�WR�WHVW�\RXU�DSSOLFDWLRQ��<RX�DOVR�QHHG�WR�GHWHUPLQH�KRZ�\RX�ZLOO�ZRUN�ZLWK�WKH�WHVWHG�SODWIRUPV�

¡ :LOO�YLUWXDO�PDFKLQHV�UXQ�RQ�D�VLQJOH�RU�RQ�VHYHUDO�FRPSXWHUV"

¡ :KLFK�XWLOLW\�VKRXOG�,�XVH�IRU�FRQWUROOLQJ�YLUWXDO�PDFKLQHV"

)RU�PRUH�LQIRUPDWLRQ�RQ�SUHSDULQJ�YLUWXDO�PDFKLQH�IRU�DXWRPDWHG�WHVW�LQJ��VHH�8VLQJ�7HVW&RPSOHWH�RQ�9LUWXDO�0DFKLQHV.

Preparing Virtual Labs for Automated Testing

$V�ZH�PHQWLRQHG�DERYH��\RX�DUH�IUHH�WR�FKRRVH�DOPRVW�DQ\�WHVWLQJ�SODW�IRUP�DQG�DQ\�90�VRIWZDUH�DYDLODEOH�RQ�WKH�PDUNHW�WR�XVH�LQ�\RXU�YLUWXDO�WHVWLQJ�ODEV�

$IWHU�\RX�KDYH�LQVWDOOHG�WKH�SDUWLFXODU�90�VRIWZDUH��\RX�FDQ�SUHSDUH�\RXU�YLUWXDO�PDFKLQHV�DFFRUGLQJ�WR�WKH�IROORZLQJ�VWHSV�

1. &UHDWH�D�QHZ�YLUWXDO�PDFKLQH��)RU�LQIRUPDWLRQ�RQ�KRZ�WR�GR�WKLV��VHH�WKH�90�VRIWZDUH�GRFXPHQWDWLRQ�

2. &RQ¿JXUH�WKH�YLUWXDO�KDUGZDUH�

What You Need to Know Before You Start Testing

Page 12: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

12

3. ,QVWDOO�WKH�QHHGHG�RSHUDWLQJ�V\VWHP�

4. ,QVWDOO�7HVW&RPSOHWH�RU�7HVW([HFXWH��VHH�,QVWDOOLQJ�$XWRPDWHG�7HVW�LQJ�7RRO�VHFWLRQ��

Installing an Automated Testing Tool

7KHUH�DUH�VHYHUDO�WRROV�WKDW�FDQ�EH�XVHG�WR�H[HFXWH�DXWRPDWHG�WHVWV�RQ�YLUWXDO�PDFKLQHV�LQ�\RXU�YLUWXDO�ODE��)RU�H[DPSOH��\RX�FDQ�LQVWDOO�7HVW�&RPSOHWH�RU�7HVW([HFXWH�RQ�WKH�YLUWXDO�SODWIRUPV�DQG�WKHQ�UXQ�WKH�WHVW�RQ�WKHVH�SODWIRUPV�XVLQJ�WKH�LQVWDOOHG�WRRO�

7R�UXQ�\RXU�WHVWV�RQ�YLUWXDO�PDFKLQHV�XVLQJ�7HVW&RPSOHWH��\RX�FDQ�EX\�WKH�)ORDWLQJ�8VHU�OLFHQVH�RI�7HVW&RPSOHWH��DFWLYDWH�LW�RQ�D�SK\VLFDO�PDFKLQH�DQG�WKHQ�LQVWDOO�7HVW&RPSOHWH�RQ�D�YLUWXDO�PDFKLQH�RQ�\RXU�QHW�ZRUN��<RX�FDQ�WKHQ�ODXQFK�7HVW&RPSOHWH�DQG�H[HFXWH�\RXU�DXWRPDWHG�WHVWV�LQ�\RXU�YLUWXDO�ODE��1RWH�WKDW�DOO�7HVW&RPSOHWH�SOXJ�LQV�UHTXLUHG�IRU�\RXU�WHVWV�WR�DOVR�EH�LQVWDOOHG�DQG�HQDEOHG�LQ�7HVW&RPSOHWH�LQ�RUGHU�IRU�\RX�WR�XVH�WKHP�LQ�\RXU�YLUWXDO�WHVWLQJ�ODE�

$V�DQ�DOWHUQDWLYH��\RX�FDQ�FUHDWH�DXWRPDWHG�WHVWV�ZLWK�7HVW&RPSOHWH�RQ�D�UHDO�FRPSXWHU�DQG�WKHQ�FRS\�WKHVH�WHVWV�WR�VHYHUDO�YLUWXDO�PDFKLQHV�LQ�\RXU�YLUWXDO�WHVWLQJ�ODE��7KHQ�\RX�FDQ�LQVWDOO�7HVW([HFXWH�ZLWK�DOO�UH�TXLUHG�SOXJ�LQV�DQG�UXQ�\RXU�DXWRPDWHG�WHVWV�LQ�\RXU�YLUWXDO�ODE��7HVW([�HFXWH�LV�D�UHVRXUFH�IULHQGO\�XWLOLW\�WKDW�H[HFXWHV�7HVW&RPSOHWH�WHVWV�DQG�ORJV�LWV�UHVXOWV�RQ�PDFKLQHV�WKDW�GR�QRW�KDYH�7HVW&RPSOHWH�

)RU�PRUH�LQIRUPDWLRQ�RQ�LQVWDOOLQJ�7HVW&RPSOHWH��UHIHU�WR�WKH�7HVW&RP�SOHWH���,QVWDOODWLRQ�*XLGH�GRFXPHQW�WKDW�LV�VXSSOLHG�DORQJ�ZLWK�7HVW&RP�SOHWH��,W�GHVFULEHV�KRZ�\RX�LQVWDOO��PRGLI\�DQG�XQLQVWDOO�7HVW&RPSOHWH�LQ�GHWDLOV�

)RU�PRUH�LQIRUPDWLRQ�RQ�LQVWDOOLQJ�DQG�DFWLYDWLQJ�7HVW&RPSOHWH�OLFHQVH�RQ�WKH�YLUWXDO�PDFKLQHV��VHH�8VLQJ�7HVW&RPSOHWH�RQ�9LUWXDO�0DFKLQHV.

Page 13: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

13

Controlling Automated Tests in Virtual Labs

7R�EH�DEOH�WR�ODXQFK�DXWRPDWHG�WHVWV�RQ�YLUWXDO�PDFKLQHV�LQ�\RXU�YLUWXDO�WHVWLQJ�ODE��WKH\�VKRXOG�EH�UXQQLQJ�DQG�\RX�VKRXOG�KDYH�FRQWURO�RYHU�WKHP��ZKHWKHU�GLUHFW�RU�UHPRWH�FRQWURO��7KHUH�DUH�WZR�SRVVLEOH�ZD\V�WR�ZRUN�ZLWK�YLUWXDO�PDFKLQHV�LQ�\RXU�ODE�

Virtual machines residing on a local computer

9LUWXDO�PDFKLQHV�FDQ�EH�LQVWDOOHG�DQG�UXQ�RQ�D�ORFDO�FRPSXWHU��ZKHUH�7HVW&RPSOHWH�RU�7HVW([HFXWH�LV�DOVR�LQVWDOOHG��<RX�FDQ�FRQWURO�GLIIHU�HQW�YLUWXDO�PDFKLQHV�MXVW�E\�VZLWFKLQJ�EHWZHHQ�WKH�ZLQGRZV�ZLWK�YLUWXDO�FRPSXWHU�GHVNWRSV�

:KHQ�UXQQLQJ�WKH�*8,�WHVWV�LQ�D�YLUWXDO�PDFKLQH�FRQVROH��GR�QRW�PLQL�PL]H�WKH�FRQVROH�ZLQGRZ��:KHQ�D�YLUWXDO�PDFKLQH�ZLQGRZ�LV�PLQLPL]HG��WKH�RSHUDWLQJ�V\VWHP�GRHV�QRW�GUDZ�WKH�*8,�VR�7HVW&RPSOHWH�FDQQRW�SHUIRUP�XVHU�DFWLRQV�RYHU�WKH�WHVWHG�DSSOLFDWLRQ�

$V�IRU�RWKHU�NLQGV�RI�WHVWV��OLNH�XQLW�WHVWV��\RX�FDQ�PLQLPL]H�WKH�YLUWXDO�PDFKLQH�FRQVROH��KRZHYHU��GR�QRW�VKXW�GRZQ�WKH�PDFKLQH�XQWLO�WKH�DXWRPDWHG�WHVWV�DUH�¿QLVKHG�

Virtual machines residing on a remote computer

<RX�FDQ�DFFHVV�UHPRWH�YLUWXDO�PDFKLQHV�YLD�D�VSHFLDO�XWLOLW\��IRU�LQ�VWDQFH��WKH�5HPRWH�'HVNWRS�&RQQHFWLRQ�WRRO�HPEHGGHG�LQ�:LQGRZV�;3�RU�WKLUG�SDUW\�XWLOLWLHV��91&��'DPH:DUH�DQG�RWKHUV��,Q�WKLV�FDVH�WKH�YLUWXDO�PDFKLQH�PXVW�EH�SUHOLPLQDU\�SUHSDUHG�IRU�FRQWUROOLQJ�LW�UHPRWHO\�DQG�H[HFXWLQJ�DXWRPDWHG�WHVWV�

7KH�5HPRWH�'HVNWRS�LV�D�EXLOW�LQ�:LQGRZV�IHDWXUH�WKDW�OHWV�\RX�DFFHVV�D�:LQGRZV�VHVVLRQ�UXQQLQJ�DW�RQH�FRPSXWHU�IURP�DQRWKHU�FRPSXWHU��,Q�RUGHU�WR�XVH�5HPRWH�'HVNWRS��WKH�ZRUNVWDWLRQ�WKDW�KDV�7HVW&RPSOHWH�RU�7HVW([HFXWH�PXVW�KDYH�VSHFLDO�VHUYHU�VLGH�VRIWZDUH��7KLV�VRIWZDUH�PD\�EH�LQFOXGHG�LQ�WKH�RSHUDWLQJ�V\VWHP��OLNH�LW�LV�LQFOXGHG�LQ�:LQGRZV�;3���RU�LW�FDQ�EH�D�WKLUG�SDUW\�VRIWZDUH�OLNH�91&��'DPH:DUH�RU�1HW2S�

Page 14: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

14

7KH�5HPRWH�'HVNWRS�IHDWXUH�OHWV�\RX�SHUIRUP�D�YDULHW\�RI�WDVNV��)RU�H[DPSOH��\RX�FDQ�XVH�WKH�5HPRWH�'HVNWRS�LI�\RX�QHHG�WR�

¡ 2EVHUYH�WKH�WHVWHG�DSSOLFDWLRQ¶V�EHKDYLRU�RQ�UHPRWH�FRPSXWHUV�

¡ 5XQ�WHVWV�RQ�UHPRWH�FRPSXWHUV�

¡ 5XQ�WHVWV�RQ�FRPSXWHUV�WKDW�DUH�ORFNHG�GXH�WR�VHFXULW\�SXUSRVHV��VHH�/RFNLQJ�&RPSXWHUV�LQ�<RXU�9LUWXDO�/DE��

¡ 9LHZ�DQG�DQDO\]H�WHVW�UHVXOWV�RQ�RQH�RU�VHYHUDO�UHPRWH�FRPSXWHUV��DQG�VDYH�WKHP�WR�D�ORFDO�FRPSXWHU�

To run automated tests with Remote Desktop, follow these steps:

¡ ,I�QHHGHG��ORFN�WKH�FRPSXWHU�ZKHUH�7HVW&RPSOHWH��7HVW([HFXWH��LV�LQVWDOOHG�

¡ /RJ�RQ�WR�WKH�7HVW&RPSOHWH��7HVW([HFXWH��ZRUNVWDWLRQ�YLD�WKH�5HPRWH�'HVNWRS�&RQQHFWLRQ�IURP�DQRWKHU�FRPSXWHU�

¡ 6WDUW�UXQQLQJ�WHVWV�ZLWK�7HVW&RPSOHWH��7HVW([HFXWH��

7HVW&RPSOHWH��7HVW([HFXWH��ZLOO�UXQ�WHVWV�LQ�WKH�5HPRWH�'HVNWRS�VHV�VLRQ��WKH�VDPH�ZD\�DV�LI�WKH\�ZHUH�UXQQLQJ�IURP�WKH�UHPRWH�FRPSXWHU�LWVHOI�

:KHQ�UXQQLQJ�*8,�WHVWV�YLD�WKH�5HPRWH�'HVNWRS��LW�LV�QRW�UHFRPPHQG�HG�WKDW�\RX�PLQLPL]H�WKH�5HPRWH�'HVNWRS�ZLQGRZ��ZKHQ�WKH�5HPRWH�'HVNWRS�ZLQGRZ�LV�PLQLPL]HG��WKH�RSHUDWLQJ�V\VWHP�GRHV�QRW�GUDZ�WKH�*8,�VR�7HVW&RPSOHWH�ZLOO�QRW�EH�DEOH�WR�³VHH´�WKH�WHVWHG�DSSOLFDWLRQ¶V�LQWHUIDFH�DQG�WKXV�ZLOO�IDLO�WR�LQWHUDFW�ZLWK�LW�

+RZHYHU��LW�PD\�LQFRQYHQLHQW�WR�DOZD\V�NHHS�WKH�5HPRWH�'HVNWRS�:LQGRZ�YLVLEOH�DV�LW�RFFXSLHV�VRPH�SDUW�RI�VFUHHQ��7R�VROYH�WKLV�SURE�OHP��\RX�FDQ�FKDQJH�WKH�5HJLVWU\�NH\�RQ�WKH�PDFKLQH�IURP�ZKLFK�\RX�DFFHVV�WKH�UHPRWH�ZRUNVWDWLRQ��)RU�PRUH�LQIRUPDWLRQ�RQ�WKLV�DSSURDFK��VHH�WKH�7HVW&RPSOHWH�7LS��5XQQLQJ�7HVWV�LQ�0LQLPL]HG�5HPRWH�'HVNWRS�:LQGRZV�EORJ.

Page 15: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

15

Organizing the application’s distributed testing

$OVR��7HVW&RPSOHWH�OHWV�\RX�WHVW�WKH�DSSOLFDWLRQ�WKDW�FDQ�ZRUN�ZLWK�VHYHUDO�FOLHQWV�VLPXOWDQHRXVO\��)RU�H[DPSOH��\RX�FDQ�XVH�WKLV�DSSURDFK�IRU�WHVWLQJ�ZHE�VLWHV��FOLHQW�VHUYHU�RU�RWKHU�DSSOLFDWLRQV��:H�FDOO�LW�GLVWULEXWHG�WHVWLQJ�DQG�XVLQJ�LW�\RX�FDQ�UXQ�GLIIHUHQW�SDUWV�RI�\RXU�WHVW�RQ�GLIIHUHQW�PDFKLQHV�FRQQHFWHG�ZLWK�HDFK�RWKHU�WKURXJK�WKH�QHWZRUN��2QH�PRUH�DGYDQWDJH�RI�WKLV�WHFKQLTXH�LV�WKDW�\RX�FDQ�HDVLO\�FRRUGLQDWH�DQG�V\QFKURQL]H�WKH�WHVW�SDUWV�UXQQLQJ�RQ�GLIIHUHQW�PDFKLQHV�

)RU�PRUH�LQIRUPDWLRQ�RQ�WKLV�WHVWLQJ�W\SH��VHH�WKH�'LVWULEXWHG�7HVWLQJ�:LWK�7HVW&RPSOHWH�DUWLFOH�

Automated Testing in a Virtual Lab - Scheme

1RZ�WKDW�WKH�YLUWXDO�PDFKLQH�FRQ¿JXUDWLRQV�DUH�UHDG\�LQ�\RXU�YLUWXDO�WHVWLQJ�ODE�DQG�\RX�NQRZ�KRZ�WR�FRQWURO�WKH�DXWRPDWHG�WHVW�H[HFXWLRQ��\RX�FDQ�VWDUW�VRIWZDUH�WHVWLQJ��7KH�IROORZLQJ�DXWRPDWHG�WHVWLQJ�VFKHPH�DOORZV�\RX�WR�WDNH�IXOO�DGYDQWDJH�RI�\RXU�4$�WHVWLQJ�LQ�D�YLUWXDO�ODE�

1. &UHDWH�D�FRS\�RI�WKH�YLUWXDO�PDFKLQHV�ZLWK�WKH�GHVLUHG�V\VWHP�FRQ�¿JXUDWLRQ��2QO\�WHVW�ZLWK�WKLV�FRS\�IURP�WKLV�SRLQW�IRUZDUG�

2. 5XQ�WKH�YLUWXDO�PDFKLQH�FRS\�PDQXDOO\�RU��IRU�H[DPSOH��XVH�WKH�Run Virtual Machine (Virtual PC)�RSHUDWLRQ�WR�DXWRPDWLFDOO\�GR�LW�IURP�$XWRPDWHG�%XLOG�6WXGLR�PDFUR�

3. ,QVWDOO�WKH�WHVWHG�DSSOLFDWLRQ�

4. &RS\�DOO�DXWRPDWHG�WHVWV�WR�WKH�YLUWXDO�PDFKLQH�LQ�\RXU�YLUWXDO�WHVW�LQJ�ODE�

5. 5XQ�DXWRPDWHG�WHVWV�XQGHU�WKH�YLUWXDO�PDFKLQH��$V�ZH�KDYH�PHQ�WLRQHG�HDUOLHU��\RX�FDQ�GR�LW�PDQXDOO\�RU�\RX�FDQ�HDVLO\�DXWRPDWH�LW�ZLWK�VSHFLDO�RSHUDWLRQV�LQ�\RXU�$XWRPDWHG�%XLOG�6WXGLR�PDFUR�

6. 7UDQVIHU�DOO�WHVW�UHVXOWV�WR�WKH�SK\VLFDO�FRPSXWHU��ZKHUH�WKH\�FDQ�EH�DQDO\]HG�

Page 16: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

16

7. 7XUQ�RII�WKH�YLUWXDO�PDFKLQH�FRS\��IRU�H[DPSOH��\RX�FDQ�GR�LW�XVLQJ�WKH�Close Virtual Machine (Virtual PC)�$XWRPDWHG�%XLOG�6WXGLR¶V�RSHUDWLRQ�

8. 'HOHWH�WKH�YLUWXDO�PDFKLQH�FRS\�

���3HUIRUP�VWHSV�����IRU�HDFK�DXWRPDWHG�WHVW�LQ�\RXU�YLUWXDO�ODE�

:LWK�WKLV�VFKHPH��\RX�FDQ�WHVW�GLIIHUHQW�DSSOLFDWLRQ�EXLOGV�RQ�GLIIHUHQW�RSHUDWLQJ�V\VWHPV�ZLWK�GLIIHUHQW�FRQ¿JXUDWLRQV�

Determining the Type of Virtual Machine in Automated Tests

7HVW&RPSOHWH�SURYLGHV�VSHFLDO�SURSHUWLHV�WKDW�GHWHUPLQH�ZKHWKHU�7HVW&RPSOHWH�LV�UXQQLQJ�XQGHU�D�YLUWXDO�PDFKLQH�RU�D�SK\VLFDO�FRPSXWHU��:LWK�7HVW&RPSOHWH��LI�WKH�6\V�2V,QIR�9LUWXDO3&�SURSHUW\�LV�7UXH��WKLV�LQGLFDWHV�WKDW�7HVW&RPSOHWH�LV�UXQQLQJ�XQGHU�D�9LUWXDO�3&�PDFKLQH��,I�WKH�6\V�2V,QIR�90:DUH�SURSHUW\�LV�7UXH��7HVW&RPSOHWH�LV�UXQQLQJ�XQGHU�D�90:DUH�PDFKLQH�

)LJXUH����'HWHUPLQLQJ�WKH�7\SH�RI�9LUWXDO�0DFKLQH�

Page 17: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

17

<RX�FDQ�DOVR�GHWHUPLQH�ZKHWKHU�7HVW&RPSOHWH�LV�UXQQLQJ�XQGHU�D�UHPRWH�VHVVLRQ�YLD�WKH�6\V�2V,QIR�5HPRWH6HVVLRQ�SURSHUW\��,I�WKLV�SURSHUW\�LV�7UXH��7HVW&RPSOHWH�LV�UXQQLQJ�XQGHU�D�UHPRWH�VHVVLRQ��IRU�LQVWDQFH��D�VHVVLRQ�ODXQFKHG�YLD�WKH�5HPRWH�'HVNWRS�XWLOLW\��8VLQJ�WKLV�SURSHUW\�\RX�FDQ�GHWHUPLQH��IRU�LQVWDQFH��ZKHWKHU�D�WHVWHU�ORJJHG�LQWR�D�YLUWXDO�ZRUNVWDWLRQ�YLD�D�UHPRWH�FRQWURO�XWLOLW\�DQG�H[HFXWH�DOO�WHVWV��H[FHSW�*8,�WHVWV��RQ�WKLV�YLUWXDO�PDFKLQH�

<RX�FDQ�XVH�DQ\�RI�WKH�SURSHUWLHV�PHQWLRQHG�DERYH�WR�SURYLGH�FRQGL�WLRQDO�WHVWLQJ�LQ�\RXU�DXWRPDWHG�WHVWV��)RU�H[DPSOH��\RX�FDQ�H[HFXWH�FHUWDLQ�DXWRPDWHG�WHVWV�RQ�VSHFL¿F�YLUWXDO�PDFKLQHV�DQG�RWKHU�DXWR�PDWHG�WHVWV�RQ�SK\VLFDO�PDFKLQHV��EDVHG�RQ�SDUWLFXODU�SURSHUW\�YDOXHV��$OVR��\RX�FDQ�H[HFXWH�RQO\�WKRVH�WHVWV�WKDW�GR�QRW�UHTXLUH�DQ�,QWHUQHW�FRQQHFWLRQ�RQ�YLUWXDO�PDFKLQHV��DQG�VR�RQ�

'LVWULEXWHG�WHVWLQJ�PHDQV�WKDW�D�WHVW�FRQVLVWV�RI�VHYHUDO�SDUWV�DQG�HDFK�SDUW�LV�SHUIRUPHG�RQ�D�VHSDUDWH�FRPSXWHU��7KLV�WHVWLQJ�LV�RIWHQ�SHU�IRUPHG�ZLWK�&OLHQW�6HUYHU�W\SH�DSSOLFDWLRQV��:LWK�D�YLUWXDO�ODE�RQ�RQH�FRPSXWHU��\RX�FDQ�SHUIRUP�GLVWULEXWHG�WHVWLQJ�RI�\RXU�&OLHQW�6HUYHU�DS�SOLFDWLRQV�ZLWKRXW�WKH�QHHG�IRU�PXOWLSOH�FRPSXWHUV�

:LWK�7HVW&RPSOHWH��\RX�FDQ�DXWRPDWH�WKH�ZKROH�GLVWULEXWHG�WHVWLQJ�SURFHVV��'LVWULEXWHG�WHVWV�FDQ�EH�RUJDQL]HG�DV�D�PDVWHU�DQG�VODYH�SURMHFWV�LQ�7HVW&RP�SOHWH��DQG�WKHQ�UXQ�LQ�D�YLUWXDO�ODE�

7KLV�LPDJH�GHPRQVWUDWHV�KRZ�WZR�SDUWV�RI�D�GLVWULEXWHG�WHVW�DUH�H[HFXWHG�RQ�D�VLQJOH�FRPSXWHU��7KH�PDVWHU�SURM�HFW�LV�UXQQLQJ�RQ�WKH�SK\VLFDO�FRPSXWHU�DQG�WKH�VODYH�SURMHFW�LV�UXQQLQJ�RQ�D�YLUWXDO�PDFKLQH�WKDW�UXQV�RQ�WKDW�VDPH�FRPSXWHU�

Distributed Testing in Virtual Labs with TestComplete

)LJXUH����'LVWULEXWHG�7HVWLQJ�LQ�9LUWXDO�/DEV�

Page 18: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

18

8VLQJ�YLUWXDO�PDFKLQHV�LV�EHFRPLQJ�D�JRRG�SUDFWLFH�IRU�WHVWLQJ�GLIIHUHQW�ZHE�DSSOLFDWLRQV��)RU�LQVWDQFH��\RX�FDQ�WHVW�ZHE�DSSOLFDWLRQV�VLPXOWD�QHRXVO\�UXQQLQJ�LQ�GLIIHUHQW�EURZVHUV�LQ�D�YLUWXDO�ODE��,Q�WKLV�FDVH�WKH�EURZVHUV�DUH�FRPSOHWHO\�LVRODWHG�IURP�HDFK�RWKHU�DQG�WKLV�WHVWLQJ�DS�SURDFK�JLYHV�WKH�PRVW�UHOLDEOH�UHVXOWV�

7KH�IROORZLQJ�LPDJH�GHPRQVWUDWHV�WZR�LQVWDQFHV�RI�D�ZHE�DSSOLFDWLRQ�UXQQLQJ�LQ�WZR�EURZVHUV�±�,QWHUQHW�([SORUHU�DQG�)LUHIR[��,QWHUQHW�([SORUHU�LV�ODXQFKHG�RQ�D�YLUWXDO�PDFKLQH�UXQQLQJ�:LQGRZV�9LVWD��)LUHIR[�±�RQ�D�UHDO�PDFKLQH�UXQQLQJ�:LQGRZV����6R��ZH�FDQ�SHUIRUP�DSSOLFDWLRQ�WHVWLQJ�RQ�PDFKLQHV�ZLWK�GLIIHUHQW�EURZVHUV�DQG�FRQ¿JXUD�WLRQV�VLPXOWDQHRXVO\�DQG�LQGHSHQGHQWO\�RI�HDFK�RWKHU�

)LJXUH����7HVWLQJ�:HE�$SSOLFDWLRQV�RQ�3K\VLFDO�DQG�9LUWXDO�0DFKLQHV

Testing Web Applications in a Virtual Lab with TestComplete

Page 19: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

19

7KHUH�DUH�VRPH�REYLRXV�EHQH¿WV�RI�WHVWLQJ�DSSOLFDWLRQV�XQGHU�YLUWXDO�SODWIRUPV��KRZHYHU��WKH\�KDYH�VRPH�OLPLWDWLRQV�WRR��7KH�YLUWXDO�RSHUDW�LQJ�V\VWHP�FDQ�ZRUN�VORZHU�WKDQ�D�UHDO�FRPSXWHU��EXW�WKLV�GHSHQGV�RQ�WKH�VLWXDWLRQ��WKH�YLUWXDOL]DWLRQ�WHFKQRORJ\��KDUGZDUH��WKH�QXPEHU�RI�VLPXOWDQHRXVO\�UXQQLQJ�YLUWXDO�SODWIRUPV�DQG�RWKHUV��%HVLGHV�WKH�VSHHG�OLPLWDWLRQV��VRPH�KDUGZDUH�IXQFWLRQDOLW\�FDQ�RQO\�EH�XVHG�E\�QDWLYH�RSHUDWLQJ�V\VWHPV�GLUHFWO\�ZRUNLQJ�RQ�D�SK\VLFDO�FRPSXWHU��6R��\RX�VKRXOG�WDNH�LQWR�DFFRXQW�WKHVH�YLUWXDO�SODWIRUP�OLPLWDWLRQV��HVSHFLDOO\�LI�\RX�DUH�WHVWLQJ�ZLWK�VSHFL¿F�KDUGZDUH�IHDWXUHV��PXOWLSURFHVVRU�V\VWHPV�DQG�RWKHU�LPSRUWDQW�IDFWRUV��2I�FRXUVH��WKHVH�OLPLWDWLRQV�GHSHQG�RQ�WKH�SDUWLFXODU�90�VRIWZDUH�DQG�KDUGZDUH�DQG�\RX�VKRXOG�FKHFN�WKHLU�GRFX�PHQWDWLRQ�¿UVW�EHIRUH�SHUIRUPLQJ�DXWRPDWHG�WHVWLQJ�

7KHUH�LV�D�ORW�RI�90�VRIWZDUH�DYDLODEOH�RQ�WKH�PDUNHW��7HVW&RPSOHWH�FDQ�ZRUN�ZLWK�DQ\�YLUWXDO�PDFKLQH�VRIWZDUH��LQFOXGLQJ�WKH�PRVW�SRSXODU�IRU�ZKLFK�$XWRPDWHG�%XLOG�6WXGLR�LQFOXGHV�D�VSHFLDO�VXSSRUW�

¡ 0LFURVRIW�9LUWXDO�3&������DQG�������0LFURVRIW�9LUWXDO�3& RSHUDWLRQV�FDWHJRU\�

¡ 0LFURVRIW�9LUWXDO�6HUYHU�������0LFURVRIW�9LUWXDO�6HUYHU�RSHUDWLRQV�FDWHJRU\�

¡ 90ZDUH�6HUYHU�����RU�ODWHU��90ZDUH�6HUYHU�RSHUDWLRQV�FDWHJRU\�

¡ 90ZDUH�:RUNVWDWLRQ�����RU�ODWHU��90ZDUH�:RUNVWDWLRQ�RSHUDWLRQV�FDWHJRU\�

1R�PDWWHU�ZKLFK�90�VRIWZDUH�\RX�XVH��\RX�FDQ�HDVLO\�DXWRPDWH�\RXU�4$�WHVWLQJ�LQ�D�YLUWXDO�ODE�ZLWK�7HVW&RPSOHWH�

Virtual Machine Limitations

Page 20: Automated Testing in Virtual Labs

TestCompleteby SMARTBEAR

20

$XWRPDWHG�WHVWLQJ�LQ�YLUWXDO�ODEV�DQG�ZRUNLQJ�ZLWK�YLUWXDO�PDFKLQHV�DO�ORZV�4$�WHVWHUV�WR�JHW�WKH�PD[LPXP�EHQH¿W�RXW�RI�WKHLU�WHVWLQJ�ZLWK�WKH�ORZHVW�RYHUKHDG�FRVW��7HVW&RPSOHWH¶V�DELOLW\�WR�ZRUN�ZLWK�ERWK�YLUWXDO�PDFKLQHV�DQG�UHDO�FRPSXWHUV�JLYHV�WHVWHUV�DQ�HGJH�DQG�FDQ�HYHQ�LQFUHDVH�\RXU�WHVWLQJ�FRYHUDJH�DQG�HI¿FLHQF\��7HVW&RPSOHWH�DOVR�KHOSV�\RX�DFKLHYH�\RXU�PD[LPXP�52,�ZKHQ�XVLQJ�DXWRPDWHG�WHVWLQJ�LQ�YLUWXDO�ODEV��,I�\RX�KDYHQ¶W�WULHG�7HVW&RPSOHWH��EH�VXUH�WR�GRZQORDG�DQG�WU\�LW�today.

,I�\RX�DUH�LQWHUHVWHG�LQ�DXWRPDWLQJ�WKH�HQWLUH�SURFHVV�RI�UXQQLQJ�WKH�WHVWV�RQ�YLUWXDO�PDFKLQHV��EH�VXUH�DOVR�WR�LQVWDOO�$XWRPDWHG�%XLOG�6WXGLR RQ�\RXU�ORFDO�PDFKLQH�

,I�\RX�ZDQW�WR�OHDUQ�KRZ�WR�XVH�FORXG�FRPSXWHUV�LQ�\RXU�WHVWLQJ��KRZ�WR�SUHSDUH�WKHP�DQG�DXWRPDWH�WKH�WHVWLQJ�SURFHVV��VHH�WKH�&ORXG�&RPSXW�HUV�:LWK�7HVW&RPSOHWH and &ORXG�7HVW�$XWRPDWLRQ�7XWRULDO�DUWLFOHV�RQ�RXU�ZHE�VLWH�

Conclusion

Page 21: Automated Testing in Virtual Labs

About SmartBear Software

0RUH�WKDQ�RQH�PLOOLRQ�GHYHORSHUV��WHVWHUV�DQG�RSHUDWLRQV�SURIHVVLRQ�DOV�XVH�6PDUW%HDU�WRROV�WR�HQVXUH�WKH�TXDOLW\�DQG�SHUIRUPDQFH�RI�WKHLU�$3,V��GHVNWRS��PRELOH��:HE�DQG�FORXG�EDVHG�DSSOLFDWLRQV��6PDUW%HDU�SURGXFWV�DUH�HDV\�WR�XVH�DQG�GHSOR\��DUH�DIIRUGDEOH�DQG�DYDLODEOH�IRU�WULDO�DW�WKH�ZHEVLWH��/HDUQ�PRUH�DERXW�6PDUW%HDU��WKH�FRPSDQ\¶V�DZDUG�ZLQQLQJ�WRROV�RU�MRLQ�WKH�DFWLYH�XVHU�FRPPXQLW\�DW�KWWS���ZZZ�VPDUWEHar.com, on )DFHERRN�RU�IROORZ�XV�RQ�7ZLWWHU�@smartbear and *RRJOH�.

SmartBear Software, Inc. 100 Cummings Center, Suite 234N Beverly, MA 01915+1 978.236.7900 www.smartbear.com ������E\�6PDUW%HDU�6RIWZDUH��,QF��6SHFL¿FDWLRQV�VXEMHFW�WR�FKDQJH�� ���������6%�7&��������:(%

Start Creating Automated Functional Tests for Web, Windows and Cloud Apps

Try TestComplete)UHH����'D\�7ULDl