android app testing help manual

Upload: jaimin

Post on 01-Jun-2018

221 views

Category:

Documents


1 download

TRANSCRIPT

  • 8/9/2019 Android app testing Help Manual

    1/12

    Software Testing help manual for Android

    Created by: Jaimin Limbani

    Email [email protected]

    Modification date 12/19/2014

    Platform Android

    Options/Events Dos Dont s

    & screens App Fonts & Other

    Contents

    According to requirement , Fonts size and

    style both should be proper.

    Larger fonts should not increase numbe

    lines of label/texts or should not create

    issues with device width.

    Font family,size and style should beproper, and clearly readable on all

    resolution screens, available in market.

    Choosing a different font family, size, ostyle should not affect the appearance a

    usability of your application.

    According to design ,all the content

    should be managed properly

    There should not overlapping issues for

    small size devices

    Screen Orientation While changing orientation -> Design

    should be fit to changed environment

    If requirement is specified as landscape

    portrait then it should not change

    orientation

    According to requirement , it may be

    locked by code also

    -

    App should change orientation , if userrotate device

    -

    Screen Timeout According to requirement , Screen light

    may be dimmed or automatically turn off

    If requirement is to keep lights on -> ap

    should not allow to automatically turn o

    the light.

    Splash screen According to requirement , splash screen

    should display/run for given time and

    than next screen should appear in time.

    App should not take extra time to prese

    splash screen.

    - User tap on back button on splash screeApp should not restart or lag.

    - User tap on Home button on splash scre

    mailto:[email protected]:[email protected]
  • 8/9/2019 Android app testing Help Manual

    2/12

    App should not crash or restart.

    pp launch Launch Event Launch app and Go to HOME -> again

    launch app from Home screen -> It

    should resume app from where it was

    suspended.

    Launch an app -> Quickly tap on back bu

    within 1-2 second -> It should not resta

    app.

    According to requirement, applications

    may be designed to reset to the initial

    condition on relaunch.

    -

    er Sign Up

    Verification

    Sign up for app According to requirement , All fields

    should be present

    According to requirement, any field mu

    not miss from sign up screen.

    According to requirement , All mandatory

    field should be mentioned with different

    sign like *,# etc..

    Any unwanted blank/white space in fie

    should not create validation error.

    According to requirement, all check box

    and radio button should be there

    Validation from the server and local mo

    app must not different.

    According to requirement , Submit/OK ,

    Reset and cancel buttons should be

    there.

    Left all fields and click on Submit/OK bu

    -> it should not submit the form.

    User should be signed up successfully , if

    all the mandatory fields filled with

    correct information

    Left any of the mandatory field and tap

    Submit button -> Form should not subm

    According to requirement,all text field

    should bound with upper and lower

    boundary value .

    Quickly tapping on submit button mult

    time, should not keep sending same for

    Server.

    According to requirement, All the date

    pickers , check box and radio buttonshould be validated.

    -

    Email id field should be validated -

    After successful sign-up -> it should

    display message

    -

    Reset button should reset all the fields. -

    Cancel button should dismiss the

    registration process

    -

    Log-in Pages According to requirement , User-name

    may be designed uniquely i.e. If

    Requirement is to combination ofalphabetical and numeric character than

    it should be like abc123.

    User-name should not left blank

    User should be logged in if user-name

    and password are entered correctly.

    User-name should not start with or con

    any symbols

    Toast should be appear in android after

    successful login.

    User-name field should not accept more

    than maximum characters

    - User-name field should not accept less t

  • 8/9/2019 Android app testing Help Manual

    3/12

    minimum characters

    - Password field should not left blank

    - Password should not contain spaces an

    period.

    - Password field should not accept more

    maximum characters.- Password field should not accept less th

    minimum characters.

    - If password or user-name do not match

    above criteria than it should display me

    for all cases.

    Password Protected

    Apps -> Log-in

    User types correct password and it allow

    user use the app.

    User types incorrect password and it wo

    allow user use the app.

    User go to home and than go back to App

    from open apps in BG -> It should ask for

    password.

    If Password is not correct -> It should di

    message or toast.

    Forgot Password User types correct mail id and it matches

    in database -> It will send the request for

    new password.

    User types incorrect mail id or other det

    and it won't send request for new passw

    If it sends request for new password

    successfully -> It should display message

    .

    If email id is wrong -> it should display

    message or toast.

    Log-out User tap on Log-out button -> should be

    redirect to Log-in page

    If Connection is lost or Offline -> It shou

    not ask user for Internet connection for

    out process and redirect to log-in screen

    If connection is lost before user tap on

    log-out -> it should redirect user to Log-in

    page.

    -

    For password protected app -> when user

    move to home screen to some other app,

    user should be Logged out of the app.

    -

    avigation Navigation buttons The Up button should navigate within an

    app based on the hierarchical

    relationships between screens

    Name or icon of the Up button should n

    different than Up screen.

    System Back button is used to navigate,in reverse chronological order, through

    the history of screens the user has

    recently worked with.

    If a screen is the topmost one in an appshould not present an Up button.

    Back button should be used to remove

    floating views like dialog box and pop

    ups.

    When the previously viewed screen is a

    the hierarchical parent of the current sc

    pressing the Back button should not hav

    different result as pressing an Up butto

  • 8/9/2019 Android app testing Help Manual

    4/12

  • 8/9/2019 Android app testing Help Manual

    5/12

    tap-able enabled when User opens Navigation

    Drawer.

    Navigation Drawer should work smoothly

    for Expand and collapse view -> It can be

    used to reach more current place in app

    easily.

    If the user navigates away from a view w

    selected content, Selection should be

    removed all the content before navigat

    to the new view.

    - If user tap on any content outside the

    drawer to close it -> it should not allow

    tap on that particular content.

    op-downs,

    uttons and

    xt fields

    Radio button and

    Check-box

    For custom radio button and Check-box -

    > size should be big enough for tapping.

    Custom radio and check-box should not

    time in response.

    Custom check boxes -> Select All box

    should change the state to marked

    automatically , if all the options below

    are selected manually

    -

    Custom check boxes -> If all options areselected and user unchecked an option

    from list, Select All box should be turn to

    unchecked.

    -

    Drop-down menu According to requirement , default value

    should be selected.

    For medium and small size character len

    > any character should not be missed.

    According to requirement , values should

    be sorted properly.

    -

    For very long Character length ->

    maximum number of characters should

    be displayed.

    -

    According to requirement, Drop-down

    box should be bounded by size.

    -

    Picker Picker should provide time and date etc...

    in correct format.

    -

    According to requirement, there should

    be validation on picker for time , date

    etc..

    -

    Text Fields According to requirement , there may be

    validation for special characters or

    numbers or alphabets etc..on text fields.

    Text fields should not accept invalid inp

    According to requirement , size may be

    limited for text fields.

    -

    According to requirement, there may be

    restriction for copy/paste on it.

    -

  • 8/9/2019 Android app testing Help Manual

    6/12

    ploads and

    ownloads

    Upload Images It should upload image to server

    successfully.

    It should not upload other extension file

    like .pdf, .txt etc.. apart from Image files

    It should display thumb image without

    stretching

    According to requirement, image size sh

    not greater than maximum size.

    According to requirement, There may be

    option to remove images from thumb.

    -

    Uploaded image path should be proper

    or valid.

    -

    Image change functionality should work

    based on requirement.

    -

    Image upload progress bar should

    display.

    -

    Download in app App should handle the pause , resume

    and stopping of resource file download

    to phone.

    In case of , Network lost or switching

    network while downloading content in

    >It should not ask user to download aga

    should not create any other error.

    aring Mail Attachments According to requirement , mail id might

    be auto attached to Mail id field.

    After sending mail , it should not stay in

    same screen.

    For Mail functionality , App should

    redirect user to list of all Mail sender app

    or defined Mail sender app.

    All files/texts that user trying to send

    through mail , should not go missing on

    email app screen.

    After sending mail , it should display

    message whether it is successful or not.

    It should not allow to send file greater t

    25 MB, or display proper message for it

    e Export Export as excel File extension of the exported file shouldbe proper.

    It should not stop exporting if file size islarge.

    File name for the exported Excel file

    should be as per the standards, like File

    contain Time-stamp or Date-stamp etc.

    Than name should replace by actual

    Date-stamp or Time-stamp

    Special characters and signs etc.. should

    be missed in exported files.

    File should have proper column name. For numeric value, Formatting should n

    change.

    Excel file data should be formatted

    properly with header and footer text,

    date, page numbers etc. values for allpages.

    Sorting value should not change in expo

    files.

    aps Maps Map should be load completely on app

    screen.

    Pin size and color should not be differen

    than requirement.

    According to requirement, pin should be

    drop at exact location

    -

    According to requirement, there may be -

  • 8/9/2019 Android app testing Help Manual

    7/12

    Zoom in button, Zoom out button and

    scroll bar, and all three should function

    properly.

    otifications

    nd

    essages

    Notification According to requirement, it may work in

    BG also when user is playing game or

    watching videos etc...

    It should not stop working when app is

    closed.

    It should work in multiple time zone also. App should not display same notificatio

    again and again.

    It should be tap-able or open new

    activity.

    If app is open and notification appear o

    app screen then it should not appear ag

    as notification.

    If there are more number of message or

    texts sent then it should display latest

    message(s) on the notification.

    -

    If app is open and notification comes -> it

    should display in app screen.

    -

    Acknowledging App should display acknowledge text to

    let the user know that the action they

    just invoked has been completed.

    -

    According to requirement , It can be

    present with Undo option also.

    -

    Confirming

    message & other

    messages and

    labels

    App should ask the user to verify that

    they truly want to proceed with an action

    they just invoked.

    Some action should not taken without

    warning or messages like Delete,Exit et

    It should display with warning ormessage. There should be no grammatical or spelmistakes in Splash / Title / Logo / Loadi

    Screen,About screen,Help/Instructions

    Screen,Main Menu and all its subsidiary

    menus and other labels...etc

    - Button name should not mismatch with

    event of the button.

    pp setting

    nd

    anagement

    Manage Lengthy

    Operations

    According to requirement , any web

    related operation that is taking more

    than expected time should ask user with

    proper message and 'Cancel' option.

    For web related operation, if app is kee

    loading for long time then operation sh

    be aborted with proper message.

    App Setting If app is launched with known setting ->

    user changed setting in App menu like

    volume,orientation or language etc... ->

    when user Exit or Minimize app , it

    should restore previous setting.

    According to requirement, Setting may

    may not change when user restart the a

    It should save all the setting on Exit of -

  • 8/9/2019 Android app testing Help Manual

    8/12

    app.

    Memory-File

    System

    management

    App should handle any type of memory

    exception properly.

    While app is writing data to file system

    app closed, it should not crash and any

    should not lost.

    It should display warning when app istrying to store data in file-system and

    memory space is not sufficient for it.

    -

    essage

    change

    Send or receive

    messages in app

    Message should be in proper format

    while sending or after receiving it.

    After sending message -> It should not t

    more time than expected time.

    On message receive, it should notify user

    or it should launch app with sound.

    Any content should not be missing whe

    reaches to receiver side.

    nguage Languages According to requirement , App should

    have all required languages.

    It should not change last selected langu

    again if user Exit app and again opens it

    If language in application set as auto-detected -> App should set language

    according to phone's language

    When user change language -> It shouldrestart app in Android.

    When user change language manually in

    app -> App should change it quickly , with

    no time delay.

    -

    atabase Database Correct data must get saved in database

    upon successful page submit.

    Null value should not submit in column

    which doesn't allow it.

    Data should be stored in either single or

    multiple column based on design.

    Data must not committed to database

    before the operation completed.

    Table should have primary key column. Null values should not be allowed forPrimary key column.

    Add/Update operation log should be

    added.

    Input data must not truncated while sav

    Valid database name should be assigned

    to it.

    -

    All the table constraint like primary key,

    foreign key etc.. are implemented

    correctly.

    -

    Radio button and drop-down list options

    are saved correctly in database.

    -

    Data should be rolled back in case offailed transactions.

    -

    ecurity Security All credentials should be transferred

    after encryption.

    Error messages should not reveal any

    sensitive information.

    Log-out functionality should function

    properly.

    Page crash should not reveal applicatio

    server info.

  • 8/9/2019 Android app testing Help Manual

    9/12

    File upload functionality should use file

    type restrictions.

    Sensitive fields like passwords and cred

    card information should not have auto

    complete enabled.

    Password and other sensitive fields

    should be masked while typing.

    -

    App password should be combination ofthe alphabets, number and special

    characters

    -

    pgrade Upgrade an app While upgrading an app, data and setting

    of old app should be preserved.

    After upgrading an app, any type of dat

    should not be missed.

    App should upgrade path from all

    previous version.

    After upgrading an app, user setting sho

    not removed/reset.

    According to requirement , push

    notification may display on notification

    bar.

    After upgrading an app,Credential shou

    not be removed.

    uch

    reens

    Single Tap on

    screen

    It should trigger the default functionality. Tap on a object and swipe finger out of

    should not trigger any functionality.

    - Tap on a object and finger swiped from

    object to another object, it should not

    trigger the functionality of second objec

    Long Press/tap Android smart phones, pressing and

    holding an item will bring up a context

    menu in the middle of the screen.

    It should not trigger the default functio

    like Single tap.

    Enter the selection mode to select

    different items/texts.

    -

    Swipe or Drag Scrolls overflowing content, or navigates

    between views in the same hierarchy.

    It should not open context menu in the

    middle of the screen.

    Swipes can be quick and should affect

    even after the finger is picked up.

    Swiping left/right should not be difficul

    open the other options.(swiping time)

    Swipe left typically used for the user to

    jump back and forth between the list and

    the detail view in Android.

    -

    Swipe left and right -> can be used to

    change the tabs.

    -

    Multiple Tap on

    Icons/Buttons

    Tap with two finger on screen at two

    different location -> it should trigger the

    functionality of firstly tapped

    icon/button.

    Tap and hold on a object and tap on ano

    icon/button with another finger -> it sh

    not trigger the event of second icon/bu

    - Tap with two finger on screen at two

    different location -> it should trigger the

    functionality of firstly tapped icon/butt

  • 8/9/2019 Android app testing Help Manual

    10/12

    and should not open both one after ano

    Double Tap For nested views, scales up the smallest

    target-able view, or returns it to its

    original scale.

    -

    Pinch Zoom In/Out Two or more finger to zoom In/Out

    contents

    It should not work as Swipe

    etwork Networking Only in Wi-Fi network it should work

    fine.

    Switching between network should not

    cause app crash.

    Should work in only 3G connection If Sim-Card is removed, app should not

    working.

    Should work in only 2G connection -

    In Airplane mode (or all connections

    disabled)

    -

    It should work fine using the network

    through a USB connection to a PC

    -

    It should work fine in case of user moves

    to Out of network.

    -

    Should Work fine in device with no SIM

    card.

    -

    It should work fine if user walk out of Wi-

    Fi range so the connection automatically

    switches to 3G/2G (for example, in a

    large building like a hospital or airport, or

    outdoor

    -

    It should display message ,if connection

    is lost.

    -

    The Application will work until time out

    and then give an error message to the

    user indicating there was an error with

    the connection

    -

    ther Hard

    ares

    SD card interaction If your application can potentially store

    or retrieve items on the device's SD card,

    then it is important to test the

    application!s behavior when there is an

    SD card present or not.

    Remove the SD card in mid operation sh

    not affect the app.

    If SD card is required for app , Message

    should be displayed if SD card is not

    available

    -

  • 8/9/2019 Android app testing Help Manual

    11/12

    Sensors Gyroscope or Accelerometer Sensors:

    While changing the position, angle and

    alignment of the device , it should move

    or navigate in app.

    -

    Proximity sensors: For phone call or auto

    screen lock , it should turn off display at

    right time and when object removed

    from over the sensors, it should turn on

    the screen automatically.

    -

    GPS sensors: In MAP related app, it

    should detect exact location and app

    should display it in time.

    GPS sensors: According to requirement,

    user is out of some specific area,then ap

    should display default location as curre

    location.

    Ambient Light Sensor: According to

    requirement, It should be enabled and

    disabled the sensors e.g. For some games

    , full brightness is mandatory

    -

    Compass sensor: In MAP related app, Itshould point toward right direction in

    right time in user's app.

    -

    Battery Usage Use of JPEG images can slow down

    battery draining instead of PNG images.

    JPEG compresses images better and is

    faster to render, and is therefore more

    energy efficient.

    GPS and blue-tooth should be turn to

    disabled when there is no more use of i

    Background service should be disabled

    when device lose connectivity.

    -

    Developers should set frequency of

    background updates to reduce the effect

    of those updates on battery life, refresh

    rate should be maximum whenever the

    device is connected to a wall charger and

    if the device is discharging, reducing your

    update rate helps prolong the battery

    life.

    -

    Background updates rate can be set

    according to battery level changes.

    -

    terruptions

    nd Crashes.

    Phone calls or

    Other Interruption

    If user receive or dial call while using

    application -> App should be paused and

    resume after end the call.

    App should not be hanged after receivin

    dialing a call.

  • 8/9/2019 Android app testing Help Manual

    12/12

    Text messages, Voice-mail notifications,

    Calendar events, Social media

    notifications (Facebook, Twitter, etc),

    Alarm clocks and Low battery notification

    -> App should work fine after such

    interruption

    App should not be hanged or data loss a

    interruption of Text messages, Voice-m

    notifications, Calendar events, Social m

    notifications (Facebook, Twitter, etc), A

    clocks and Low battery notification.

    App Crash Programmer should Handle the a poor

    network connection,it can force an app

    crash as well.

    When a programmer references an obje

    variable that doesn't exist, technically c

    a null-pointer error.

    For some low memory devices -> app can

    crash easily compare to high end devices.

    Programing Errors in the coding that trig

    invalid and unauthorized instructions ca

    cause app crash.

    me-Out Time-out According to requirement, App log-in/out

    function can be set to specific timeout forsecurity purpose.

    If app is idle then it should not be long t

    for secure app like banking app.

    While uploading or downloading data ,if

    it takes more time due to interruption or

    lost network, it should be timeout.

    If server is responding very slow or due

    any other interruption there is any is

    then it should not be keep loading, it sh

    be timed out

    According to requirement, app can be

    designed so that user redirect to some

    specific screen after specific time interval

    in ideal condition.

    oudaring

    Cloud Sharing According to requirement , app may usedstore/share data to clouds like Drop-box,

    Box.net, SugerSync etc.

    -

    While uploading or Downloading data to

    cloud, it should display progress

    While uploading or Downloading data

    user should not allow to do any other a

    After redirect to cloud app, Log in/out

    functionality should work properly.

    After redirect to cloud from the app W

    logging in/Out , app should not crash.

    While Downloading data from cloud it

    should ask to store data on desired

    location.

    -

    If in the same file/Folder user wants to

    copy data, and a file with samename/data is already exist there it

    should inform user about it.

    -