1 internal testing snapshot jacob hodges 8 august 2014 this briefing is provided for informational...
DESCRIPTION
3 Demographics Organizations involved: DISAM, DISAM Contractors Lockheed Martin International Training Team 711 th HPW/RHAS ONR RC SSC PacificTRANSCRIPT
![Page 1: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/1.jpg)
1
Internal Testing Snapshot
Jacob Hodges8 August 2014
This briefing is provided for informational and lessons learned purposes only – all of the data collected during the Internal
Evaluation will be destroyed
![Page 2: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/2.jpg)
2
Introduction
• Timeframe: 20 July – 8 August 2014
• Number of emails sent: 20
• Participants Update:
Activity NumberRegistered 10
Finished Pre-Test 10
Completed Evaluation 7
![Page 3: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/3.jpg)
3
Demographics
• Organizations involved:• DISAM, DISAM Contractors• Lockheed Martin International Training Team• 711th HPW/RHAS• ONR RC• SSC Pacific
![Page 4: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/4.jpg)
Content Evaluation
4
Content Type Number of ReviewsVideo 7
Web-based 7
E-pub (Android/Apple) 3
E-pub (Kindle) 1
DISAM App 4
![Page 5: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/5.jpg)
Non-Testable Content Reviewed
5
Content Material Number of ReviewsInformality 6
Egalitairism 6
Short-Term Mentality 6
Daily Life in America 7
![Page 6: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/6.jpg)
What did you like most about the learning experience?
6
• Although I was unable to run this from a handheld Android device the desktop worked fine
• The video and web-based content was very engaging
• Fast, fun, well-constructed
• I noted the .flv movies are not working properly but the link at the very end of the last page (Daily Life in America) did not show up and hyperlinks was not accessible
• The video was very informative but too long so I liked that best. It was good to see and hear the speaker throughout the video. The graphics used nicely illustrated the ideas being discussed.
• Comparing the same content presented in multiple formats
![Page 7: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/7.jpg)
What did you like least about the learning experience?
7
• The inability to launch from an Android device
• Could not link to the mobile app – need a QR Code
• Really can’t do that – I wrote and produced it
• Thought it was not a real big deal, I noticed that I did not enjoy the web-based format as much because it required my interaction to click to the next module. The Daily Life in America module didn’t provide a button to click on to complete the module.
• The videos were not available in the web section at the time of my evaluation
![Page 8: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/8.jpg)
List five words that express your experience
8
convenient 1dull 1engaging 1enlightening 1exciting 1fun 1high quality 1informative 3interesting 2motivated 1new approach 1reading 1rewarding 1rote 1satisfying 1unmotivated 1useful 1
![Page 9: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/9.jpg)
Overall, I was satisfied with this course
9
![Page 10: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/10.jpg)
Problems Solved During Internal Evaluation
10
1) A sentence was added to the Learning Formats page informing participants when they would receive the MLS Final Instructions
2) The QR Code was added so that mobile devices can connect directly to the DISAM Mobile App
![Page 11: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/11.jpg)
11
3) Modified the last question on the Post-Test Questionnaire to read “Which word refers to. . .” to read versus “Which work refers to. . .”
4) Created shorter PINs for users accessing the MLS Data Portal on mobile devices
5) Streamlined the creation of PINS so that no human interface is required; thereby eliminating any potential violation of the research protocol requirements.
![Page 12: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/12.jpg)
Final Thoughts . .
12
• Two Learning Format issues (video and web-based) raised by DISAM will be addressed when Björn returns from vacation.
• The learning options are somewhat limited for Apple iPad/iPhone users (i.e., cannot access the DISAM App or Web-based formats)
• Issues noted in comments will be further reviewed to ensure resolution, if possible (i.e., .flv movies are not working properly but the link at the very end of the last page (Daily Life in America) did not show up and hyperlinks was not accessible)
• Interim provided a some good insight and testing of the evaluation process – more streamlined approach
• What user liked most/least will be reviewed to see where improvements can be made
• Good to see the humor in some comments
![Page 13: 1 Internal Testing Snapshot Jacob Hodges 8 August 2014 This briefing is provided for informational and lessons learned purposes only – all of the data](https://reader036.vdocuments.us/reader036/viewer/2022062905/5a4d1ae37f8b9ab059977f99/html5/thumbnails/13.jpg)
13
Questions/Comments