google and beyond: what sources are students really using?

Google and Beyond:Google and Beyond: What Sources are Students What Sources are Students

Really Using?Really Using?

Don MacMillanUniversity of Calgary

WILU 2007, TorontoMay 17, 2007

WILU 2007 | Google and Beyond | MacMillanWILU 2007 | Google and Beyond | MacMillan 22

IntroductionIntroduction

University of Calgary (Calgary, Alberta, University of Calgary (Calgary, Alberta, Canada)Canada)30,000 FT and PT Students30,000 FT and PT Students

Long-standing integration of IL skills into Long-standing integration of IL skills into the Biological Sciences Curriculum the Biological Sciences Curriculum

Ongoing assessment of IL programOngoing assessment of IL program

Survey questions generated more Survey questions generated more information than anticipatedinformation than anticipated


Why?Why?

Promote student reflection on research skillsPromote student reflection on research skills

What sources were upper-level biology students What sources were upper-level biology students actually using?actually using?

Have research habits changed over time-why?Have research habits changed over time-why?

Do students use different sources at different Do students use different sources at different stages?stages?

Is IL instructional content aligned with student Is IL instructional content aligned with student needs?needs?


Who?Who?

25 third and fourth year biological 25 third and fourth year biological sciences students in CMMB421-Virology sciences students in CMMB421-Virology Fall 2006Fall 2006

Most students have had at least one Most students have had at least one instruction session (BIOL231)instruction session (BIOL231)

More than 20 students considering More than 20 students considering graduate studiesgraduate studies


How?How?

FAST-Free Assessment Summary ToolFAST-Free Assessment Summary Tool http://www.getfast.ca/

Anonymous online survey tool that Anonymous online survey tool that summarizes students impressions of a summarizes students impressions of a course/instructorcourse/instructor

Numerical and textual data easily Numerical and textual data easily gathered and collatedgathered and collated

16 question survey administered at the 16 question survey administered at the end of instruction sessionend of instruction session


Table 1 - Resources used by Table 1 - Resources used by Virology Undergraduate Students (N=25)Virology Undergraduate Students (N=25)

ResourceResource RankRank

Biological AbstractsBiological Abstracts ??????

Google/ScholarGoogle/Scholar

Library CatalogueLibrary Catalogue

PatentsPatents

PubMedPubMed

Web of ScienceWeb of Science



ResourceResource RankRank

Biological AbstractsBiological Abstracts 22

Google/ScholarGoogle/Scholar 44

Library CatalogueLibrary Catalogue 33

PatentsPatents 66

PubMedPubMed 11

Web of ScienceWeb of Science 55



ResourceResource NumberNumber PercentagPercentagee

Biological Biological AbstractsAbstracts

2020 80%80%

Google/ScholarGoogle/Scholar 1818 72%72%

Library CatalogueLibrary Catalogue 1919 76%76%

Patent DatabasesPatent Databases 22 8%8%

PubMedPubMed 2121 84%84%

Web of ScienceWeb of Science 55 20%20%


Table 3 - Purpose of use for each resourceTable 3 - Purpose of use for each resource

ResourceResource Choosing a Choosing a topictopic

Exploring a Exploring a topictopic

Finding Finding specific specific

infoinfo

Finding Finding background background

infoinfo

Will use in Will use in futurefuture

Bio AbsBio Abs 55 1010 77 22

GoogleGoogle 88 99 33 55 2 2 (Scholar)(Scholar)

LibraryLibraryCataloguCataloguee

44 88 55 11

PatentsPatents 11 33

PubMedPubMed 77 1515 88 55 33

WOSWOS 22 11 11


How do you decide which source to How do you decide which source to check first?check first?

““Usually I use Biological Abstracts and then Usually I use Biological Abstracts and then PubMed”.PubMed”.

“ “I was using Biological Abstracts because I was I was using Biological Abstracts because I was most familiar with it, but now I think PubMed and most familiar with it, but now I think PubMed and Web of Science might be better because there Web of Science might be better because there are a lot of useful features on these databases are a lot of useful features on these databases that I wasn't aware of”.that I wasn't aware of”.

““I use general sources such as Google Scholar to I use general sources such as Google Scholar to browse general topics in the field of interest browse general topics in the field of interest before searching for specific articles”.before searching for specific articles”.


Which source do you find most useful Which source do you find most useful

for your research purposes?for your research purposes?

““I think PubMed will become my most I think PubMed will become my most useful tool”.useful tool”.

I find PubMed usually very helpful as well I find PubMed usually very helpful as well as Google Scholar as Google Scholar

““I anticipate PubMed, Web of Science and I anticipate PubMed, Web of Science and the Patents databases will be very useful “the Patents databases will be very useful “


Has the way you do library research Has the way you do library research changed as you have progressed changed as you have progressed through your studies? If so, how?through your studies? If so, how?

““More information has become available and more More information has become available and more links. Library sessions have been very informative”.links. Library sessions have been very informative”.

““I often use multiple search engines/databases now I often use multiple search engines/databases now to ensure that I have received a more complete to ensure that I have received a more complete picture on my search topic. Before, I would only use picture on my search topic. Before, I would only use one search engine.” one search engine.”

““The library seems more organized and also the The library seems more organized and also the information sessions have gotten more specific and information sessions have gotten more specific and are quite helpful.”are quite helpful.”


What factors caused the What factors caused the change?change?

““Formal instruction such as this session changed Formal instruction such as this session changed my research strategies”my research strategies”

““Tutorials for Ecology, Biology and now CMMB (Cell Tutorials for Ecology, Biology and now CMMB (Cell Biology)”. Biology)”.

““Library tutorials have given me a lot of useful Library tutorials have given me a lot of useful information, as well as advice from profs and TA's”. information, as well as advice from profs and TA's”.

““Professors, personal research and playing around, Professors, personal research and playing around, informal and formal instruction”. informal and formal instruction”.


What do you know about library What do you know about library research now that you wished you had research now that you wished you had

known earlier?known earlier?

““I like how the index on PubMed works to break I like how the index on PubMed works to break down searches into specific categories”.down searches into specific categories”.

““The idea of "index" I learned today in Pubmed. The idea of "index" I learned today in Pubmed. Given a very general topic, Pubmed was provided Given a very general topic, Pubmed was provided more specific topics for me to explore”. more specific topics for me to explore”.

““That there is so much available online. I would That there is so much available online. I would far rather be at home searching for a topic with a far rather be at home searching for a topic with a cup of tea at my side than wandering through the cup of tea at my side than wandering through the aisles of a library for hours”. aisles of a library for hours”.


How did you learn about the various How did you learn about the various sources?sources?

““CMMB421 tutorial!”. CMMB421 tutorial!”.

““Library sessions. I would honestly recommend Library sessions. I would honestly recommend them to anyone who has do to any kind of them to anyone who has do to any kind of research”.research”.

““Biology 231, 313”. Biology 231, 313”.

““Blind luck and of course this tutorial”.Blind luck and of course this tutorial”.


Do you plan to pursue an advanced Do you plan to pursue an advanced degree?degree?

14 students indicated they would be pursuing 14 students indicated they would be pursuing advanced studies in the biological or life sciencesadvanced studies in the biological or life sciences

10 students selected medicine or ‘other’ as future 10 students selected medicine or ‘other’ as future areas of studyareas of study

‘‘Future’ medical students used PubMed but there Future’ medical students used PubMed but there was no clear difference between usage patterns was no clear difference between usage patterns for PubMed among ‘pre-med’ and ‘other students’ for PubMed among ‘pre-med’ and ‘other students’


Unanticipated ResultsUnanticipated Results High number of positive responses regarding the High number of positive responses regarding the

value IL sessionsvalue IL sessions

Students appreciate review of IL skills from course Students appreciate review of IL skills from course to courseto course

High use of PubMedHigh use of PubMed

No habitual Google Scholar usersNo habitual Google Scholar users

Many predictive statements about changes to Many predictive statements about changes to research habits based on IL sessionsresearch habits based on IL sessions

Students recognize value of their IL skills - useful Students recognize value of their IL skills - useful for marketing purposesfor marketing purposes


ConclusionsConclusions

Students use a variety of strategies to achieve Students use a variety of strategies to achieve research goalsresearch goals

Reinforcement of literacy skills throughout degree Reinforcement of literacy skills throughout degree program highlights the benefits of integrated IL program highlights the benefits of integrated IL

Students used different tools for different Students used different tools for different purposespurposes

Learned about more resources-use resources Learned about more resources-use resources more efficientlymore efficiently

Survey results benefited students and librarianSurvey results benefited students and librarian


Future DirectionsFuture Directions

Incorporate PubMed earlier in IL cycleIncorporate PubMed earlier in IL cycle

Google and Google Scholar will be split in Google and Google Scholar will be split in next iteration of surveynext iteration of survey

Add Scopus (Elsevier) in next surveyAdd Scopus (Elsevier) in next survey

Ask follow-up question later in term to Ask follow-up question later in term to ascertain what new sources were used ascertain what new sources were used during the term. during the term.


Related LinksRelated Links

Link to WILU 2007 presentation: Link to WILU 2007 presentation: http://tinyurl.com/38mzeb

CMMB 421 IL Survey Questions:CMMB 421 IL Survey Questions:http://tinyurl.com/2g7e8t

CMMB 421 IL Survey Results:CMMB 421 IL Survey Results:http://tinyurl.com/yu7el3


Related LinksRelated Links

Related Readings:Related Readings:http://tinyurl.com/ynuz4x

FAST Survey Tool:FAST Survey Tool:http://www.getfast.ca/

CMMB 421 (Virology) IL Web Page:http://tinyurl.com/ypx963

Thank You!Thank You!

Don MacMillanDon MacMillanLibrarian for Biological Librarian for Biological Sciences, Physics and Sciences, Physics and

AstronomyAstronomy

University of CalgaryUniversity of [email protected]@ucalgary.ca

google and beyond: what sources are students really using?

Documents

google scholar

useful wilu

students impressions

library research

upperlevel biology students

useful tool

lot of useful information

purpose of use