Meg Frazier and Megan JaskowiakCullom-Davis Library
Bradley University
Learning Concepts
Assessment: What Do They Remember?
Who We Are
Meg Frazier: MLS in 1989 from UT-Austin At Bradley since 1998Information Literacy LibrarianLiaison Areas: Engineering, Computer Science, Women’s Studies and Theatre
Megan Jaskowiak: MLIS in 2013 from Kent St, PhD in 2003 from North Dakota St At Bradley since 2013Science/Health Science LibrarianLiaison Areas: Biology, Chemistry, Health Sciences, Mathematics, Nursing, Physical Therapy, Physics
Who We Are
• Bradley University: Private, undergraduate institution with graduate programs aimed at returning professionals -- 5,000 undergrads/ 1,000 graduates
Learning Concepts Sheet • Will Thalheimer• Newness of the Concept• Value of the Concept• Likelihood of Using the Concept
Some analysis of open ended questions
• Formulate categories• Condense the answers• Double check your categories
Our Results
• Revising Searches–‘narrow’ or ‘revise’–get better results–select a specific date range
• Generalized Statements–learned about the library–learned about finding articles–learned about finding books
Our ResultsThemes Total % Librarian 1 Librarian 2
How to revise searches 17.1 17.3 16.9
Generalized statements 16.9 19.9 15
I-share 14.5 2.6 21.6
Where databases’ links are on library's website 11 16.8 7.5
Other 8.6 4.2 11.3
Finding specific items (newspapers/books/articles) 8.2 6.8 9.1
Using Wikipedia's Talk Page 7.3 13.6 3.4
ILLiad 3.3 1.6 4.4
Finding accurate or credible information 2.9 5.2 1.6
Mentioned specific databases 2.7 4.2 1.9
Learned nothing new 2.2 4.7 0.6
Google Scholar 2 2.8 2
How use databases citation feature 1.4 0.5 1.9
How to find specific encyclopedias 1 0.9 1
The importance of reading the abstract 0.6 0 0.9
How to recognize a scholarly article 0.4 1 0
• Answers easier to code• Statistical analysis more
robust• Replication is easier• Takes less time
• Suggest ideas• Cannot notice
misinterpretations of questions
• May be too simplistic• Participants may find
them irritating
Pros and cons of closed questions
Standard Descriptive Statistics Mean Median Skewness Kurtosis
How books are arranged in the library?
4.063 4.000 -0.501 -0.669
How to search for books in the library catalog?
4.135 4.000 -0.558 -0.558
What is the topic section of the catalog record?
3.683 4.000 -0.296 -0.695
How to get books and videos from other libraries?
4.026 4.000 -0.343 -0.445
Where to search for articles on the library website?
3.817 4.000 -0.341 -0.736
What kind of search tool is an article database?
4.325 5.000 -0.720 -0.397
How narrow or focus your search in an article database?
3.976 4.000 -0.442 -0.765
How to look for different kinds of articles?
4.214 5.000 -0.634 -0.400
What are the differences between these search tools: Google Scholar, the library catalog and article databases?
3.778 4.000 -0.235 -0.957
Pearson Correlation of values A B C D E F G H IA 1 0.6(0) 0.6(0) 0.4(0) 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)B 0.6(0) 1 0.6(0) .5(0) 0.6(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)C 0.6(0) 0.6(0) 1 0.5(0) 0.6(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)D 0.4(0) 0.5(0) 0.5(0) 1 0.5(0) 0.4(0) 0.5(0) 0.4(0) 0.5(0)E 0.5(0) 0.6(0) 0.6(0) .5(0) 1 0.8(0) 0.7(0) 0.7(0) 0.5(0)F 0.4(0) 0.5(0) 0.5(0) 0.4(0) 0.8(0) 1 0.7(0) 0.7(0) 0.6(0)G 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.7(0) 0.7(0) 1 0.8(0) 0.6(0)H 0.5(0) 0.5(0) 0.5(0) 0.4(0) 0.7(0) 0.7(0) 0.8(0) 1 0.7(0)I 0.4(0) 0.3(0) 0.4(0) 0.5(0) 0.5(0) 0.6(0) 0.6(0) 0.6(0) 1
A= How books are arranged in the library?B= How to search for books in the library catalog?C= What is the topic section of the catalog record?D= How to get books and videos from other libraries?E= Where to search for articles on the library website?F= What kind of search tool is an article database?G= How narrow or focus your search in an article database?H=How to look for different kinds of article, I= What are the differences between these search tools: Google Scholar, the library catalog and article databases?
<0.2 Very weak relationship0.2-0.4 Weak relationship0.4-0.6 Moderate relationship0.6-0.8 Strong relationship>0.8 Very strong
relationship
A B C D E F G H I
A 1 0.5(0) 0.4
(0.001)
0.4(0) 0.4(0) 0.4(0) 0.3(0) 0.4(0) 0.4
(0.002)
B 0.6(0) 1 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0) 0.5(0) 0.5(0)
C 0.4
(0.001)
0.5(0) 1 0.3
(0.007)
0.24
(0.055)
0.4
(0.004)
0.24
(0.055)
0.3
(0.039)
0.50(0)
D 0.4(0) 0.5(0) 0.3
(0.007)
1 0.6(0) 0.5(0) 0.4(0) 0.4(0) 0.5(0)
E 0.4(0) 0.5(0) 0.2
(0.056)
0.6(0) 1 0.6(0) 0.5(0) 0.5(0) 0.4
(0.001)
F 0.5(0) 0.5(0) 0.4(0) 0.5(0) 0.6(0) 1 0.7(0) 0.6(0) 0.5(0)
G 0.3
(0.018)
0.4(0) 0.24
(0.055)
0.4(0) 0.5(0) 0.6(0) 1 0.7(0) 0.6(0)
H 0.4(0) 0.5(0) 0.3(0) 0.4(0) 0.5(0) 0.6(0) 0.7(0) 1 0.5(0)
I 0.4
(0.002)
0.5(0) 0.4
(0.002)
0.5(0) 0.4
(0.001)
0.5(0) 0.6(0) 0.5(0) 1
Pearson Correlation of newness
Pearson CorrelationQuestion Correlation between newness and importance
How books are arranged in the library? -0.097(0.442)
How to search for books in the library catalog? -0.087(0.491)
What is the topic section of the catalog record? -0.156(0.215)
How to get books and videos from other libraries? -0.044(0.727)
Where to search for articles on the library website? -0.282(0.001)
What kind of search tool is an article database? 0.205(0.107)
How narrow or focus your search in an article database?
-0.221(0.077)
How to look for different kinds of articles? -0.358(0.001)
What are the differences between these search tools: Google Scholar, the library catalog and article databases?
-0.252(0.043)
Interpreting Results from Both Analyses
• Students remembered and seemed to value finding articles/using article databases over finding books/use the library catalog.