2009 the american physiological society quality control in dl content: what are the issues? marsha...

2009 The American Physiological 2009 The American Physiological SocietySociety

Quality Control in DL Quality Control in DL Content: Content:

What are the Issues?What are the Issues?Marsha Lakes Matyas, Ph.D.Marsha Lakes Matyas, Ph.D.

Director of Education ProgramsDirector of Education ProgramsThe American Physiological SocietyThe American Physiological Society

9650 Rockville Pike9650 Rockville PikeBethesda, MD 20814-3991Bethesda, MD 20814-3991

Quality Control: Quality Control: Content vs. MetadataContent vs. Metadata

Quality control in metadataQuality control in metadata Allows users to find resources in the DL more easilyAllows users to find resources in the DL more easily

Quality control in contentQuality control in content Gives users informed expectations about the materials Gives users informed expectations about the materials

they will find in the DLthey will find in the DL

BEN Survey results:BEN Survey results: 79% of higher education faculty want resources to 79% of higher education faculty want resources to

enhance their lecturesenhance their lectures 43% want resources for student projects or 43% want resources for student projects or

assignmentsassignments

57% used the resources they accessed through BEN57% used the resources they accessed through BEN 50% incorporated new ideas, methods, or resources 50% incorporated new ideas, methods, or resources

they found in BENthey found in BEN

85% felt it was important that resources were peer-85% felt it was important that resources were peer-reviewed and backed by professional societies. reviewed and backed by professional societies.

81% said resources that are original and 81% said resources that are original and authoritative are important. authoritative are important.

What do users want?What do users want?

A. Chang, M. Matyas, N. Gough, & Y. George. (2004). http://www.apsarchive.org/resource.cfm?submissionID=3764.

Whether “Best of the Best” or wide Whether “Best of the Best” or wide acceptance, assuring “quality” is importantacceptance, assuring “quality” is important

Requires establishing standards and review Requires establishing standards and review processes for digital resourcesprocesses for digital resources

Easier for materials developed Easier for materials developed de novo de novo for the for the DLDL

Complicated for Complicated for individual submissionsindividual submissionsWebsites, programs, simulations, etc.Websites, programs, simulations, etc.

Today’s session: Probably more questions Today’s session: Probably more questions than answers!than answers!

Submission and Review Submission and Review Standards Standards

Scientific accuracyScientific accuracy DefinitionDefinition

Reviewers and “editors” must have a common Reviewers and “editors” must have a common definitiondefinition

Definition should be transparent to usersDefinition should be transparent to users Time sensitiveTime sensitive

WHENWHEN was it scientifically accurate? was it scientifically accurate? When developed? Reviewed? Released?When developed? Reviewed? Released?

Re-review periodically? Update materials?Re-review periodically? Update materials? Web site review issues – in addition to Web site review issues – in addition to

accuracy…accuracy… Who wrote the site? – Credibility of authorsWho wrote the site? – Credibility of authors Why did they write it?Why did they write it?

CourseCourse AdvertisementAdvertisement

How often is it updated?How often is it updated? Advertisement-driven/Advertisement-impedeAdvertisement-driven/Advertisement-impede HOW MUCH DO YOU REVIEW?HOW MUCH DO YOU REVIEW?

Some common issues…Some common issues…

SafetySafety Grade level dependentGrade level dependent

Appropriate for graduate/medical? Undergraduate? K-12? Appropriate for graduate/medical? Undergraduate? K-12? Extra review criteria for K-12 materialsExtra review criteria for K-12 materials

Student learningStudent learning Not all resources are pedagogy-specific but should Not all resources are pedagogy-specific but should

have accurate descriptions and documentationhave accurate descriptions and documentation GraphicsGraphics TablesTables ChartsCharts PhotosPhotos PowerPointsPowerPoints


Use of animals/humans/microbes in teachingUse of animals/humans/microbes in teaching What is your policy?What is your policy?

APS Position Statement on Animals in Teaching APS Position Statement on Animals in Teaching ((www.apsarchive.org/resource.cfm?submissionID=26720)www.apsarchive.org/resource.cfm?submissionID=26720)

Institute for Laboratory Animal Use in Research/NAS Institute for Laboratory Animal Use in Research/NAS (http://dels.nas.edu/ilar_n/ilarhome/Principles_and_Guidelines.pdf(http://dels.nas.edu/ilar_n/ilarhome/Principles_and_Guidelines.pdf))

NSTA Position Statement NSTA Position Statement (http://www.nsta.org/about/positions/animals.aspx)(http://www.nsta.org/about/positions/animals.aspx)

NABT Position Statement NABT Position Statement (http://www.nabt.org/websites/institution/index.php?p=97)(http://www.nabt.org/websites/institution/index.php?p=97)

State regulations on use of animals in K-12 (see State Education State regulations on use of animals in K-12 (see State Education websites)websites)

Grade level matters in specifics but NOT in principleGrade level matters in specifics but NOT in principle ““ABC – Appropriate, Beneficial, Caring”ABC – Appropriate, Beneficial, Caring”

International differencesInternational differences ReviewersReviewers SubmittersSubmitters


Original work/plagiarism Original work/plagiarism TextText Reuse of materials (e.g., graphics, figures, and tables)Reuse of materials (e.g., graphics, figures, and tables)

Replace with description and reference or linkReplace with description and reference or link Outdated texts are problematic…include descriptionOutdated texts are problematic…include description Cartoons!Cartoons!

Author reuse policiesAuthor reuse policiesCopyright Clearinghouse Center Copyright Clearinghouse Center

(www.copyright.com)(www.copyright.com) Affirmation by author that they hold copyrightAffirmation by author that they hold copyright

Institutional claims on faculty workInstitutional claims on faculty work

LanguageLanguage

Review translations?Review translations?


Age appropriatenessAge appropriateness K-12 reviewK-12 review

MultimediaMultimedia Animal useAnimal use Human anatomy physiologyHuman anatomy physiology

My ArchiveMy Archive

Digital FormatsDigital Formats Programs and simulationsPrograms and simulations

May not be able to change in response to reviewers’ May not be able to change in response to reviewers’ commentscomments

Editor’s call: Minor errors versus major issuesEditor’s call: Minor errors versus major issues

Mac vs. PC issuesMac vs. PC issues Older versions of softwareOlder versions of software


Semper vigilansSemper vigilans (Always vigilant) (Always vigilant) Have content quality policies and use themHave content quality policies and use them Educate reviewersEducate reviewers

Caveat emptor Caveat emptor (Let the buyer beware)(Let the buyer beware) ““Let the purchaser beware, for he ought not to be Let the purchaser beware, for he ought not to be

ignorant of the nature of the property which he is ignorant of the nature of the property which he is buying from another party”buying from another party”

Make your content quality policies transparent to the Make your content quality policies transparent to the useruserWhat quality controls are in placeWhat quality controls are in placeHow items are reviewedHow items are reviewedWhen items were reviewed/releasedWhen items were reviewed/released

Balancing ActBalancing Act

NSDL Collection Task ForceNSDL Collection Task ForceCharge: Provide input and recommendations on matters Charge: Provide input and recommendations on matters

related to collection development and management related to collection development and management and policy matters:and policy matters:

– Recommend revisions to NSDL Collection PolicyRecommend revisions to NSDL Collection Policy – Provide input to NSDL collection evaluation activities, Provide input to NSDL collection evaluation activities,

such as recommending collection metrics and such as recommending collection metrics and assessment for determining collection scope and assessment for determining collection scope and balance, identifying gaps in content coverage, and balance, identifying gaps in content coverage, and recommending priority areas for collection developmentrecommending priority areas for collection development

Representation from NSDL Pathways, Resource Center, Representation from NSDL Pathways, Resource Center, Technical Network ServicesTechnical Network Services

Contact infoContact info

Marsha Lakes MatyasMarsha Lakes Matyas

Email: [email protected]: [email protected]

Digital Library: www.apsarchive.org Digital Library: www.apsarchive.org

Portal: www.biosciednet.orgPortal: www.biosciednet.org

Phone: 301-634-7957Phone: 301-634-7957

2009 the american physiological society quality control in dl content: what are the issues? marsha...

Documents