Artificial Intelligence-Based Student Learning Evaluation

BE 8th Semester, ISE 1PI12IS002 1

Abhishek Kumar Gupta

1PI12IS002

8th Semester, ISE

Seminar Guide: Asst. Prof. Sangita J

Abstract

BE 8th Semester, ISE 1PI12IS002 2

• Artificial Intelligence-based student learning evaluation tool(AISLE).

• Probability distribution of concepts identified in the concept map.

• Extensive XML parsing is used to perform the required evaluation.

Introduction

BE 8th Semester, ISE 1PI12IS002 3

• What is concept map?

• How to use concept map?

• Objective of the project.

• Impact on the academic community.

Introduction

BE 8th Semester, ISE 1PI12IS002 4

• What is concept map?.

Literature Survey

BE 8th Semester, ISE 1PI12IS002 5

• Intelligent Knowledge Assessment System

AISLE

Comparing concept maps to access student’s understanding of topics

Can be used to validate the process used for grading the students

IKAS

Access an individual concept mapfor analyzing the depth of a students

understanding of the topics

Focused more on identifying anindividual’s understanding of the topic.

Literature Survey

BE 8th Semester, ISE 1PI12IS002 6

• Personalized Assessment System Supporting Adaptation and Learning

AISLE

Validation of concept maps is left to the instructor

Focus is on an individual’s understanding with respect to others.

PAAS

Supports investigation of unknown concepts and misbelieves

Provides focus on an individual’s understanding of a particular topic.

Literature Survey

BE 8th Semester, ISE 1PI12IS002 7

• Knowledge Assessment System

AISLE

Concept maps are developed from scratch

Uses definitive scoring system to assess the strength of a concept map using probability

distribution

KAS

Allows students to add to an existing concept map

The scoring system is more or less theoretical in nature.

Methodology

BE 8th Semester, ISE 1PI12IS002 8

• Students develop concept maps after studying the prescribed material.• These concept maps are converted into XML-based documents.• The XML analyzer module of the tool extracts the concepts embedded in the

XML document.• The analysis module makes an assessment of the importance of the concepts

captured by the students and provides a summary of the results of the user interface module.

IMPLEMENTATION

BE 8th Semester, ISE 1PI12IS002 9

• A concept map is developed by the instructor which acts as the reference for evaluating all the students.

• Each concept is assigned an unique concept ID, and is interlinked with other concepts using linking-phrase-id.

• Concepts are divided into Levels 0,1,2.• Different connections are established between concepts and linking phrases.• This is given as input to the analysis module.

Overview of the Techniques

BE 8th Semester, ISE 1PI12IS002 10

Analysis Module:• First, random score is given for each concept represented in a concept map.• Second, a random score value depends on the level of the concepts in the

hierarchy.• All the level 1 concepts are given random score at equal increments.• Concept at the level 0 i.e. root is assigned next increment score.• All the level 2 concepts are then assigned higher score so as to indicate the in-depth

knowledge.

Overview of the Techniques

BE 8th Semester, ISE 1PI12IS002 11

Analysis Module:

Overview of the Techniques

BE 8th Semester, ISE 1PI12IS002 12

Analysis Module:

Z_concept = Score of concept – Mean of concept scores Standard Deviation of Score

Concept No. Name Z_concept

1 War of American Indep. -1.532 World war 1 -1.263 Civil War -0.984 World War II -0.705 French and Indian War -0.426 American History 0.127 Boston Campaign 0.688 Bombing of Hamburg 0.959 Forbes Expedition 1.2310 Selective Service Act 1.51

Overview of the Techniques

BE 8th Semester, ISE 1PI12IS002 13

Analysis Module:

Concept No. Name Z_concept

1 War of American Indep. 6.182 World war 1 10.343 Civil War 16.244 World War II 23.985 French and Indian War 33.396 American History 44.977 Boston Campaign 24.788 Bombing of Hamburg 16.879 Forbes Expedition 10.8110 Selective Service Act 6.49

Overview of the Techniques

BE 8th Semester, ISE 1PI12IS002 14

Parameters Used to Evaluate Concept Map in AISLE:1) Height of the curve, which represents the standard probability distribution value where the mean of the curve is equal to zero.2) Concept number, which represents the numeric values assigned to each of the concepts in the hierarchy.3) Leaning of the curve with the standard curve, which represents the depth of the topic or supporting concepts about the topic.

Analysis And Results

BE 8th Semester, ISE 1PI12IS002 15

Analysis And Results

BE 8th Semester, ISE 1PI12IS002 16

Observations of the Use of AISLE for classrooms:• Use of AISLE considerably reduces the time involved in assessing a student’s

understanding of a topic in study for the instructor.• Allows for the comparison of multiple students understanding on a given topic, such

that the instructor can access the variability between students.• It is very sophisticated to evaluate concepts that do not involve hierarchy.• Experiment indicates that the students having the curve to the right made excellent

score on the related course item. And those who had the curve to the left made below average scores.

Analysis And Results

BE 8th Semester, ISE 1PI12IS002 17

Limitations:• The method used to assess concept maps does not work very well when the concept

maps submitted by the students are not hierarchical in nature.

• The validation of the concepts contained in the concept maps has to be done manually by the instructor.

Thank You

BE 8th Semester, ISE 1PI12IS002 18