b.b.a. degree program assessment summaries - ut tyler mba - aol... · summaries of assessment...

THE UNIVERSITY OF TEXAS AT TYLER | College of Business & Technology | 1

Summaries of Assessment Activities and Results

For Degree Programs

B.B.A.; M.B.A.

Academic Year 2010-2011

B.B.A. Degree Program Assessment Summaries

Learning Goal 1: Professional Proficiency

Graduates have the knowledge and communication skills to succeed in the business profession.

Objective 1: Students demonstrate that they are knowledgeable about current business theory,

concepts, methodology, terminology and practices.

Method of Assessment

Semester Reviewed: Fall 2010, Spring 2011 Course: Strategic Management (MANA 4395)

Number of Students Reviewed: 214 Assessment Tool: Major Field Test Exam Criterion: 50% of students score above the national

median on the overall MFT Score Analysis 52% of students met the criterion. Areas of concern are Economics (49%),

Quantitative Analysis (47%) and Finance (49%). Recommendation Accounting:

Adopt a new textbook with an enhanced online homework manager which will increase the rigor of Principles of Financial Accounting (ACCT 2301).

Incorporate a hybrid-model Principles of Managerial Accounting (ACCT 2302) course using video-enhanced modules beginning in the fall of 2011.

Finance:

Adopt a common syllabus with common learning objectives.

Adopt a common textbook to facilitate implementation of common learning objectives.

Marketing:

Adopt a standardized textbook in all Principles of Marketing (MARK 3311) courses.

Require students to complete a written marketing plan in all Principles of Marketing (MARK 3311) courses.

Quantitative Analysis:

Change Operations Management (MANA 3305) to increase focus on quantitative techniques.

Review MFT topics to be sure appropriate material is covered in MANA 3305. Other:

Move MFT Test date to later in the semester in Strategic Management (MANA 4395).


Implementation Accounting faculty has adopted a new textbook beginning in the fall of 2011. Hybrid course in Managerial Accounting is being piloted in the fall of 2011. Finance syllabus and textbook were adopted for spring of 2012. Changes to Operations Management and Strategic Management will take place in the spring of 2012. Marketing faculty adopted a standardized textbook in all Principles of Marketing (MARK 3311) courses starting Fall 2011. Marketing faculty also required students to complete a written marketing plan in all Principles of Marketing (MARK 3311) courses starting Fall 2011.

Objective 2: Students can prepare a business document that is focused, well-organized, and

mechanically correct.


Semester Reviewed: Fall 2010, Spring 2011 Course: Business Writing and Oral Presentations

(MANA 3370) Number of Students Reviewed: 92 Assessment Tool: Written Assignment Criterion: 70% of students meet or exceed expectations Analysis 86% of students met or exceeded the expectation of clear, original and focused

writing to demonstrate knowledge of the subject.

92% structured sentences to communicate ideas clearly.

89% used appropriate tone and style to keep readers interested.

70% followed normal conventions of spelling and grammar with few mistakes.

A confirmatory factor analysis indicated that our rubric appropriately measured the construct.

Recommendation The analysis was based upon a single faculty member’s assessment; going forward a

panel will be used to get more input into appropriate remediation. Implementation A cross-disciplinary faculty panel comprising four faculty members was created to review

writing skills in MANA 3370 and TECH 4372 in the fall of 2011.


Objective 3: Students create a compendium of evidence (skills and behaviors) to market themselves as

professionals.


Semester Reviewed: Spring 2011 Course: How to Get a Job (MANA 3170)

Number of Students Reviewed: 138 Assessment Tool: Resume & Mock Interview Criterion: 100% of students meet or exceed expectations Analysis 100% of students met or exceeded all expectations of preparing a resume.

At least 95% dressed appropriately, used vocal variety, maintained eye contact, controlled body movement, allowed few vocal pauses and listened attentively.

At least 82% communicated unique value, answered questions clearly and asked appropriate closing questions.

Recommendation Results of a confirmatory factor analysis indicated that this measure did not contribute to

the measurement of the professional proficiency construct. Implementation This assessment will be eliminated from future analysis.

Objective 4: Students are able to deliver a presentation that is focused, well-organized, and includes

appropriate verbal and non-verbal behaviors.


Semester Reviewed: Fall 2010, Spring 2011 Course: Business Writing and Oral Presentations

(MANA 3370) Number of Students Reviewed: 106 Assessment Tool: Oral Presentation Criterion: 70% of students meet or exceed expectations Analysis At least 92% of students met or exceeded all expectations of the oral

presentation rubric.

Recommendation Instructor should be provided with the results of the assessment and encouraged to

focus on improving student ability in weaker areas (introduction, conclusion and appropriate use of fillers).

Implementation Instructor focused on weak areas during spring of 2012.


Learning Goal 2: Technological Competence

Graduates use the information sources and tools associated with their chosen profession.

Objective 1: Students demonstrate an understanding of information systems and their role in business

enterprises.



Number of Students Reviewed: 214 Assessment Tool: Major Field Test Exam Criterion: 50% of students score above the national

median of Section VIII (Info Systems) of the MFT Exam

Analysis 65% of students scored above the national median in section VIII (Information

Systems) of the MFT Exam.

Recommendation The criterion should be increased from 50% to 70% since our students consistently

exceed the current expectation. Implementation Beginning in the fall of 2011, our college will strive for 70% of students to exceed the

national mean score of Section VIII (Info Systems) of the MFT Exam.

Objective 2: Students are able to use business software, data sources, and tools.


Semester Reviewed: Fall 2010 Course: Intro to Computer Applications (TECH 2323)

Number of Students Reviewed: 28 Assessment Tool: Oral Presentation Criterion: 70% of students meet or exceed expectations Analysis At least 96% of students met or exceeded expectations in all presentation

criteria.

Recommendation Recommend that a less structured, more complex, assessment is used in an upper level

course. Implementation The revised assessment was implemented in TECH 2323 during Spring 2012.


Learning Goal 3: Global Awareness

Graduates incorporate global considerations in business activities.

Objective 1: Students demonstrate awareness of global issues and perspectives.


Semester Reviewed: Fall 2010, Spring 2011 Course: Managing People in Organizations (MANA 3311)

Number of Students Reviewed: 151 Assessment Tool: Global Awareness Profile Criterion: Students score above the global average in all

categories Analysis Students scored below the global average in 12 of 14 categories. Sections in

which they scored above the global average were Global context and region.

Recommendation Increase global content across the college curriculum. Implementation College of Business and Technology has purchased a subscription for every student to

Bloomberg Businessweek. The faculty voted unanimously that the following courses will require readings that incorporate global contexts: Principles of Finance (FINA 3311), Managing People in Organizations (MANA 3311), Principles of Marketing (MARK 3311), Cost Accounting (ACCT 3311), International Finance (FINA 4350), International Management (4310), International Marketing (4360) and Strategic Management (4395). Faculty employed quizzes, in-class discussions, article summaries, blogs, discussion boards and other means of incorporating global/international content.


Objective 2: Students are knowledgeable of global issues and perspectives that may impact business

activities.


Semester Reviewed: Spring 2011, Summer 2011 Course: Human Resource Management (MANA 3320)

Number of Students Reviewed: 77 Assessment Tool: Case Analysis Criterion: 70% of students meet or exceed expectations Analysis Students met or exceeded expectations in demonstrating an understanding of

the assignment’s purpose (84%) and defining the issue at hand (82%).

Students did not meet expectations in evaluating relevant points of view (69%), gathering sufficient, credible and relevant information (43%), identifying, explaining and using key concepts (44%), making valid assumptions (52%), following evidence to logical conclusions (55%) and identifying significant implications or consequences (51%).

Recommendation Increase global content across the college curriculum and modify the assessment tool in

future semesters. Implementation See Businessweek initiative above under Objective One.

The assessment tool will become MFT Section IX (International) beginning Fall 2011.


Learning Goal 4: Social Responsibility

Graduates evaluate the social consequences of alternative outcomes when making business decisions.

Objective 1: Students demonstrate good citizenship as leaders and participants of peer teams.


Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Course: Introduction to Marketing (MARK 3311)

Number of Students Reviewed: 234 Assessment Tool: Peer Review Criterion: 70% of students meet or exceed expectations Analysis At least 98% of students met or exceeded expectations in all criteria. Recommendation The Committee is not satisfied that peer assessment of participation in course-based

teams is a good measure of learning about social responsibility. The Committee will recommend to the faculty that the goal be revised to reflect the attributes graduates should possess, and the learning objective rewritten to ensure that the activities measured are appropriate. The Strategic Management faculty should develop a Corporate Social Responsibility module and assessment for inclusion in the Strategic Management (MANA 4395) beginning in the spring of 2012.

Implementation The CSR module was embedded in Strategic Management (MANA 4395) in spring 2012.

A random block multiple choice test was created and embedded in BlackBoard for administration by strategic management faculty. The module was created to be suitable for adaption by other programs (e.g. HRD, MBA, MSHRD).


Learning Goal 5: Ethical Courage

Graduates understand ethical considerations and their impacts.

Objective 1: Students understand legal and ethical concepts.



Number of Students Reviewed: 214 Assessment Tool: Major Field Test Criterion: 50% of students score above the national

median of Section VII (Law) of the MFT Exam Analysis 52% of students exceeded the national median score of Section VII (Law). Recommendation Accounting faculty will consider making BLAW 4340 an Accounting degree plan

requirement. In other disciplines, students will be encouraged to include business ethics

in their degree plans. There are no plans to require the course at this time for other majors.

Implementation BLAW 4340 will be a required course for all Accounting majors beginning Spring 2013.

To facilitate both Accounting and other major students taking this course as an elective, the course was offered during evening hours and enrollment limits were increased.

Objective 2: Students make ethical decisions.


Semester Reviewed: Fall 2010, Spring 2011 Course: Business and Professional Ethics (BLAW 4340)

Number of Students Reviewed: 63 Assessment Tool: Course Embedded Assessment Criterion: 80% of students make the best ethical decision

on the second of two case analyses Analysis 87% of students made the best decisions on the second of two case analyses.

Because BLAW 4340 is not a required class for BBA students, the distribution is heavily skewed toward accounting majors, who take this course to qualify for the CPA exam.

Recommendation The ethics game should be embedded in several other courses to ensure that we have

good program representation. Accounting faculty will consider making Business Ethics (BLAW 4340) an Accounting degree plan requirement.

Implementation The ethics game was embedded in TECH 4310 effective fall 2012. BLAW 4340 is now a

required course for all Accounting majors beginning in Fall 2012.


M.B.A. Degree Program Assessment Summaries

Learning Goal 1: Professional Proficiency

Graduates are leadership ready and have an understanding of the business discipline that is both broad

and deep.

Objective 1: Students demonstrate both breadth and depth in their comprehension of current business

theory, concepts, methodology, terminology, and practices.


Semester Reviewed: Spring 2011 Course: Formulating and Implementing Strategy

(MANA 5395) Number of Students Reviewed: 50 Assessment Tool: Major Field Test Exam Criterion: 50% of students score above MBA MFT exam

national mean Analysis 72% of students scored above the overall MFT MBA exam national mean.

Criterion was met in all five sections individually: Marketing (66%), Management (70%), Finance (62%), Accounting (66%) and Strategic Integration (68%).

Recommendation Criterion will be raised from 50% to 70% at the meeting on 10/11/2011. Implementation Content area criterion was raised.

Objective 2: Students analyze and critique their personal change leadership styles.


Semester Reviewed: Spring 2011, Summer 2011 Course: Strategic Human Resources Management

(MANA 5350) Number of Students Reviewed: 108 Assessment Tool: Self-Assessment Survey Criterion: Results form a normal distribution Analysis 20% of students self-identified as change leaders.

37% of students self-identified as change agents.

29% of students self-identified as average change managers.

14% of students self-identified as average managers. Recommendation Expand the assessment by having students acquire external assessor to complement

their self-assessment. Implementation The committee will determine criteria for an outside party. The next assessment in the

spring of 2012 will include responses both from students and their elected outside individual.


Learning Goal 2: Technological Competence

Graduates possess the technical, research, and quantitative skills to solve business problems.

Objective 1: Students comprehend tools such as decision models, statistical analyses, forecasting, and

supply chain logistics.


Semester Reviewed: Course:

Number of Students Reviewed: Assessment Tool: Criterion: Analysis Outcome not yet assessed. Assessment scheduled for fall of 2011. Recommendation Implementation

Objective 2: Students apply these tools and research skills effectively when resolving business decision

problems.


Semester Reviewed: Course:

Number of Students Reviewed: Assessment Tool: Criterion: Analysis Outcome not yet assessed. Assessment scheduled for fall of 2011. Recommendation Implementation


Learning Goal 3: Global Awareness

Graduates think critically and can analyze business decisions with awareness of global considerations

that may impact decisions.

Objective 1: Students demonstrate awareness of global issues and perspectives.


Semester Reviewed: Spring 2011 Course: Strategic Human Resource Management

(MANA 5350) Number of Students Reviewed: 73 Assessment Tool: Global Awareness Profile Criterion: Students exceed the global average in all

categories Analysis Students scored above the global average in all 14 of 14 categories. Recommendation Although students met the criterion, the CBT faculty decided to increase global content

across the college curriculum. Implementation College of Business and Technology has purchased a subscription for every student to

Bloomberg Businessweek. The faculty voted unanimously that the following courses will require readings that incorporate global contexts: Accounting for Management Control (ACCT 5320), Advanced Financial Management (FINA 5320), Leading and Managing People (MANA 5320), Advanced Marketing Fundamentals (MARK 5320) and Formulating and Implementing Strategy (MANA 5395). Faculty employed quizzes, in-class discussions, article summaries, blogs, discussion boards and other means of incorporating global/international content.


Objective 2: Students can assess and critique alternative sets of actions in a global context.


Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Course: Leading and Managing People (MANA 5320)

Number of Students Reviewed: 87 Assessment Tool: Case Study Analysis Criterion: 70% of students meet or exceed expectations Analysis Students failed to meet expectations in six out of eight areas.

o 92% of students met or exceeded expectations in demonstrating an understanding of the assignment’s purpose.

o 78% of students met or exceeded expectations in defining the issue. o 69% of students evaluated relevant points of view. o 52% of students gathered sufficient, credible and relevant information. o 59% of students accurately explained and used key concepts and made valid

assumptions. o 62% of students followed evidence to logical conclusions. o 56% of students identified significant implications or consequences.

Recommendation Increase global content across the CBT curriculum. In their search to fill two vacant

positions, the management faculty will attempt to hire someone with global/international experience.

Implementation See Businessweek initiative above under Objective One.

Search was completed during fall of 2011. Two international faculty were hired, one in Human Resource Management and one in Operations Management.


Learning Goal 4: Social Responsibility

Graduates have a fully-developed philosophy of social responsibility and are prepared to be good

citizens.

Objective 1: Students demonstrate knowledge of and can apply various Corporate Social Responsibility

concepts.


Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Course: Strategic Human Resources Management

(MANA 5350) Number of Students Reviewed: 88 Assessment Tool: Course Embedded Assessment Criterion: Students answer at least 80% of questions

correctly in each subject area Analysis Students answered 74% of questions regarding the Pyramid Scheme correctly.

Students answered 59% of questions regarding the Case against Corporate Social Responsibility correctly.

Students answered 82% of questions regarding Wikipedia correctly.

Students answered 57% of questions regarding Rethinking the Social Responsibility of Business correctly.

Students answered 76% of questions regarding Formulating and Implementing Strategy correctly.

Students answered 91% of questions regarding the Socially Responsible Business Quiz correctly.

Recommendation The Strategy and Policy faculty should develop a Corporate Social Responsibility module

and assessment for inclusion in a graduate level course beginning in the spring of 2012. Implementation The CSR module was used in Strategic Human Resource Management (MANA 5350) in

the spring of 2012. A random block multiple choice test was created and embedded in BlackBoard for administration by Strategy and Policy faculty.


Objective 2: Students demonstrate good citizenship by engaging in a service activity.


Semester Reviewed: Academic Year 2010-2011 Course: N/A

Number of Students Reviewed: 16 Assessment Tool: Survey Criterion: 100% of students participated in Community

Service during their master’s study Analysis 75% of students participated in Community Service during their master’s study. Recommendation Because this is the first year of measurement and catalog changes to implement this

Learning Objective are not yet in print, we will strive to increase student awareness and participation through verbal and web-enhanced communications.

Implementation Efforts will commence immediately beginning in the fall of 2011. Catalog copy outlining

this requirement was included in the 2011-2012 catalog.


Learning Goal 5: Ethical Courage

Graduates make ethical decisions.

Objective 1: Students analyze and critique ethical behavior.


Semester Reviewed: Spring 2011 Course: Accounting for Management Control

(ACCT 5320) Number of Students Reviewed: 50 Assessment Tool: Case Analysis Criterion: 70% of students meet or exceed expectations Analysis 100% of students met or exceeded expectations in clearly stating the ethical

dilemma, identifying the stakeholders involved, and using adequate reasoning to defend their position.

86% of students evaluated the ethical issues from multiple perspectives.

90% of students identified the ramifications of various solutions.

74% of students used proper spelling and grammar. Recommendation Case used for measurement was deficient. Suggest instructor find a new case for

analysis. Implementation A new case and rubric will be used beginning in the fall of 2011.

Objective 2: Students compare ethical codes and make ethical decisions.


Semester Reviewed: Spring 2011 Course: Accounting for Management Control

(ACCT 5320) Number of Students Reviewed: 50 Assessment Tool: Case Analysis Criterion: 70% of students meet or exceed expectations Analysis 100% of students met or exceeded expectations in clearly stating the ethical

dilemma, identifying the stakeholders involved, and using adequate reasoning to defend their position.

86% of students evaluated the ethical issues from multiple perspectives.

90% of students identified the ramifications of various solutions.

74% of students used proper spelling and grammar. Recommendation Case used for measurement was deficient. Suggest instructor find a new case for

analysis. Implementation A new case and rubric will be used beginning in the fall of 2011.

b.b.a. degree program assessment summaries - ut tyler mba - aol... · summaries of assessment...

Documents