california state university, fullerton assessment conference xix presentation on business assessment...

California State University, FullertonASSESSMENT CONFERENCE XIX

Presentation onBusiness Assessment Test

BATJay Grosflam

Assessment & AccreditationCalifornia State University, Long Beach

March 20, 2015OFFICE - 562.985.5698CELL – 310.498.2332

[email protected]

BAT developed in 2004. New 2015 BAT test in place for online or paper version. Results used for AACSB accreditation and Assurance of Learning. BAT tests for Business Functions / Quantitative & Technical

Skills 17,698 tests given to date. 2013 – 1374 tests given. 2014 – 2956 tests given. 2015 – Number of California schools increasing – in talks with UC

schools and private Universities in / out of California.

Business Assessment Test2015

ACCOUNTANCY INTERNATIONAL ECONOMICS ETHICS FINANCE MANAGEMENT OPTIONAL: INFORMATION SYSTEMSBUSINESS LAW MARKETING SUPPLY CHAIN MANAGEMENT STATISTICS ~ Universities can request all, or a MANAGEMENT subgroup of segments, with

more segments being developed

BAT Subject Coverage

Critical Thinking Ethics Team & Interpersonal Skills Communication Skills Business Functions – tested by BAT Quantitative & Technical Skills – tested

by BAT Domestic & Global Environment

CSULB undergraduate Learning Goals for AACSB

Create a benchmark for Business schools to compare and evaluate student learning effectiveness.

Develop a knowledge test for undergraduate students in California.

BAT - Assesses Business Function / Quantitative Skills in the Assurance of Learning for AACSB.

Assessment results provide valuable program input to improve the learning experience and Close the Loop.

Cost effective assessment ($5 per test – revenue neutral) to support AACSB Assurance of Learning.

I offer my assistance to show how we incorporate BAT results AACSB Assurance of Learning usage.

BAT Purpose

11 years of successful implementation. Since 2004. Localized questions for the California State University system. Customizable BAT test to your particular requirements. Preview of all test question. Quick turnaround of customizable results. End data usable for AACSB Assurance of Learning

requirement. Results used in over 15 separate university AACSB

accreditation Assurance of Learning reports.

BAT Strengths

AOL ProcessMission

Learning Goal

Learning Objective

Develop Measurement

Collect Pilot Data

Analyze Data

Identify Needed Improvements

Implement Improvements

Collect Data

Evaluate Improvements

Close the loop

Measure 1

Measure 2

Direct versus Indirect AssessmentDirect = Student work - Exams, projects, papers, portfolios.Indirect = Business Assessment Test Elective versus Core Course AssessmentDid you know…? Program level Assessment versus Course Level

AssessmentAssessment of learning focuses on the results of a PROGRAM

AACSB Assessment

Intro to IS Intro to Marketing Intro to Finance Intro to Management Intro to Statistics

Classes a student could have taken

SFSU CSU Humboldt CSUN CSU East Bay CSU Sonoma Hong Kong Baptist

University CSU San Marcos CSU Long Beach CSU Bakersfield CSU Stanislaus Cal Poly SLO CSU Dominguez Hills CSU San Bernardino SJSU

Participating Universities

Q4 2014 N ACCT ECON FIN BLAW MGMT MIS MKTG STAT SCM INTLETHIC

S1 131 48.31 50.34 54.87 34.88 68.81 51.44 57 48.46 50.38 57.69 902 1068 48.03 50.61 53.78 45.55 65.6 48.51 58.01 51.35 54.56 48.65 86.43 194 30.64 41.13 39.2 24.47 57.64 41.5 43.19 38.51 47.87 42.13 82.984 38 48.65 43.24 55.86 36.82 70.52 55.07 54.86 52.97 58.11 47.57 86.49

CSULB 167 45.87 50.26 55.39 39.99 71.31 50.28 63.64 51.93 54.86 45.73 92.195 910 43.95 45.34 43.95 37.72 60.88 47.49 45.94 45.94 48.36 42.57 87.446 259 46.885 47.1 53.835 38.615 66.65 55.8 60.76 47.23 54.57 44.105 93.21

2715 AVERAGE

CSU % PER

SEGMENT AY 2013 -

14

48.76 46.16 55.68 38.14 70.58 54.23 59.3 52.87 56.6 40.86 91.48

BAT 2014

IDOverall Score - 80

Q's ACCT ECON FIN BLAW MGMT MIS MKTG STAT SCM INTL ETHICS104850094 40.00% 28.57% 87.50% 75.00% 25.00% 14.29% 14.29% 14.29% 42.86% 42.86% 42.86% 42.86%000148842 57.50% 28.57% 75.00% 75.00% 12.50% 57.14% 42.86% 71.43% 28.57% 85.71% 85.71% 71.43%104874872 57.50% 28.57% 75.00% 37.50% 25.00% 57.14% 71.43% 85.71% 42.86% 57.14% 71.43% 85.71%

104262572 78.75% 57.14%100.00

% 87.50% 37.50%100.00

% 85.71%100.00

% 57.14% 57.14% 85.71%100.00

%104397512 57.50% 42.86% 87.50% 62.50% 37.50% 57.14% 71.43% 71.43% 28.57% 28.57% 71.43% 71.43%101690067 33.75% 28.57% 25.00% 50.00% 25.00% 42.86% 42.86% 28.57% 42.86% 14.29% 57.14% 14.29%

102992641 75.00% 71.43% 50.00% 75.00% 37.50% 71.43%100.00

% 71.43% 71.43%100.00

% 85.71%100.00

%103454635 53.75% 57.14% 75.00% 25.00% 25.00% 85.71% 71.43% 57.14% 28.57% 28.57% 71.43% 71.43%104341040 60.00% 57.14% 75.00% 75.00% 37.50% 57.14% 71.43% 71.43% 14.29% 42.86% 85.71% 71.43%

CSUX Average 44.44% 72.22% 62.50% 29.17% 60.32% 63.49% 63.49% 39.68% 50.79% 73.02% 69.84%CSU Average 48.76% 46.16% 55.68% 38.14% 70.58% 54.23% 59.30% 52.87% 56.60% 40.86% 91.48%

Closing the loop

How many students meet or exceed expectations?

Almost all Reinforce

Celebrate!

Not enough Improve: Where are the deficiencies?Curriculum changes?Possible remedies?

Closing the loop

Possible remedies: Modified courses or new books – Disagree = 68% Agree =

14% A change in delivery technology – Disagree = 11% Agree =

75% Changing an learning objective – Disagree = 46% Agree =

36% Raising admission standards - Disagree = 57% Agree = 36% Faculty development

Info derived from: Ethics and Business Law Faculty Publications Closing the loop in assurance of learning programs: Current

practices and future challenges. University of St. Thomas, Minnesota UST Research Online – 2013, page 282.

Effective assessment programs should…

Flow from mission or strategic plan Have faculty ownership and

responsibility Rely on multiple measures Provide useful feedback Lead to improvement Have institution-wide support (including

budget) Be cost effective

Accounting: The right to receive money in the future is called a(n)

a. account payable.b. account receivable.c. liability.d. revenue.

Which of the following is not considered an asset?a. Equipmentb. Dividendsc. Accounts receivabled. Inventory

Economics: Economists assume that individuals:

a. are rational and respond to incentives.b. prefer to live in a society that values fairness above all else.c. behave in unpredictable ways.d. will never take actions to help others.

Rent control is an example of a. a price floor.b. a price ceiling. c. a subsidy for low-skilled workers.d. a black market.

Sample Questions – 1 / 5

Accounting: The right to receive money in the future is called a(n)

a. account payable.b. account receivable.c. liability.d. revenue.

Which of the following is not considered an asset?a. Equipmentb. Dividendsc. Accounts receivabled. Inventory

Economics: Economists assume that individuals

a. are rational and respond to incentives.b. prefer to live in a society that values fairness above all else.c. behave in unpredictable ways.d. will never take actions to help others.

Rent control is an example of a. a price floor.b. a price ceiling. c. a subsidy for low-skilled workers.d. a black market.

Sample Questions with answers

Finance: Which of the following sources of capital is generally the most expensive for an average corporation?

a. Newly issued common stock.b. Long-term bonds.c. Preferred stock.d. Short-term notes payable.

In general, which of the following is likely to occur if you randomly add stocks to your portfolio which presently consists of three stocks?

a. The company-specific risk of your portfolio will probably decline.b. The expected return of your portfolio will decline.c. The market risk of your portfolio will rise.d. The expected return of your portfolio will rise.

Management: Organizations needs to adopt _______ when environmental uncertainty increases

a. work specialization b. decentralizationc. centralizationd. tight vertical control

When Google acquired Motorola Mobility, it was pursuing a _____.a. corporate-level strategyb. business-level strategyc. functional-level strategyd. multi-domestic strategy


Information Systems: Information systems that process purchasing orders, billing, payroll, etc. are called:

a. Decision support systems.b. Transaction processing systems.c. Expert systems.d. Functional systems.

_____ is by far the most popular language for creating and manipulating databases.a. XML

b. HTMLc. PHPd. SQL

Marketing: The stages of the product life cycle, in order, are:

a. introduction, maturity, declineb. introduction, growth, maturity, declinec. growth, maturity, plateau, declined. innovation, early adoption, late adoption, laggard

Which marketing management philosophy focuses on the question, “What do customers want and need?”

a. Sales Orientationb. Production Orientationc. Product Orientationd. Market Orientation


Statistics: What type of sampling method should be used when accuracy and generalizability of findings is a

primary concern?a. Randomb. Judgmentc. Convenience d. Quota

In a hypothesis test, the p-value was calculated as 0.025. If the level of significance is, α = 0.05, what is the decision regarding the null hypothesis test?

a. Reject the null hypothesis.b. Do not reject the null hypothesis.c. No definitive conclusion can be made.d. In a hypothesis test, p-value and level of significance has no relationship.

International: The price of a currency stated in units of another currency is the:

a. London interbank rate.b. international money rate.c. exchange rate.d. money market rate.

An equity-based joint venture exemplifies which type of entry strategy?a. strategic allianceb. licensingc. exportingd. wholly owned subsidiary


Ethics: What do economists call the situation where a hired manager does not have the same interests

as the owners of the business?a. conquest and control b. a financial intermediary problemc. a principal-agent problem d. a financial problem

Under stakeholder theory, a decision with ethical consequences would consider the impact to which stakeholder?

a. Shareholdersb. Customersc. The local community where the business is located

d. All of the above


Ethics: What do economists call the situation where a hired manager does not have the same interests

as the owners of the business?a. conquest and control b. a financial intermediary problemc. a principal-agent problem d. a financial problem

Under stakeholder theory, a decision with ethical consequences would consider the impact to which stakeholder?

a. Shareholdersb. Customersc. The local community where the business is locatedd. All of the above


Questions?

Thank you very much

california state university, fullerton assessment conference xix presentation on business assessment...

Documents

assessment results

learning experience

customizable bat test

student learning effectiveness

business schools

program level assessment

program aacsb assessmentintro

test question