california state university, fullerton assessment conference xix presentation on business assessment...
Post on 30-Dec-2015
233 Views
Preview:
TRANSCRIPT
California State University, FullertonASSESSMENT CONFERENCE XIX
Presentation onBusiness Assessment Test
BATJay Grosflam
Assessment & AccreditationCalifornia State University, Long Beach
March 20, 2015OFFICE - 562.985.5698CELL – 310.498.2332
jay.grosflam@csulb.edu
BAT developed in 2004. New 2015 BAT test in place for online or paper version. Results used for AACSB accreditation and Assurance of Learning. BAT tests for Business Functions / Quantitative & Technical
Skills 17,698 tests given to date. 2013 – 1374 tests given. 2014 – 2956 tests given. 2015 – Number of California schools increasing – in talks with UC
schools and private Universities in / out of California.
Business Assessment Test2015
ACCOUNTANCY INTERNATIONAL ECONOMICS ETHICS FINANCE MANAGEMENT OPTIONAL: INFORMATION SYSTEMSBUSINESS LAW MARKETING SUPPLY CHAIN MANAGEMENT STATISTICS ~ Universities can request all, or a MANAGEMENT subgroup of segments, with
more segments being developed
BAT Subject Coverage
Critical Thinking Ethics Team & Interpersonal Skills Communication Skills Business Functions – tested by BAT Quantitative & Technical Skills – tested
by BAT Domestic & Global Environment
CSULB undergraduate Learning Goals for AACSB
Create a benchmark for Business schools to compare and evaluate student learning effectiveness.
Develop a knowledge test for undergraduate students in California.
BAT - Assesses Business Function / Quantitative Skills in the Assurance of Learning for AACSB.
Assessment results provide valuable program input to improve the learning experience and Close the Loop.
Cost effective assessment ($5 per test – revenue neutral) to support AACSB Assurance of Learning.
I offer my assistance to show how we incorporate BAT results AACSB Assurance of Learning usage.
BAT Purpose
11 years of successful implementation. Since 2004. Localized questions for the California State University system. Customizable BAT test to your particular requirements. Preview of all test question. Quick turnaround of customizable results. End data usable for AACSB Assurance of Learning
requirement. Results used in over 15 separate university AACSB
accreditation Assurance of Learning reports.
BAT Strengths
AOL ProcessMission
Learning Goal
Learning Objective
Develop Measurement
Collect Pilot Data
Analyze Data
Identify Needed Improvements
Implement Improvements
Collect Data
Evaluate Improvements
Close the loop
Measure 1
Measure 2
Direct versus Indirect AssessmentDirect = Student work - Exams, projects, papers, portfolios.Indirect = Business Assessment Test Elective versus Core Course AssessmentDid you know…? Program level Assessment versus Course Level
AssessmentAssessment of learning focuses on the results of a PROGRAM
AACSB Assessment
Intro to IS Intro to Marketing Intro to Finance Intro to Management Intro to Statistics
Classes a student could have taken
SFSU CSU Humboldt CSUN CSU East Bay CSU Sonoma Hong Kong Baptist
University CSU San Marcos CSU Long Beach CSU Bakersfield CSU Stanislaus Cal Poly SLO CSU Dominguez Hills CSU San Bernardino SJSU
Participating Universities
Q4 2014 N ACCT ECON FIN BLAW MGMT MIS MKTG STAT SCM INTLETHIC
S1 131 48.31 50.34 54.87 34.88 68.81 51.44 57 48.46 50.38 57.69 902 1068 48.03 50.61 53.78 45.55 65.6 48.51 58.01 51.35 54.56 48.65 86.43 194 30.64 41.13 39.2 24.47 57.64 41.5 43.19 38.51 47.87 42.13 82.984 38 48.65 43.24 55.86 36.82 70.52 55.07 54.86 52.97 58.11 47.57 86.49
CSULB 167 45.87 50.26 55.39 39.99 71.31 50.28 63.64 51.93 54.86 45.73 92.195 910 43.95 45.34 43.95 37.72 60.88 47.49 45.94 45.94 48.36 42.57 87.446 259 46.885 47.1 53.835 38.615 66.65 55.8 60.76 47.23 54.57 44.105 93.21
2715 AVERAGE
CSU % PER
SEGMENT AY 2013 -
14
48.76 46.16 55.68 38.14 70.58 54.23 59.3 52.87 56.6 40.86 91.48
BAT 2014
IDOverall Score - 80
Q's ACCT ECON FIN BLAW MGMT MIS MKTG STAT SCM INTL ETHICS104850094 40.00% 28.57% 87.50% 75.00% 25.00% 14.29% 14.29% 14.29% 42.86% 42.86% 42.86% 42.86%000148842 57.50% 28.57% 75.00% 75.00% 12.50% 57.14% 42.86% 71.43% 28.57% 85.71% 85.71% 71.43%104874872 57.50% 28.57% 75.00% 37.50% 25.00% 57.14% 71.43% 85.71% 42.86% 57.14% 71.43% 85.71%
104262572 78.75% 57.14%100.00
% 87.50% 37.50%100.00
% 85.71%100.00
% 57.14% 57.14% 85.71%100.00
%104397512 57.50% 42.86% 87.50% 62.50% 37.50% 57.14% 71.43% 71.43% 28.57% 28.57% 71.43% 71.43%101690067 33.75% 28.57% 25.00% 50.00% 25.00% 42.86% 42.86% 28.57% 42.86% 14.29% 57.14% 14.29%
102992641 75.00% 71.43% 50.00% 75.00% 37.50% 71.43%100.00
% 71.43% 71.43%100.00
% 85.71%100.00
%103454635 53.75% 57.14% 75.00% 25.00% 25.00% 85.71% 71.43% 57.14% 28.57% 28.57% 71.43% 71.43%104341040 60.00% 57.14% 75.00% 75.00% 37.50% 57.14% 71.43% 71.43% 14.29% 42.86% 85.71% 71.43%
CSUX Average 44.44% 72.22% 62.50% 29.17% 60.32% 63.49% 63.49% 39.68% 50.79% 73.02% 69.84%CSU Average 48.76% 46.16% 55.68% 38.14% 70.58% 54.23% 59.30% 52.87% 56.60% 40.86% 91.48%
Closing the loop
How many students meet or exceed expectations?
Almost all Reinforce
Celebrate!
Not enough Improve: Where are the deficiencies?Curriculum changes?Possible remedies?
Closing the loop
Possible remedies: Modified courses or new books – Disagree = 68% Agree =
14% A change in delivery technology – Disagree = 11% Agree =
75% Changing an learning objective – Disagree = 46% Agree =
36% Raising admission standards - Disagree = 57% Agree = 36% Faculty development
Info derived from: Ethics and Business Law Faculty Publications Closing the loop in assurance of learning programs: Current
practices and future challenges. University of St. Thomas, Minnesota UST Research Online – 2013, page 282.
Effective assessment programs should…
Flow from mission or strategic plan Have faculty ownership and
responsibility Rely on multiple measures Provide useful feedback Lead to improvement Have institution-wide support (including
budget) Be cost effective
Accounting: The right to receive money in the future is called a(n)
a. account payable.b. account receivable.c. liability.d. revenue.
Which of the following is not considered an asset?a. Equipmentb. Dividendsc. Accounts receivabled. Inventory
Economics: Economists assume that individuals:
a. are rational and respond to incentives.b. prefer to live in a society that values fairness above all else.c. behave in unpredictable ways.d. will never take actions to help others.
Rent control is an example of a. a price floor.b. a price ceiling. c. a subsidy for low-skilled workers.d. a black market.
Sample Questions – 1 / 5
Accounting: The right to receive money in the future is called a(n)
a. account payable.b. account receivable.c. liability.d. revenue.
Which of the following is not considered an asset?a. Equipmentb. Dividendsc. Accounts receivabled. Inventory
Economics: Economists assume that individuals
a. are rational and respond to incentives.b. prefer to live in a society that values fairness above all else.c. behave in unpredictable ways.d. will never take actions to help others.
Rent control is an example of a. a price floor.b. a price ceiling. c. a subsidy for low-skilled workers.d. a black market.
Sample Questions with answers
Finance: Which of the following sources of capital is generally the most expensive for an average corporation?
a. Newly issued common stock.b. Long-term bonds.c. Preferred stock.d. Short-term notes payable.
In general, which of the following is likely to occur if you randomly add stocks to your portfolio which presently consists of three stocks?
a. The company-specific risk of your portfolio will probably decline.b. The expected return of your portfolio will decline.c. The market risk of your portfolio will rise.d. The expected return of your portfolio will rise.
Management: Organizations needs to adopt _______ when environmental uncertainty increases
a. work specialization b. decentralizationc. centralizationd. tight vertical control
When Google acquired Motorola Mobility, it was pursuing a _____.a. corporate-level strategyb. business-level strategyc. functional-level strategyd. multi-domestic strategy
Sample Questions – 2 / 5
Finance: Which of the following sources of capital is generally the most expensive for an average corporation?
a. Newly issued common stock.b. Long-term bonds.c. Preferred stock.d. Short-term notes payable.
In general, which of the following is likely to occur if you randomly add stocks to your portfolio which presently consists of three stocks?
a. The company-specific risk of your portfolio will probably decline.b. The expected return of your portfolio will decline.c. The market risk of your portfolio will rise.d. The expected return of your portfolio will rise.
Management: Organizations needs to adopt _______ when environmental uncertainty increases
a. work specialization b. decentralizationc. centralizationd. tight vertical control
When Google acquired Motorola Mobility, it was pursuing a _____.a. corporate-level strategyb. business-level strategyc. functional-level strategyd. multi-domestic strategy
Sample Questions with answers
Information Systems: Information systems that process purchasing orders, billing, payroll, etc. are called:
a. Decision support systems.b. Transaction processing systems.c. Expert systems.d. Functional systems.
_____ is by far the most popular language for creating and manipulating databases.a. XML
b. HTMLc. PHPd. SQL
Marketing: The stages of the product life cycle, in order, are:
a. introduction, maturity, declineb. introduction, growth, maturity, declinec. growth, maturity, plateau, declined. innovation, early adoption, late adoption, laggard
Which marketing management philosophy focuses on the question, “What do customers want and need?”
a. Sales Orientationb. Production Orientationc. Product Orientationd. Market Orientation
Sample Questions – 3 / 5
Information Systems: Information systems that process purchasing orders, billing, payroll, etc. are called:
a. Decision support systems.b. Transaction processing systems.c. Expert systems.d. Functional systems.
_____ is by far the most popular language for creating and manipulating databases.a. XML
b. HTMLc. PHPd. SQL
Marketing: The stages of the product life cycle, in order, are:
a. introduction, maturity, declineb. introduction, growth, maturity, declinec. growth, maturity, plateau, declined. innovation, early adoption, late adoption, laggard
Which marketing management philosophy focuses on the question, “What do customers want and need?”
a. Sales Orientationb. Production Orientationc. Product Orientationd. Market Orientation
Sample Questions with answers
Statistics: What type of sampling method should be used when accuracy and generalizability of findings is a
primary concern?a. Randomb. Judgmentc. Convenience d. Quota
In a hypothesis test, the p-value was calculated as 0.025. If the level of significance is, α = 0.05, what is the decision regarding the null hypothesis test?
a. Reject the null hypothesis.b. Do not reject the null hypothesis.c. No definitive conclusion can be made.d. In a hypothesis test, p-value and level of significance has no relationship.
International: The price of a currency stated in units of another currency is the:
a. London interbank rate.b. international money rate.c. exchange rate.d. money market rate.
An equity-based joint venture exemplifies which type of entry strategy?a. strategic allianceb. licensingc. exportingd. wholly owned subsidiary
Sample Questions – 4 / 5
Statistics: What type of sampling method should be used when accuracy and generalizability of findings is a
primary concern?a. Randomb. Judgmentc. Convenience d. Quota
In a hypothesis test, the p-value was calculated as 0.025. If the level of significance is, α = 0.05, what is the decision regarding the null hypothesis test?
a. Reject the null hypothesis.b. Do not reject the null hypothesis.c. No definitive conclusion can be made.d. In a hypothesis test, p-value and level of significance has no relationship.
International: The price of a currency stated in units of another currency is the:
a. London interbank rate.b. international money rate.c. exchange rate.d. money market rate.
An equity-based joint venture exemplifies which type of entry strategy?a. strategic allianceb. licensingc. exportingd. wholly owned subsidiary
Sample Questions with answers
Ethics: What do economists call the situation where a hired manager does not have the same interests
as the owners of the business?a. conquest and control b. a financial intermediary problemc. a principal-agent problem d. a financial problem
Under stakeholder theory, a decision with ethical consequences would consider the impact to which stakeholder?
a. Shareholdersb. Customersc. The local community where the business is located
d. All of the above
Sample Questions – 5 / 5
Ethics: What do economists call the situation where a hired manager does not have the same interests
as the owners of the business?a. conquest and control b. a financial intermediary problemc. a principal-agent problem d. a financial problem
Under stakeholder theory, a decision with ethical consequences would consider the impact to which stakeholder?
a. Shareholdersb. Customersc. The local community where the business is locatedd. All of the above
Sample Questions with answers
top related