dual language streams teaching in pharmaceutical education: evidence of comparability in assessment...

1
54.2% ± 13.1 35.0% (n = 30) 24.5% ± 5.1 57.5% ± 18.8 23.4% ± 7.0 20.0% (n = 23) 0.0% 50.0% 100.0% W hole C ourse (M ean ± SD ) M CQ Part(40 % oftotal m arks) Proportion 'B' grade and above M arks O btained English stream C hinese stream Problem and Methods: This study aims to determine whether parallel language streams teaching on common syllabus for an established pharmacology course can achieve comparable assessment results. The Advanced Certificate in Pharmacology and Pharmaceutical Management/ Administration program is used as the test case. This part-time sub-degree program has been offered for more than 15 years and teaching for pharmacology course is benchmarked against University Level 1 standard through external assessor appointment. In recent years, there is increasing heterogeneity of student background where clinic dispensing staff with sub-degree and below entry qualifications overtakes pharmaceutical business personnel as the major group of entrants (Table 1). As a result of this, the spread of student abilities in English has become marked and which necessitates a strategy of diversion at the point of admission to meet both pedagogic and equity considerations. Faced with this challenge, the Chinese stream was instituted in 2004. After 3 years of implementation, opportunity arises now to evaluate its effectiveness. The evaluation is based on the 2006 intake. Data analysis includes results of the Learning Evaluation Survey and the written examination. Difference between groups is compared by independent t-test. Introduction: The issue of medium of instruction for enhancing student learning has not attracted much attention in postsecondary education due to the predominant assumption that majority of teaching and assessment activities are hitherto conducted in English. Where there is an issue about student ability to cope with the language of instruction, remedial English language course is often prescribed as the solution. This approach may not work where the format of assessment involves assignment and essay type questions in the examination that require demonstration of higher order competencies in the use of English language. Moreover, in part-time higher education, there is little scope for offering additional language courses for weaker learners due to a variety of constraints such as cost, time and student motivation. Results and Discussion: Students’ perception of the appropriateness of content and level and the quality of teaching is found to be comparable in the two language streams (Fig. 1). This provides broad confidence that baseline parameters are similar despite that the two classes are taught by different teachers. It additionally complements the face validity assumed on the basis of using a common syllabus for teaching. Assessment results strongly suggest that the two groups are comparable in their average performance in the written examination (Fig. 2). At the course level, mean marks obtained are similar and not statistically significant, t(51)=- 0.751, p=0.456, while mean marks for the MCQ part also do not differ, t(51)=0.641, p=0.525. There is however a larger proportion of students obtaining ‘B’ grade or above in the English stream which may be due to the underlying difference in educational background where this group contains more students holding a bachelor degree or above qualifications upon entry. This academic level advantage may be translated into an edge in answering essay questions as compared to the group with only sub-degree or below qualifications. COLLEGE OF LIFE SCIENCES AND TECHNOLOGY, SPACE, UNIVERSIT Y OF HONG KONG Email: [email protected] success in implementing dual language streams teaching would depend on at least 3 factors that impinge on internal and external variables to the institution, viz.: teacher capacity, curriculum support and further study route/employer recognition. In the case of pharmacology which is a well established academic discipline, teaching staff with bilingual capability can be easily found. Besides, textbooks with good if not universal agreement on the subject matter are available in both languages. The real difficulty lies with seeking employer recognition for equivalency of qualifications irrespective of the medium of instructions. In Hong Kong, there is still a huge obstacle towards realizing parity of treatment because qualifications and awards given in English for technical subjects are prima facie considered to be of higher status. As course providers tend to follow prevailing thinking when deciding their course offering, there is naturally less scope for articulation to higher level courses if students in the Chinese stream choose to pursue further study. This can only be remedied if course providers stay committed to the opening of study Table 1 Cohort Characteristics (2006 intake) Figure 2 Comparison of Assessment Results for Pharmacology C ourse BENJAMIN TAK-YUEN CHAN English Stream Chinese Stream Gender M 36.4 % 14.8 % F 63.6 % 85.2 % Education Bachelor and above 48.5 % 3.7 % Subdegree and bel ow 51.5 % 96.3 % Occupation Pharmaceutical business personnel 51.5 % 25.9 % Clinic dispensing staff 24.3 % 55.6 % Others 24.2 % 18.5 % N (enrolled) 33 27 Completion (passing) rate 84.8 % 84.0 % DUAL LANGUAGE STREAMS TEACHING IN PHARMACEUTICAL EDUCATION: EVIDENCE OF COMPARABILITY IN ASSESSMENT OUTCOMES Conclusion: The accumulated experience of running dual language st reams teaching in a pharmacology course demonstrates t hat it is possible to achieve comparable assessment re sults while operating on a common syllabus and examina tion format. Of course, absolute comparability can on ly be assured if the same topics are taught by the sam e teachers and the exact exam paper is used as in a controlled study. On the practical side, 68.5% 66.1% 70.8% 71.2% M odule Effectiveness Score Teaching Effectiveness Score % A greem enton E ffe ctive n E nglish stream C hinese stream Figure 1 Comparison of Module and Teaching Effectiveness f or Pharmacology Course

Upload: benjamin-tak-yuen-chan

Post on 25-May-2015

104 views

Category:

Documents


4 download

DESCRIPTION

Poster Presented at International Conference on Language Issues in English-medium Universities: a global concern, HKU, HK, June 18-20, 2008

TRANSCRIPT

Page 1: Dual language streams teaching in pharmaceutical education: evidence of comparability in assessment outcomes

54.2%± 13.1

35.0%(n = 30)

24.5%± 5.1

57.5%± 18.8

23.4%± 7.0 20.0%

(n = 23)

0.0%

50.0%

100.0%

Whole Course(Mean ± SD)

MCQ Part (40 %of total marks)

Proportion 'B'grade and

above

Ma

rks

Ob

tain

ed

EnglishstreamChinesestream

Problem and Methods: This study aims to determine whether parallel language streams teaching on common syllabus for an established pharmacology course can achieve comparable assessment results. The Advanced Certificate in Pharmacology and Pharmaceutical Management/ Administration program is used as the test case. This part-time sub-degree program has been offered for more than 15 years and teaching for pharmacology course is benchmarked against University Level 1 standard through external assessor appointment. In recent years, there is increasing heterogeneity of student background where clinic dispensing staff with sub-degree and below entry qualifications overtakes pharmaceutical business personnel as the major group of entrants (Table 1). As a result of this, the spread of student abilities in English has become marked and which necessitates a strategy of diversion at the point of admission to meet both pedagogic and equity considerations. Faced with this challenge, the Chinese stream was instituted in 2004. After 3 years of implementation, opportunity arises now to evaluate its effectiveness.

The evaluation is based on the 2006 intake. Data analysis includes results of the Learning Evaluation Survey and the written examination. Difference between groups is compared by independent t-test.

Introduction:The issue of medium of instruction for enhancing student learning has not attracted much attention in postsecondary education due to the predominant assumption that majority of teaching and assessment activities are hitherto conducted in English. Where there is an issue about student ability to cope with the language of instruction, remedial English language course is often prescribed as the solution. This approach may not work where the format of assessment involves assignment and essay type questions in the examination that require demonstration of higher order competencies in the use of English language. Moreover, in part-time higher education, there is little scope for offering additional language courses for weaker learners due to a variety of constraints such as cost, time and student motivation.

Results and Discussion:Students’ perception of the appropriateness of content and level and the quality of teaching is found to be comparable in the two language streams (Fig. 1). This provides broad confidence that baseline parameters are similar despite that the two classes are taught by different teachers. It additionally complements the face validity assumed on the basis of using a common syllabus for teaching. Assessment results strongly suggest that the two groups are comparable in their average performance in the written examination (Fig. 2). At the course level, mean marks obtained are similar and not statistically significant, t(51)=-0.751, p=0.456, while mean marks for the MCQ part also do not differ, t(51)=0.641, p=0.525. There is however a larger proportion of students obtaining ‘B’ grade or above in the English stream which may be due to the underlying difference in educational background where this group contains more students holding a bachelor degree or above qualifications upon entry. This academic level advantage may be translated into an edge in answering essay questions as compared to the group with only sub-degree or below qualifications.

COLLEGE OF LIFE SCIENCES AND TECHNOLOGY, SPACE, UNIVERSITY OF HONG KONGEmail: [email protected]

success in implementing dual language streams teaching would depend on at least 3 factors that impinge on internal and external variables to the institution, viz.: teacher capacity, curriculum support and further study route/employer recognition. In the case of pharmacology which is a well established academic discipline, teaching staff with bilingual capability can be easily found. Besides, textbooks with good if not universal agreement on the subject matter are available in both languages. The real difficulty lies with seeking employer recognition for equivalency of qualifications irrespective of the medium of instructions. In Hong Kong, there is still a huge obstacle towards realizing parity of treatment because qualifications and awards given in English for technical subjects are prima facie considered to be of higher status. As course providers tend to follow prevailing thinking when deciding their course offering, there is naturally less scope for articulation to higher level courses if students in the Chinese stream choose to pursue further study. This can only be remedied if course providers stay committed to the opening of study opportunity in the language stream with deficiency of provision and actively communicate with employers on such new development.

Table 1 Cohort Characteristics (2006 intake)

Figure 2 Comparison of Assessment Results for Pharmacology Course

BENJAMIN TAK-YUEN CHAN

English Stream Chinese Stream

GenderM 36.4 % 14.8 %F 63.6 % 85.2 %

Education

Bachelor and above48.5 % 3.7 %

Subdegree and below51.5 % 96.3 %

Occupation

Pharmaceutical business personnel

51.5 % 25.9 %

Clinic dispensing staff

24.3 % 55.6 %

Others 24.2 % 18.5 %N (enrolled) 33 27

Completion (passing) rate

84.8 % 84.0 %

DUAL LANGUAGE STREAMS TEACHING IN PHARMACEUTICAL EDUCATION: EVIDENCE OF COMPARABILITY IN ASSESSMENT OUTCOMES

Conclusion:The accumulated experience of running dual language streams teaching in a pharmacology course demonstrates that it is possible to achieve comparable assessment results while operating on a common syllabus and examination format. Of course, absolute comparability can only be assured if the same topics are taught by the same teachers and the exact exam paper is used as in a controlled study. On the practical side,

68.5%

66.1%

70.8% 71.2%

Module Effectiveness Score Teaching EffectivenessScore

% A

gre

em

en

t o

n E

ffe

ctive

ne

ss

EnglishstreamChinesestream

Figure 1 Comparison of Module and Teaching Effectiveness for Pharmacology Course