Evaluative Research: Spanish Grammar Strategies Website

Talk for the Berkeley Language Center, 5 Feb 10

Communicating Grammatically: Evaluating a Learner Strategies Website for Spanish GrammarAndrew D. Cohen adcohen@umn.eduwith Angela Pinilla-Herrera pinil001@umn.edu, Jonathan Thompson thom2532@umn.edu,& Lance Witzig witz0043@umn.edu

1

1

Spanish Grammar Strategies Website The RationaleWhile attention is focused on the teaching of grammar, not very much attention is paid to how learners are to go about learning and performing it.

Grammar forms are not just magically acquired.

Learners encounter grammar forms that are problematic, regardless of how well they are presented in textbooks or in class.

At heart, learning depends on the student (Oxford & Lee, 2007).

2

[Oxford, R. L. & Lee, K. R. (2007). L2 grammar strategies: The second Cinderella and beyond. In A. D. Cohen & E. Macaro (Eds.), Language learner strategies: 30 years of research and practice (pp. 117-139). Oxford: Oxford University Press.]

2

Main Objective3This website is dedicated to the pursuit of ways to enhance learners control of Spanish grammar.

How?By providing examples of strategies that learners of Spanish have used successfully in their efforts to deal with problematic grammar. Grammar strategies are deliberate thoughts and actions that learners consciously employ in order to have better control of grammar structures.

3

Where did we find these grammar strategies?So, rather than being a repository of Spanish grammar rules (which can be found elsewhere on the web), this website is intended to offer a representative set of strategies for dealing with problematic grammar offered by numerous learners who have been there and done that successfully. (Weve checked to make sure that they do have control over the forms that theyve shared their strategies for.)

4From learners themselves: The website features strategies deployed successfully by learners, including strategies from nonnative teachers of Spanish who must learn and perform Spanish grammar if they are going to teach it to others.

4

Gathering the Strategies & Planning the WebsiteAugust of 2007 initial effort involving the design of online surveys (5 versions for learners [N=111] and 2 for instructors [N=24]) as to what they considered to be problematic grammar forms in Spanish. Subsequently, 28 students and 8 NNS teachers interviewed with videotaping, use of a Cyberpad and class notes.45 hours of taping produced 66 usable video-clips.Videotaping digitized.Project advisor, Rebecca Oxford.

5

5

Organization of the Website -http://www.carla.umn.edu/strategies/sp_grammarIntroduction Reasons for using strategies to learn and perform Spanish grammarDefinition and example of a grammar strategyQuestions to promote self-awareness of current language strategy usePurpose of the website Factors that influence the choice and effectiveness of grammar strategies

Learning Style Survey

Rationale for using particular strategies

Glossary

6

6

Im looking for a strategy that someone has used successfully to learn a specific grammar form.Im looking for strategies that match my learning style and that can apply to various grammar forms.7Organization of the WebsiteHow can I use this website?

7

Im looking for a strategy that someone has used successfully to learn a specific grammar form.

TensesPreteriteImperfectPreterite vs. imperfect MoodsSubjunctiveImperfect subjunctiveConditionalConditional perfect and pluperfect subjunctiveCommands

PronounsSimultaneous use of direct and indirect object pronounsReflexive pronouns in present perfect constructionsDirect and indirect object pronouns in affirmative and negative t commands Relative pronouns

8

8

Ser vs. EstarPor vs. paraNegative words SuperlativesHacer and desde in time expressionsOtherLo + adjectivesGender and number agreementGender of nounsDemonstrative adjectives9Im looking for a strategy that someone has used successfully to learn a specific grammar form.

9

10Im looking for strategies that match my learning style and that can apply to various grammar forms.

AuditoryRhymesSongs and chantsTalking to native speakers

VisualColor codingDecision mapsDrawings / mental imagesNote cardsPlaying with verbs

KinestheticPhysical behaviorsWriting it over

Memory aidsAcronymsInitials as a vehicle for mnemonicsPhrases as memory aidsPhrases as vehicles for syntax

Quasi-math formulasQuick grammar references

10

CognitiveEnglish sentences with Spanish syntaxEnglish sentences with Spanish words insertedFocusing on meaningLearning materials as a chunkLearning grammar by explaining it to others

Using archetypal sentencesUsing L1 to keep forms and functions straightContext-basedMaking associationsObserving use of the form in contextOtherAvoiding avoidanceCombining perceptual modes

11

11

Examples from the Website12

I need a strategyfor a particular grammar form.

12

Ser and estar(Main page)As a learner and user of Spanish, you need to deal with two main verbs used to express the English verb 'to be ser and estar. As you have probably discovered, deciding whether to use one form or the other can be a challenge. The following strategies have proven useful for many beginning learners.

When to use ser and estarAcronyms for the basic differencesObserving contextual use

When to use serAssociation by the first sound of the word

When to use estarA rhymeA phrase with an acronym in it

13

13

A phrase with an acronym in itA nonnative teacher uses "CLING to a star/estar" to help her students remember that estar is necessary when talking about:

Temporary conditions Lola est embarazada y su esposo est asustado.

Location La seccin de maternidad est en el segundo piso del hospital.

-ing forms in English El beb est llorando.

14Ser and estar (strategy)

A teacher uses "CLING to a star/estar" to help her students remember that estar is necessary when talking about:

Temporary conditions Example: Lola est embarazada y su esposo est asustado.'Lola is pregnant and her husband is scared.' (Lola's pregnancy is temporary since it lasts only 9 months.It is expected that her husband will stop being scared after a while.)

Location Example: La seccin de maternidad est en el segundo piso del hospital.'The maternity unit is on the second floor of the hospital.' (To reveal the location of the maternity unit, estar is required.)

-ing forms in EnglishExample: El beb est llorando. 'The baby is crying.'(To express ongoing -ing actions in English the auxiliary verbestar is always required in Spanish.)

14

15

I want strategies that fit my learning style preferences.

15

Verb endings and especially irregular forms can be challenging. Because they are not easily learned with simple rules, you have to figure out ways to memorize them. One way is through songs or chants.

16

Auditory

Songs and chants(Main page)A song (Irregular preterite forms)A song (Irregular t commands)A song (Negative t commands)A chant (Present tense forms)A chant (Preterite endings)A chant (Irregular t commands)A chant (Irregular subjunctive forms)

16

A song (Irregular t commands)A students, Sam, explains how singing the irregular t commands to the tune of Row, row, row your boat helps her remember the irregular forms. Notice that she uses repetition in her song to help her remember the forms.17

17

The Nature of the Website72 strategies found to be effective.Strategizing about the learning and use of Spanish grammar.Not a Spanish grammar website.Wide variety of strategies -- related to perceptual styles, cognitive strategies, memory strategies, and other strategies with defy classification.Rules of grammar or rules of thumb (Negueruela & Lantolf, 2006).

18

18

Research ProjectPurpose: To evaluate the effectiveness of the websiteUROP grant awarded to undergraduates Jonah Thompson and Lance Witzig in the Spring of 2007.Grant provided funds to offer participants gift certificates at the University bookstore.Unique niche for this study: researching strategies at a high level of specificity unlike in other studies where a strategy is much less fine-tuned e.g., I use a dictionary.

19

19

Research Questions1. To what extent do learners perceive the strategies that they select are helpful in improving their Spanish?2. What are the learners reasons for choosing the strategies that they chose?3. How are specific strategies received by learners?4. What are the learners overall impressions of the website?20

20

Research Design SampleRecruitment of participants: February 200915 students volunteered5 Spanish majors, 9 Spanish minors, 1 neither11 females, 4 malesMajority of students with intermediate mid proficiency recruited mainly from 5th-semester SpanishTwo 4th-semester studentsOne student preparing his final seminar project for the Spanish major.

21

21

TreatmentOrientation to website February, 2009How to use the websiteIntroduction to Strategy Tracking Form Participants were asked to fill in the tracking form only about the strategies they thought might be helpful to them.Participants had free rein of the Spanish Grammar Strategies Website22

22

InstrumentationOrientation to website and its rationale, purpose of research, Strategy Tracking FormFirst InterviewCollecting data on subjects experiences with the strategiesCollecting demographics on participants classes, major/minor, Spanish proficiencyReasons for studying Spanish, attitudes re grammar, learning style preferencesSecond Interview Update on previously reported strategies and report on new ones23

23

24

24

Data Collection ProceduresFrom 6 to 8 weeks, between orientation (February, 2009) and interviewsGoing over Strategy Tracking Forms Students reported on at least 4 strategies Interviews 20-25 minutes on the averageWitzig audio-taped most interviews, Thompson took notes on student responses

25

25

Procedures for Data AnalysisA three-point scale was used for rating the reported helpfulness in learning Spanish grammar that a given strategy provided: helpful, not helpful, and unclear (in cases where still no empirical evidence regarding the helpfulness of a strategy).Looked for student language positively describing the utility of the strategy for them, as well as evidence that they had actually used the strategy in order to determine whether the given strategy improved the subjects Spanish ability e.g., Elise: The rhyme completely cleared up any confusion I had been havingI use it all the time.26

26

1. To what extent did learners perceive the strategies that they had selected were helpful in improving their Spanish?

27Results

27

Most of the strategies selected (77 out of 106 73%) were perceived by the learners to be helpful and to have improved their control over certain aspects of Spanish grammar (see Table 1).

While learners varied in their approach to and perception of different strategies, nonetheless all learners benefited from at least three strategies found on the website.

28

28

29PERCEPTION REGARDING HELPFULNESS OF STRATEGIESStrategy perceived as helpfulStrategy perceived as unhelpfulUnclear (i.e., no empirical evidence yet)Total # of StrategiesMichiko9009Elise8008Molly81110Kallie7007Melanie6006Drew5139Mitch 5308Erin5409Amber4037Layla4105Abby4127Daniel3104Anne3205Libby3216Vick3216TOTALS77 (73%)18 (17%)11 (10%)106 (100%)

29

Perceived ImprovementClassroom tasks: activities, tests, and writing assignments Example:Melanie mentioned that she used the PRINT vs. LITE acronym while writing drafts of her papers to help distinguish when to use ser or estar. She also noted using this last strategy on a test: On our last Spanish exam we were working with ser vs. estar. It was on our study guide to go over the two in our book, but I found this strategy more helpful so I added it to my study guide instead and remembered PRINT and LITE on our test. I referred back to it during the test too and it helped me to correctly determine the situations where ser was needed, and the situations where estar was needed. 30

30

Ability and confidence: Using grammar forms that were at one time problematic or unclear Example:Abby noted that she consciously used a mnemonic device dealing with tu commands when she ordered food in Spanish.Kallieexplaining the usefulness of an acronym to help distinguish masculine and feminine nouns on a quiz:It really helps to just remember a few irregular endings for masculine and feminine nouns. We were tested on the gender of some irregular nouns on our first quiz and remembering these endings really helped. I got 100%.

Students reported being generally more strategic in the overall learning process.

31

31

322. What were the learners reasons for choosing the strategies that they chose?

32

Strategy SelectionExplicitly encouraged to use the website just as they would if left to their own devices.Found strong interest in seeking strategies for specific grammar forms, and particularly those which they struggled with or the forms that they were working on in class. 65 (61%) - strategies for specific grammar forms 41 (39%) - general strategiesNote: The distinction is a bit misleading since a fair portion of the strategies found through the general-strategy route nonetheless provided assistance with specific grammar forms.Individual variation

33

33

Approach to WebsiteIndividual variation in approaching the websiteMelanie: Initially spent 4-5 hours going through the majority of the strategies on the website and then focused only on those that really appealed to her.Abby: Visited the website fifteen minutes here and there looking for strategies that she needed for specific grammar forms, especially when writing papers.34

34

Learning Styles Linked to Strategy SelectionIndividual variation in how students used the website some casually browsing the website for appealing strategies, others going directly to strategies needed for specific forms, still others spending considerable time looking through all the strategies in sequence to choose the strategies that piqued their interest.Melanie: Visual learner for whom the first strategy was a decision map to distinguish between the preterite and the imperfect tense.Molly: Visual learner who reported using a strategy to write all of the strategies that she found appealing on note cards.

35

35

Daniel: Went straight to strategies for specific forms and form use, particularly relating to the subjunctive mood. Some students used their learning style preferences as a main factor in selecting strategies from the website.

[Note: At the time of the study, general strategies were not categorized by learning style preferences as they are now.]

36

36

3. How were specific strategies receivedby learners?37Positive Reception: 1. Auditory - rhyme keeping the different demonstrative adjectives straight

Elise: This is a simple rhyme that has completely cleared up any confusion I had been havingWhen I am writing any of the demonstrative adjectives (este, esta, ese, esa), I consciously think about this.Erin: The rhyme was catchy. It was very brief and it was easy to remember demonstrative adjectives. This is one of the problems I encounter when Im writing essays. I cant determine when to use estos and esos or if estes even exists. It helps me with many of my writing assignments. Many words I use in my papers are estos, estas, esos, ese, etc. Now I can easily apply this fun, catchy line to help me (remember) when to use such words.

37

2. Por vs. para distinction - using English equivalents for porKallie: I used this strategy on my test last week for the por vs. para section. For each blank, I translated what the sentence was saying and chose the right word based on the equivalents I studied. I got my test back and got them all right!Libby: Its a very simple method for remembering the uses of por, and then inferring when to use para based on those conclusions Its a way to remember the distinction without memorizing extensive definitions for both por and paraI consciously remember the definitions when I am writing.

38

38

Vick: It was color-coded, which kind of made it more aesthetically pleasing. I think it was nice because it was short, and it hadequivalents like by, through, in exchange for. This would have been super useful especially during the testAfter seeing it and practicing with it a little bit you kind of start to get a feel: Instead of thinking of por as always by, if you think of it as through, or in exchange for, it makes more sense and it would probably help kids out a lot. 3. Tense/aspect imperfect acronym: DUWIT Libby: Ive referred to the acronym to decide which tense to use. My % correct of fill-in-the-blank conjugation questions increased after using this strategy My pre-test worksheet = 50% correct [before adding this strategy], my exam = 100% correct.

39

39

Mixed Reception: 1. Ser-estar distinction: an acronym PRINT + LITE

Reported to be helpful Kathy: I definitely used this strategy when I was writing my mesa redonda [round table composition], especially because I had to also decide between pretrito and imperfect, so it was nice to be more certain about which (ser or estar) to use and then figure out which tense.Reported not to be helpful Mitch: I thought it could be useful, but realized that I have trouble remembering what the letters stand for Ill remember what the acronym is but not what each letter represents.

40

40

2. Auditory - memory aid - phrase (using Vin Diesel) to remember affirmative t commands

Reported to be helpful Drew: It is an acronym that I can remember fairly easily I have noticed that I am less hesitant when using the affirmative t commands The other day I was trying to tell one of the children in my class to do it, but I couldnt think of the affirmative t command for hacer, so I recalled the acronym and got haz.Reported to be unhelpful Layla: I know there are a few irregular commands so I wanted to find a strategy for them all Whats interesting is that I do remember this device; it sticks with me. I just choose not to use it. The way it sounds in my head does not at all relate to the irregulars: ven di sal haz ten ve pon s

41

41

4. What were the learnersoverall impressions of the website?42

42

The majority of subjects seemed to find the website useful and planned to go on using it throughout their Spanish studies. Others found it to be too simplistic and felt that it would be more appropriate for beginning learners, despite having gained more than two strategies that had high utility for them.Some students felt that their experience in classroom Spanish had taken them beyond the level where they needed to work on grammar, making them unwilling to search for helpful material. 43

43

When Drew took the time to search for material, he had a change of opinion:At first glance, I think since I am just about to graduate with my Spanish major, I thought it didn't really pertain to me. I guess I looked at some of those strategies and felt, Wow, what is the point of having these?'" But after we met that first time I realized that I might have been a little overconfident in some of my abilities, and after I went through and examined some of these I really saw the benefits of some of them.

44

44

Melanie: greater confidence in her grammatical control of Spanish actually increased her motivation towards Spanish. Molly: I would definitely recommend it for others. Abby expressed that, in addition to helping her with grammar, the website helped her become more aware of her learning style preferences. For Vick, since the website was missing strategies for many of the grammar points for which he needed assistance, it was not that appealing. But after spending time working with strategies from the website, he praised it for being very multidimensional and for catering to a variety of learners because it had acronyms, songs, videos, and chants.

45

45

Discussion Study to determine the impact of a Spanish grammar strategies website on the 15 learners who agreed to track their experiences with selected strategies over a period of from 6-8 weeks. Students perceptions tended to reflect positively on the website and on its potential for supporting students in remembering and using correctly various grammatical forms that had previously been problematic for them.

46

46

LimitationsNo verification as to whether the students Spanish grammar actually improved by virtue of using strategies from the website.A select sample only those who chose to be in the study.Motivation to use strategies due in part to the three bookstore gift certificates.The sample lacked diversity mostly similar in class level, gender, and major/minor. Students only asked to select strategies that they found appealing.Not enough time for them employ some of the strategies extensively or at all.

47

47

InterpretationCould interpret positive responses to strategies on the website as a result of the students freedom to self-select strategies based on their interests and needs hence, strategies consistent with their learning style preferences, personality, and other factors. In addition, the positive contribution of certain strategies may only show up with more extended use of the website.

48

48

Suggestions for Future Research

Assess the actual gain in grammatical control as a result of the use of given strategies. Incorporate teacher feedback into a study of how learners use the website.Determine the experience of students using the website when they are not remunerated for doing so, perhaps by making it a requirement in a given Spanish course, and ideally over a substantial period of time (e.g., a semester or more).49

49

Pedagogical ImplicationsIntention of the website to give learners a venue for improving their grammatical control on their own out of class up to the teachers to determine how to best incorporate the website into the current instructional program.Another pedagogical implication would be to ensure that learners are adequately aware of their learning style preferences in order to benefit from the general strategies section of the website.50

50