Evaluation Report

14.07.2011

MTV Staying Alive Foundation

“AIDS don’t know about discrimination. Protect yourself!”

01.07.2010-30.06.2011

By: Bethany Weymer

Executive member of RROMA

1

I. Summary:

The Regional Roma Educational Youth Association (RROMA), based out of Kratovo,

Macedonia, has concluded the first year of its partnership with MTV’s Staying Alive

Foundation. The following report includes a general synapses of the events that

transpired throughout the duration of the campaign, the affect and effectiveness of the

implementation of the events on the communities and schools directly involved in the

campaign, strengths and weaknesses related to the campaign, areas to be improved

upon as well as future objectives to be addressed in subsequent phases of the

partnership.

This evaluation is meant to serve as a brief overview, to both the participants and

stakeholders of the campaign, of the events and actions that took place under the

awareness campaign title “AIDS doesn’t know about discrimination. Protect yourself!”

from the 1st of July, 2010 and lasting until the 30th of June, 2011. At the time of

compilation, the data from the questionnaires distributed during the campaign was still

being analyzed. For this reason, the evaluation lacks quantitative statistics and will

instead focus on a more qualitative evaluation approach.

Overall, the campaign was thought to be a success by participants, educational

institutions and communities directly involved in the project. Over 3,000 people in six

communities throughout the north eastern region of the Republic of Macedonia were

directly exposed to/involved with the awareness campaign. This includes but is not

limited to: participants in secondary school training workshops, observers of street

actions and outdoor workshops, recipients of informative brochures and fliers, visitors

to RROMA’s website, observers of online videos documenting actions from the

campaign, as well as over 600 pre-test and 600 post-test questionnaires completed by

students and local citizens.

2

II. Introduction:

This report will assess the major components of the campaign including the distribution

of 100 questionnaires in each of the six participating communities (Kratovo, Probistip,

Vinica, Berovo, Veles and Kocani), the two-day training workshop of RROMA’s youth to

become peer educators, distribution of informative brochures on World AIDS day,

workshops in secondary schools of each community, the two day comic-book workshop

and the final grand event in Kratovo, Macedonia. Additionally, the role of RROMA’s

executive board, RROMA’s 12 peer educators, partnering organizations as well as

influential community leaders will be addressed. The roll of the $10,500.00 USD allotted

budget will not be addressed in this assessment as separate financial reports and audits

are being prepared separately.

This assessment is particularly relevant as RROMA has recently been approved to extend

their campaign with the Staying Alive Foundation for an additional three years. The

campaign will be conducted in three phases, each one spanning into a different

geographic region of the country. The success/failures of this initial phase are important

to realize in order to ensure the succeeding phases will run smoothly and be

implemented properly for maximum effectiveness.

III. Activities of the Campaign:

A. Distribution of 100 questionnaires in each of the six schools in the north eastern region of Macedonia: Kratovo, Probistip, Vinica, Berovo, Veles and Kocani. Each of the three youth leaders was given 200 questionnaires and distributed 100 of them in each community. Additionally, in Berovo and Vinica, a portion of the one hundred questionnaires were distributed in Roma communities. This action was completed in the same manner after each training in each respective community.

B. Training of 12 RROMA youth peer educators in Probistip.

3

a. HERA, an HIV/AIDS related NGO based out of the capital city of Skopje, Macdonia, trained and certified one of our youth leaders in an HIV/AIDS awareness seminar. She was provided with credible information through this workshop and transferred the knowledge gained there to her peers in order for them to also become peer educators.

b. The two-day workshop in Probistip, Macedonia was conducted by three RROMA youth delegates (lead by Merlin, the young woman who received the certificate). The information provided to their peers was accurate and their approach was interactive and creative. The youth trainers ensured that their peers grasped the content completely as they would later be the instructors in their respective communities’ school. The trainers came to the event prepared with their information and took their responsibility seriously. Information was transferred and proper condom application was demonstrated using bananas.

C. Distribution of informative brochures on World AIDS day (December 1st, 2010).

a. Five members of RROMA went around the community of Kratovo and distributed informative brochures on HIV/AIDS. The brochures contained information about HIV/AIDS, facts about transmission and prevention. The brochures as well as red ribbon stickers with the slogan of the awareness campaign were given to local high school students, influential people around town such as the mayor and school board members, as well as other pedestrians.

b. Most people accepted the information brochure when handed one. However, the effectiveness of this cannot be ensured as it is uncertain whether or not community members actually reviewed the content of the brochure. Little resistance was met while completing this action which shows the receptiveness of the community to the issue in general.

D. In-school trainings in Kratovo, Probistip, Vinica, Berovo, Veles and Kocani. In total 245 male and female students ranging from 14-18 years of age participated in the 60 minute trainings.

4

a. Trainings were conducted in each respective community’s secondary school by RROMA peer educators (previously trained at the two-day Probistip workshop). Attendance for the trainings was arranged by school pedagogies.

b. Content of the trainings included the following: AIDS/HIV awareness, protection and prevention, STD facts and statistics, proper condom usage (this was demonstrated again on bananas and student volunteers were asked to demonstrate after the initial proper application was shown), HIV transmission.

c. Students were given informative brochures that were distributed on World AIDS Day as well as contact information for RROMA if they had further questions or comments in regard to the training.

d. Students were generally attentive to the material and handled the sensitive subject with maturity.

e. Aside from the condom demonstration, the trainings were not very interactive. Perhaps more dialogue could have been exchanged between trainers and students. In order for this to be possible, a longer workshop would be necessary, which may not be possible to do during an actual school day. May need to rethink the time and duration of in-school trainings.

E. Comic Drawing Workshop.

a. Five RROMA youth were trained in Kratovo, Macedonia on the 27th and 28th of March, 2011.

b. The workshop took place at the local House of Culture/ Museum of Kratovo (the venue was free of charge to RROMA). Youth were trained in comic book design and creation. As the weather was nice the weekend of the workshop, the youth drew their comics on the outside patio area of the premises. This made the workshop visible to the community and attracted attention to the campaign. A local field trip of approximately 30 primary school children came to the museum and became engaged in the workshop and the comic drawings.

5

c. The comics were later published and distributed at the large closing event on the 11th of June. This was a creative way to educate and inform local citizens. It also allowed RROMA youth to use critical thinking skills.

F. Big Event in Kratovo.

a. RROMA hosted “Staying Alive Festival” in Kratovo on the 11th of June, 2011. The event consisted of two parts:

i. Street actions in the town’s center; including a flash mob, frozen town, graffiti artists and distribution of informative brochures and HIV/AIDS comic strips from inside of a giant condom. The street actions were meant to draw attention to the campaign and attract as many people as possible for maximum information distribution. Also to inform the community of the concert event (part II), which occurred later in the evening.

ii. Concert Event: Occurred on a stage at the town’s House of Culture/Museum (use of the venue was free of charge). It consisted of a fashion show of the final project of some of RROMA’s university students who are studying fashion design. The models were local primary school girls. Also, RROMA youth modeled traditional ethnic apparel from Macedonia, Roma and Vla backgrounds. There was a Roma brass band, a Roma hip hop dance group, a local rock band and two DJ’s to conclude the night. Throughout the stage event, HIV/AIDS statistics/information was announced to maintain the educational/informative theme of the event.

b. The local municipality supported the event and donated money to assist with the cost of the large stage, lighting and sound equipment. This demonstrates the municipality’s investment in the campaign and shows promise for advocacy in later stages of the campaign.

c. In general, the event was received well by local citizens. The attendance was high and people were receptive and interested in both the street actions and

6

the concert event later in the evening. Local people of influence also praised the event and the large crowd it attracted.

d. The event had large banners displaying the logos of RROMA, MTV/SAF, the campaign logo as well as the Macedonian and Roma flags.

e. Advertising for the event was limited and could have been done earlier to the date of the event. However, local and national media were in attendance which brought even more attention to the campaign.

IV. Active agents in the campaign and their roles:

A. RROMA Executive Board:

a. Consisting of Director of RROMA: Mustafa Jakupov, Program Coordinator: Daniela Janevska and United States Peace Corps Volunteer, Bethany Weymer.

i. The executive board was responsible for general organization details of main events, including food, lodging, travel arrangements and necessary materials for each event.

ii. The board oversaw RROMA youth trainers who conducted the peer educational events in local schools. The board gave the trainers full responsibility of the training content but monitored the events to ensure that they were meeting quality performance standards.

iii. The board was responsible for creating promotional materials for the campaign, including the brochures, questionnaires, the campaign logo and materials for the various events of the campaigns. As well organizing the creative campaigning and actions training in Prilep, October 2010.

7

B. RROMA Youth trainers:

a. Three of RROMA’s youth were selected to be trainers to lead the initial two-day training of RROMA’s peer educators. Merlin, the certified trainer, spearheaded the trainings and was a strong presence in almost all of the trainings. Youth worked well independently from RROMA’s executive board and remained in close communication with the board throughout the campaign’s duration.

b. The initial training of the peer educators was interactive and creative. This aspect did not necessarily transfer over to the peer educators and was lacking from the in-school trainings.

C. RROMA Youth peer- educators:

a. Two youth from each community involved with the campaign were trained by the

RROMA youth trainers at the initial two-day training. Not all of those in attendance

were active in later trainings. Some took a more passive role than others.

b. Trainings in the secondary schools were generally good. However, a more

interactive approach could have better engaged the students participating in the

project.

D. Other organizations involved in campaign:

a. Comic center of Macedonia. Vane Trajkov, the director of the comic center, was directly involved in the training of RROMA youth in the art of comic strip illustration. He was patient with the youth and allowed them to exercise their own creativity rather than imposing technical rules and limiting their imaginations.

E. Social Media:

a. Throughout the campaign, RROMA updated its blog, Twitter, Facebook page and website to inform visitors/viewers of the pages of the actions of the

8

campaign. This included both pictures and information taken from the various events performed during the campaign.

b. RROMA created an awareness video at an international training in Edrine, Turkey with participants from over 3 European countries in relation to the theme of the campaign: AIDS doesn’t know about discrimination. Protect yourself!”. Additionally, videos were posted throughout the duration of the campaign including actions performed at the final event. The flash mob video had received over 130 views at the time of this compilation (only two weeks after the event). There were five other videos posted from the event, including the girls fashion show, musical performances and dancing.

c. RROMAs website had 1,609 visitors at the time of compilation. These numbers add to the larger audience of the campaign and also include additional support and resources for later stages of the campaign.

F. Communities/Schools:

a. Praise: The pedagogue in Kocani was very enthusiastic about the campaign and was eager to assist RROMA in its actions within her school. Also, the mayor of Kratovo really enjoyed the big event and stated that the community should look at RROMA as a positive example within the community and for inspiration to become active agents of social change. The Municipality of Kratovo and the Mayor supported the big event financially too.

b. Resistance:

i. In Vinica there were comments that RROMA was promoting sex through the distribution of information and literature on the topic. Otherwise, communities were generally receptive to the awareness campaign.

V. Variations from projected activities listed on application to actual implementation of said activities during the campaign:

a. Meeting with ministry of health.

9

i. Local government and health institutions were not involved in this phase of the campaign as originally projected on the application. However, in the subsequent phases of the awareness campaign, RROMA youth will advocate for their involvement in sustaining trainings on and related to safe sex practices/ HIV/AIDS/STD awareness.

b. Distribution of condoms.

i. Condoms were not distributed. In total, 18 condoms were used for demonstration purposes, both in illustrating proper application as well as what to look for in a ‘quality’ condom.

VI. Sustainability:

a. The sustainability of the awareness campaign will come into play during the subsequent phases of the campaign. The youth who were previously trained at the beginning of this initial phase, will again be peer educators to the additional youth who will become youth trainers in their own communities. As the campaign expands into new geographic regions, RROMA youth will train the selected youth from the new communities.

b. Furthermore, as phases conclude in each geographic region, the youth will be trained in advocacy through the contents of the GYCA Political Advocacy E-course completed by a member of RROMA’s executive board. Youth will be expected to meet with local government and health institutions to arrange agreements for community support in additional HIV/AIDS trainings and information sessions. This will transfer the investment from RROMA to each respective municipality.

10

VII. Pre and Post data related to the project

Pre-data:

a. The pre-questionnaire was distributed in six municipalities: Kratovo, Probistip, Kocani, Vinica, Berovo and Veles. The questions were divided into four categories:

1. Basic knowledge about HIV/AIDS and STD’s;

2. Opinion of the target group about HIV + persons;

3. Basic knowledge about HIV transmission and infection;

4. Basic knowledge about usage of protection.

b. In Category 1, 77 % of the target group did not make a difference between HIV and AIDS, but 93% did know about the different STD’s.

c. In Category 2, 64% of the target group said that a HIV+ person cannot be recognize by the environment, but a high 60% said that HIV+ persons should not have the same rights as other people.

d. In Category 4, only 23% gave a correct answer about HIV transmission and 48% about HIV infection, but in total 77% did not know about HIV transmission and infection.

e. In Category 3, 79% of the target group knew that a specific blood test is needed to get tested of HIV; surprisingly a high 94% uses condoms as a basic protection from STD’s and unwanted pregnancy.

f. During the data-collection RROMA noticed that the age range of starting sexual intercourse is very low, starting from an average of 14 years.

11

Post-data:

g. The post-questionnaire was distributed in six municipalities: Kratovo, Probistip, Kocani, Vinica, Berovo and Veles. The questions were divided into four categories:

1. Basic knowledge about HIV/AIDS and STD’s;

2. Opinion of the target group about HIV + persons;

3. Basic knowledge about HIV transmission and infection;

4. Basic knowledge about usage of protection.

h. In Category 1 an improvement of 14% occurred, 63 % of the target group did not make a difference between HIV and AIDS. The 93% knowledge about the different STD’s, increase for 1% to 94%.

i. In Category 2, 63% of the target group said that a HIV+ person cannot be recognize by the environment, this is for 1% lower than previously, but a high 76% said that HIV+ persons should have the same rights as other people.

j. In Category 3, around 27% gave a correct answer about HIV transmission and 53% about HIV infection, which makes improvements of 4% and 5%. In total 77% did not know about HIV transmission and infection previously, but this has been reduced for a high 20% to 57%.

k. In Category 4, an increased 80% of the target group knew that a specific blood test is needed to get tested of HIV; surprisingly the high 94% that uses condoms as a basic protection from STD’s and unwanted pregnancy got higher for 3% to 97%.

In total 1200 questionnaires were printed out for the data collection. The Youth coordinators return and validated 1081 questionnaires.

12

VIII. Conclusions and Recommendations:

In conclusion, RROMA maintained and fulfilled most objectives listed on their application for the

campaign. Events were realized with punctuality with the exception of the final event, which

was delayed because of political elections (would minimize effectiveness of event).

The youth trainers were active agents in the campaign and generally did an excellent job

preparing workshops and helping to prepare for large events. Communities involved with the

awareness campaign were receptive to the material and even showed signs of investment as

they donated resources to assist RROMA in their mission.

RROMA utilized social media devices, such as Facebook, Twitter, blogging, and video-posting

which spread the actions of the campaign to an even greater audience. This will be a valuable

tool to keep the leaders of the later stages of the campaign connected with the leaders from the

previous phases. As the campaign spans throughout the rest of the nation, this will allow

communication to be easily accessible to active agents in the campaign.

The creation of a database from the six communities is currently in development as the results

are still being reviewed and analyzed. This information can be presented to local government

and health institutions during later phases of the campaign in which their partnership will be

sought after.

Areas for improvement and recommendations for the future include a more interactive training

approach in the schools. This may require longer training workshops and additional training of

peer educators. Additionally, more advertising could be beneficial in the future when hosting a

large event to attract an even larger audience to the event. Otherwise, the project achieved its

main objectives and if the subsequent phases are implemented in a similar manner, they should

be just as if not more effective.