indicators for the instruments of in situ conservation · of the factors that strengthen or block...

21
95 Scope and vision Public environmental policies have been evaluated from several perspectives, e.g. academic or governmental, and the methodologies used in each case are very dif- ferent. For example, from an academic perspective, Merino and Segura-Warnholtz (2007) emphasize that public forestry policies must be based on an understanding of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management of resources, i.e. that local measures are sufficient for the building of policies that promote sustainability. e methodolo- gies used in this type of study are social research techniques, such as questionnaires or focus groups. In terms of the environmental policy assessments prepared by the government; when Mexico joined the Program of Action for Sustainable Devel- opment, or Agenda 21, signed during the Earth Summit in Rio de Janeiro, our country undertook to adopt both national and global measures of sustainability, such as actions aimed at the generation of indicators through which to measure and evaluate the policies, instruments and strategies for sustainable development. However, far from generating committed indicators, Mexican policies regarding measurement and evaluation have adhered to the implementation of the so-called Logical Framework Matrix (LFM), an instrument designed to give some order and permit the monitoring of budgetary policies and public governance. It is therefore increasingly common, among those responsible for planning or managing invest- ment initiatives in the public sector, to speak in terms of the logical framework of a program or project. is is particularly true over the last few years, since the Inter-American Development Bank (IDB), has been strongly promoting the use of the LFM in Latin America. e method was developed during the 1960s, basi- cally attempting to circumvent three common problems: the existence of multiple objectives in a project and the inclusion of activities that do not contribute to its fulfillment; executive failures due to the lack of a clear definition of responsibili- ties and methods for appropriate monitoring and control and, finally, the lack of an objective and consensual basis on which to compare the planned results with those actually achieved. However, the LFM is not self-sufficient, it does not automatically solve man- agement problems, nor does it guarantee project success. For example, the LFM is not able to assess ex-ante the socio-economic suitability or financial viability Indicators for the instruments of in situ conservation Véronique Sophie Ávila Foucat, Felipe Ramírez Ruiz de Velasco and Ana Ortiz Monasterio

Upload: others

Post on 14-Apr-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

95

Scope and vision

Public environmental policies have been evaluated from several perspectives, e.g. academic or governmental, and the methodologies used in each case are very dif-ferent. For example, from an academic perspective, Merino and Segura-Warnholtz (2007) emphasize that public forestry policies must be based on an understanding of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management of resources, i.e. that local measures are sufficient for the building of policies that promote sustainability. The methodolo-gies used in this type of study are social research techniques, such as questionnaires or focus groups. In terms of the environmental policy assessments prepared by the government; when Mexico joined the Program of Action for Sustainable Devel-opment, or Agenda 21, signed during the Earth Summit in Rio de Janeiro, our country undertook to adopt both national and global measures of sustainability, such as actions aimed at the generation of indicators through which to measure and evaluate the policies, instruments and strategies for sustainable development. However, far from generating committed indicators, Mexican policies regarding measurement and evaluation have adhered to the implementation of the so-called Logical Framework Matrix (LFM), an instrument designed to give some order and permit the monitoring of budgetary policies and public governance. It is therefore increasingly common, among those responsible for planning or managing invest-ment initiatives in the public sector, to speak in terms of the logical framework of a program or project. This is particularly true over the last few years, since the Inter-American Development Bank (IDB), has been strongly promoting the use of the LFM in Latin America. The method was developed during the 1960s, basi-cally attempting to circumvent three common problems: the existence of multiple objectives in a project and the inclusion of activities that do not contribute to its fulfillment; executive failures due to the lack of a clear definition of responsibili-ties and methods for appropriate monitoring and control and, finally, the lack of an objective and consensual basis on which to compare the planned results with those actually achieved.

However, the LFM is not self-sufficient, it does not automatically solve man-agement problems, nor does it guarantee project success. For example, the LFM is not able to assess ex-ante the socio-economic suitability or financial viability

Indicators for the instruments of in situ conservationVéronique Sophie Ávila Foucat, Felipe Ramírez Ruiz de Velasco and Ana Ortiz Monasterio

Page 2: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

96

of a given project. Neither is it sufficient to guarantee good scheduling for the implementation of the project, or an effective and efficient control of its execu-tion. Moreover, it does not question the objectives and relevance of the program. It is therefore necessary to turn to other complementary instruments and tech-niques to determine if a project is suitable for the country (social evaluation) and for the institution which undertakes its implementation (private evaluation). The LFM does not ensure that the project will have the support of the community and authorities involved, and should therefore be used in conjunction with other methods, techniques and instruments in methodologies to formulate and manage projects. This method has its detractors and has been criticized, mainly regarding the overly rigid application of the method, without adaptation to the individual characteristics of each case. In summary, the LFM is a very useful instrument and can be recommended for the entire term management of projects, but must be used in conjunction with other techniques and methods at different stages of the project life cycle.

However, it is important to note that there have been very few evaluations of in situ conservation instruments; and almost all of these have focused on evaluation of programs or laws.

In response to this deficiency, the present project, entitled “Criteria for the evaluation of the efficacy and capacities of selected instruments of in situ con-servation”, has been formulated, and aims to provide criteria for the evaluation of the following conservation instruments: sustainable forest management (SFM), payment for environmental services (PES) and management units for the con-servation of wildlife (UMAs) (Boxes 1, 2 and 3). These conservation instruments were selected because they have had little revision to date and there are therefore no existing criteria for their evaluation, and also because they are all instruments that are directed to local beneficiaries, i.e. they are comparable in terms of scale. It would be difficult to compare an instrument of planning for the use of natural resources, such as protected natural areas or land-use planning, with the UMAs, which are voluntary instruments aimed at communities. While the UMAs, the SFM and PES share the same scale, they are very different instruments; the latter two are schemes of federal subsidy, while the former is a voluntary scheme that induces the development of emerging markets and self-sufficiency. Sustainable forest management is one of the most evaluated instruments, and some examples can be found in which the logical framework has not been used, and an effort has been made to generate indicators. For example, Morán (2005) developed a standard composed of principles, criteria and indicators for assessing the sustain-ability of community forest management, applied in 16 communities in the state

Page 3: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

97

of Guerrero. Also worth mentioning is the work of Luján et al. (2003), in which a system of principles, criteria, indicators and verifiers was designed to assess the progress of sustainable forest development in a forest of Chihuahua, and used to analyze the socio-economic, ecological and cultural situation of the community that managed the forest.

The program of PES, despite being a relatively recent instrument, has been the object of discussions that have produced elements to determine criteria for its evaluation (Kosoy et al., 2007). However, the development of systematic assess-ments of this instrument is still required to determine its efficacy as a policy of in situ conservation.

UMAs are productive areas that promote alternative schemes compatible with the protection of the environment through extractive and non-extractive uses of renewable natural resources. They seek to substantially change the practices of undervaluation, abusive exploitation and application of restrictive models which have been used in the country in relation to wildlife. UMAs were derived from the Program of Wildlife Conservation and Productive Diversification in the Rural Sector, 1997-2000 in Mexico, which established the general objective: “To conserve the biodiversity of Mexico and to generate opportunities of socio-economic diversification for the rural sector.” Both the overall purpose and the specific objectives of this program were adopted and developed by the general law covering the subject. Its regulations limit the concept of UMAs to those subject to management in the wild; intensive UMAs directed towards the reproduction of specimens for subsequent return to the wild; and federally owned property. UMAs have been integrated into the System of Management Units for the Conservation of Wildlife (SUMA, by its Spanish acronym), which, through the grouping of these units, seeks to enhance their capacity for conservation. The SUMA has grown year after year, to such an extent that it currently incorporates more than eight thousand units, representing 15.6% of the national territory and covering an area of more than 30 million hectares. Due to their characteristics, UMAs instill in the owners or occupants of the properties a more positive perception regarding wildlife and habitat conservation in the owners or occupants

of the properties through the possibility of utilizing them to obtain benefits. The UMAs are generating alternative sources of employment, income and foreign currency for rural communities (Guajardo and Martínez, 2004), resulting in the maintenance of environmental goods and services. Trade in wildlife generates important economic benefits for communities, and it has been estimated that the economic impact is close to three billion pesos a year (Anta, Carabias et al., 2008). The objectives, legally established by the government, for the coordination and promotion of the SUMA are:

a) Conservation of biodiversity and the natural habitat of wildlife, thereby enabling continuity of evolutionary processes.

b) Formation of biological corridors that interconnect the UMAs among themselves, and with the protected natural areas.

c) Promotion of activities of restoration, recovery, reintroduction and repopulation, with the participation of stakeholders.

d) Application of traditional biological knowledge, promotion and development of wildlife research, and incorporation of these into the conservation of biodiversity.

e) Development of alternative productive activities for rural communities and combat of illegal seizure and trafficking of specimens, parts and derivatives.

f) Support for the accomplishment of activities of conservation and sustainable use in Mexico through linkage and exchange of information between different units and simplification of the management based on the past record of each one

Box 1. Management units for the conservation of wildlife (UMAs)

Page 4: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

98

Similarly, some case studies related to UMA have been analyzed (Weber et al., 2006; Ávila-Foucat, 2002; Ávila-Foucat et al., 2007); however, despite the fact that the system in which these units are grouped currently covers more than 15.5% of the country, a systematic effort has not yet been made to evaluate the instrument. Therefore, there is a gap not only in the evaluation of instruments of conservation, but also in criteria and indicators for assessing the instruments of in situ conserva-tion, which is the purpose of this study. It should be emphasized that this study does not seek to make the evaluation of the efficacy and capacities of the instru-ments of in situ conservation listed above, but simply aims to generate the criteria necessary for such an evaluation.

Sustainable forest management was defined in Helsinki in 1994, as the responsible use of forests and forest lands in order to maintain their biodiversity, productivity, regeneration capacity, vitality and their potential to satisfy relevant ecological, economic and social functions at a local and global scale now and in the future, without causing damage to other ecosystems (Morán, 2005). Today, it is proposed that sustainable forest management must manage the forest ecosystem as a whole (Aguirre, 1997; Jardel et al., 1997). In this sense, ecosystem management emphasizes the condition or state of the forest, evaluating also, or in more detail, parameters such as: biodiversity, landscape type, soil productivity, age, structure, vigor, floral composition, fauna, timber residues, etc. (Aguirre, 1997).However, conventional forest management has focused principally on resource density and yield. Under this approach, some of the parameters used are timber volume, forest density and infrastructure. Therefore, forest management now faces the challenge of generating schemes that ensure the maintenance of biological diversity, soil fertility, conservation and dispersal of genetic variability as well as all the ecological functions of the areas under management (Aguirre, 1997). For its part, the General Law for Sustainable Forest Development in Mexico (LGDFS, 2003) defines forest management as “the process that includes the conjunction of actions and procedures that are aimed at the

arrangement, cultivation, protection, conservation, restoration and use of forest resources in a forest ecosystem, considering ecological principles, respecting the functional integrity and interdependence of resources and without reducing the productive capacity of existing resources and ecosystems.” Likewise, the concept of SFM established in the Strategic Forestry Plan for Mexico, 2025, is the institutional framework for integrating environmental, social and economic aspects into forestry. It aims to ensure that the capacity of forest resources is maintained or increased in the long term. The SFM is proposed in this document to be an engine in the fight against poverty, and for private investment and generation of sustainable use and efficient markets.While it is true that SFM and community forest management (CFM) are not true policy instruments as such, many rural communities have practiced these for many years on their own initiative or with the support of civil society organizations, and they are achieved under different schemes, such as participatory community ecological planning (PCEP), community reserves, communal or ejido forestry companies and community forestry, among others. It is important to note that in many of the properties managed under different schemes of CFM, criteria are applied beyond even the established institutional or existing regulations in order to achieve sustainability of use.

Box 2. Sustainable Forest Management (SFM)

Page 5: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

99

Conceptual framework and synopsis of the workshops

Conceptual framework of the project

The project sought to generate criteria and indicators to measure the efficacy and capacities of the instruments of in situ conservation described earlier. Efficacy of these instruments is understood as the success of the results obtained from their design and implementation, while the capacity of the instruments refers to the institutional potential for their implementation and the possibilities of their ap-plication, from a socioeconomic and environmental perspective.

Criteria for evaluation of the three instruments of public policy typically in-clude analysis of the design, implementation and results (Cohen and Franco, 2006, Wayne, 2007). Therefore, criteria were developed to conduct an ex-post analysis, whether for instruments that have been in operation for several years, or for those with a much shorter time in application but that are required to satisfy certain criteria in the future. In addition to this, this study focuses on environmental, socioeconomic and institutional aspects in order to conduct a comprehensive as-sessment of current public policies.

Environmentally, the criteria are aimed at the conservation of populations and ecosystems whereas, in the social field, they are focused on consolidating social capital, since various aspects of organization and cohesion are critical to ensuring

Environmental services are those ecosystem functions that directly or indirectly benefit human welfare. This topic and its associated compensation schemes have generated important literature within the areas of policy and environmental economics (Pagiola et al., 2003; Alix-García et al., 2005, Swallow et al., 2005), as well as within areas of forestry, hydrological and ecological research (Mayrand and Pakin, 2004, Merino et al., w/d; Torres and Guevara, 2002). Four general categories of environmental services are recognized that can be valid for different types of ecosystems (Millennium Ecosystem Assessment, 2005).

a) Procurement services: These are products derived from nature, mainly foods, fibers, fuels, genetic resources, biochemical products, natural medicines and pharmaceutical products, ornamental resources and water.

b) Regulating services: These are the benefits obtained from the regulation of ecosystem processes, among which

are maintenance of air quality, regulation of climate and hydrological cycle, erosion control, purification of water and waste management, regulation of human diseases, biological control, pollination and protection from hydrometeorological phenomena.

c) Cultural services: these are considered to be non-material benefits obtained from ecosystems through reflection, knowledge development, recreation and aesthetic experiences. They include cultural diversity, spiritual and religious values, knowledge systems, educational values, inspiration, cultural and historical values as well as recreation and ecotourism, among others.

d) Support services: these are the services that are necessary for the production and maintenance of other services; they differ from the others in that their impacts are felt over longer time periods (e.g. formation of soils and provision of oxygen).

Box 3. Payment for Environmental Services (PES)

Page 6: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

100

that community projects function in the long term and therefore for the benefit of conservation of the ecosystems involved (Durán-Medina et al., 2007). In the field of economics, the criteria are focused on product diversification and the economic benefits for communities related to the implementation of the instrument. At institutional level, the criteria and indicators are directed towards the existence of capacities, conviction and commitment to optimally administrate and promote the instruments.

The criteria and indicators derived from this work, as stated in the Meeting of Experts on the Harmonization of Criteria and Indicators for Sustainable Forest Management (FAO, 1995), seek to comply with the following attributes:

• Clarity: theycanbeeasilyunderstoodatdifferentgovernment,politicalandtechnical levels.

• Scientificsoundness:theyarebasedonresearchandscientificexpertise,andaretherefore objective.

• Applicability:theycanbeusedandeasilymeasuredusingavailabletechnology,and therefore their achievement does not require hard work or high costs.

• Flexibility:theymaybeappliedinecosystemsatdifferentlevels,i.e. from each individual country to that of the whole Central American region.

• Relevance:theymustberelevanttoeachinstrument.• Consistency:theymustbeconsistentwiththeestablishedgoalsandcriteria.• Reliability:theymustbebothmeasurableandrepresentativeofreality.• Theymustbeatanappropriatespatialandtemporalscale.

In this sense, criteria and indicators were developed to satisfy the features pro-posed in the logical framework methodology: to be objective, measurable, rel-evant, specific, practical and economical (Ortegón et al., 2005).

Synopsis of the workshops

The sequence of work was similar to that followed by Herrera and Corrales (2004) to build forestry criteria and indicators, through the development of a proposal of revised and evaluated indicators in workshops with experts whose reports are included in Appendix 3.1 to 3.4.

Synopsis of Workshop 1On June 17th, 2008, in Mexico City, a first workshop was held with the aim of establishing the evaluation criteria of SFM, UMAs and PES, and to identify case studies for a subsequent pilot assessment.

Page 7: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

101

In organizing this workshop, potential participants were identified using the following criteria:

• Theirnationalvisionforthethreeevaluatedinstrumentsofin situ conservation, in order to consider aspects related to the different regions of the country.

• Theirknowledgeofkeyaspectssuchasadministrativemanagement,marketingofspecimens, parts and derivatives, product certification, funding and the social as-pects of all three instruments.

• Theexperienceoftheparticipantsinvarioussectorsorthemes.

Each participant received a working document before the workshop that in-cluded an initial proposal of criteria and indicators generated based on the con-ceptual framework and presented in Appendix 3.1. Following the contact of dif-ferent stakeholders based on the above criteria, the workshop was attended by 46 participants: 13 government officials, 16 academics, 9 representatives of civil organizations and 8 beneficiaries of the various instruments. Before the workshop began, a document was sent to all participants containing the necessary inputs and the process to be followed.

The workshop was conducted in three sessions (Appendix 1):

a) Introductory session. Presentation of the overall project, comprising a profile of the conservation instruments under examination and details of the dynamics of the workshop.

b) Session 1 (for evaluation of the indicators of design and implementation). Par-ticipants evaluated the proposed general criteria and indicators in a process that lasted two hours, during which the criteria of evaluation were screened in the form of questions, and each participant filled out a form indicating whether the question was relevant, clear and sufficiently precise. Participants were subse-quently asked whether it was necessary to incorporate other criteria and indica-tors, or to reconsider any questions.

c) Session 2 (for the review of environmental and socioeconomic indicators). Par-ticipants assessed the specific criteria and indicators for each instrument, in a roundtable discussion devoted to the UMAs, and another for SFM and PES. Indicators were validated by consensus and, when necessary, relevant changes were made. Participants were also asked to propose or indicate possible case studies to which selected indicators could be subsequently applied. Each dis-cussion had a chairperson and two reporters.

Page 8: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

102

Synopsis of workshop 2 The second workshop, again in Mexico City, was held on August 11th, 2008, in order to validate the most important criteria and indicators that emerged from the first workshop through the implementation of a pilot test which involved techni-cians, beneficiaries, decision makers and several organizations, related to the three instruments of in situ conservation under assessment.

The workshop undertook to incorporate the northern, central and southern regions of the country through selected case studies.

The focus group methodology has the advantage of recovering many qualita-tive aspects, as well as having a more equitable participation of all participants. This technique brings together small to medium sized groups (preferably between 3 and 10 members) in order to work with these concepts, experiences, emotions, categories, events or topics of interest for the purposes of the study. In this sense, it seeks to determine how people form an outline or perspective of a problem (Hernández, 2006) (Appendix 3.3).

In terms of methodology, the application of evaluation criteria was designed to be used at a national scale and thus each instrument was represented in a pilot test, utilizing case studies from different regions of the country —both successful and unsuccessful in their implementation— to validate the criteria. As stated above, experts, beneficiaries and decision makers from the three instruments participat-ed, in line with the recommendations proposed by the participants of workshop 1, as well as NGOs and academic organizations.

The analyzed indicators were grouped according to the following criteria:

• Planningoftheinstrument.• Adequateandefficientimplementationoftheinstrument.• Sustainablemanagementpractices.• Conservationofnaturalvegetation.• Conservationofbiodiversity.• Landusechange.• Regionalimportance.• Economicbenefits.• Marketandproductivechains.• Socialorganizationofthebeneficiary.• Socialcohesion.• Environmentalcultureandawareness.

Page 9: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

103

On reviewing the indicators and criteria of the first workshop to develop the matrices of the second workshop, several of these were identified as variables of others or of themselves. Consequently, a reduced number of indicators was agreed upon for the focus group discussion. Throughout the discussion, the viability and relevance of each indicator and its variables were explored, and substantive com-ments noted on each. Similarly, the need to include new variables was explored.

Main results

Results of the first workshop

The most relevant indicators, and those newly proposed in session 1, are presented in tables 1 and 2.

TaBle 1. Most relevant general indicators (session 1) Indicator

Does the program have incentives that promote its continuation in the long-term?

Is the instrument suitable for all types of ecosystem?

Are the objectives of the instrument being met?

Are the services and administrative infrastructure suitable for the instrument?

Is the target population satisfied with the services they receive?

Are there other institutions that could assist in the implementation of the instrument?

Has there been sufficient dissemination and promotion of the instrument throughout its

implementation?

Is access to the instrument easy?

Are the channels of implementation of the instrument appropriate?

Is there any synergy with other instruments?

Has the instrument been able to reverse or slow changes in land use?

Are some of the recipients of the program receiving more benefits than others?

Do the services provided have beneficial effects on the economy of the population served?

Does the instrument have synergy with other instruments or in situ conservation programs?

Page 10: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

104

The main results obtained from this first workshop are as follows (Appendix 3.2):

• 107indicatorswerereviewedcollectively.• 42generalindicatorswereacceptedwithoutsubstantivechanges.• InthediscussionofSFM and PES, changes were often directed towards increas-

ing the precision of the indicators, and some resulted in new indicators and variables.

• InthediscussionofUMAs, the comments were more technical, with an empha-sis placed on the value of each indicator and the feasibility of measurement.

• IntheSFM and PES discussion, the comments were mainly focused on social indicators, highlighting the gender issue. In the discussion of UMAs, economic indicators were among the factors discussed most extensively. This is partly because this instrument does not have any specific support from the federal government.

• GenderandothersocialissueswerenotdeemedrelevanttothediscussionofUMAs, but certification caused discussion and controversy in both groups.

Based on these results, a new proposal of criteria and indicators was developed, as detailed in Appendix 3.2. This proposal was used in the second workshop, de-scribed below.

Results of the second workshop

Participating in the UMA group were representatives of units from Baja California Sur, Morelos and Quintana Roo; while the PES group involved communities from the states of Guerrero, Coahuila, Oaxaca, Veracruz and Chiapas. The SFM group

TaBla 2. Indicators proposed for inclusion (session 1) Indicator to be included

Did the target population participate in the design, implementation and evaluation?

Are there mechanisms for them to participate? (Make this specific to different scales)

Does the instrument propose a plan of co-responsibility?

Were there any obstacles to the implementation of the instrument?

Is the decentralized implementation of the instrument considered, and by which scheme/institutions?

Did the implementation of the instrument lead to unintended consequences?

Do the provided services have unexpected adverse side effects on the population served?

Does the instrument adapt to the traditions and customs of the community?

Page 11: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

105

had the participation of communities from Quintana Roo, Durango, Oaxaca and Michoacán. Some of the cases used were the result of recommendations of the first workshop (Appendix 3.4).

In total, this workshop was attended by 37 participants, comprising four focus groups (PES, SFM, UMA and decision makers). These groups included 17 beneficia-ries of the instruments, four representatives of the assisting civil organizations, five technicians, nine government officials and two researchers. The workshop had the support of 16 additional people who served as coordinators, observers, reporters and assistants.

In each of the focus groups, thoughts and concerns became apparent with re-gard to in situ conservation instruments that were of interest because they revealed problems in the design and implementation, even though only a relatively few case studies were available and therefore cannot be taken as statistically significant nor extrapolated as being representative of the national reality. Nevertheless, the participants agree that the concerns identified during the workshop should be brought to the attention of decision makers involved in the design and implemen-tation of these policies (Appendix 3.4).

There was a general consensus on the need for an in depth evaluation of the issue of management and administration, recurrent in all focus groups, so it is essential that there be specific and sufficient indicators in this regard. In general, the indicators and variables related to socioeconomic and environmental aspects were found to be adequate, with some adjustments (Appendix 3.4). This was re-flected in the interest aroused on raising central questions that generated discus-sion about the efficacy and capacities of the instruments, in relation to their de-sign, implementation and results. Similarly, different indicators emerged, or were naturally incorporated, into the discussion of the corresponding central questions. Although the intention of this work was not to evaluate the conservation instru-ments themselves, interesting ideas and recommendations were raised during the second workshop and these are shown in Appendix 3.5.

Final set of criteria and indicators

The results of the second workshop allowed the formulation of a new proposal of criteria, indicators and variables. The first set or matrix presented below makes reference to the criteria and indicators to be used in a general manner to mea-sure whether the planning, design and implementation have been effective, and whether the capacities exist to make this happen. Following this matrix, three others are presented describing the criteria, indicators and variables for measur-ing the contribution of the three instruments of in situ conservation (SFM, PES,

Page 12: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

106

UMA) in relation to conservation, and social and economic aspects. These three sections refer to natural, social and heritage capital. A Likert scale is included in the column of variables so that the respondent answers the question, and then a number of variables are included specifying the motive for the initial response. Variables do not have a specific weight because each case or region of the country presents different realities. Moreover, some of the variables, particularly the social variables, are more qualitative in nature, so their weight is difficult to establish and will depend on each case or region. Therefore, the proposed criteria and indica-tors presented here should be analyzed statistically, i.e., if a response is statistically representative, it will be considered. If the case study satisfies most of criteria and indicators in a positive manner, then the instrument will function effectively in that location.

In the case of indicators of design and implementation, while many of the indi-cators are qualitative, it is recommended that they be evaluated in as quantitative a manner as possible. In this case, the variables will depend on each instrument and are therefore not included as variables in the final matrix; for example, the indica-tor “is there an explicit synergy with other instruments or programs” can be mea-sured by showing how many programs or instruments referred to priority being given to the beneficiary that participates in an UMA, a PES or SFM. Other indica-tors such as, for example, “Was there participation of the target population in the design of the instrument”, may be measured by the number of public consultations or the participation scheme used (if any) when designing the instrument. Other indicators of design and implementation recommended for quantitative measure-ment are shown in Table 3.

TaBle 3. Indicators of design and implementation that can be measured quantitatively

Indicator Example of quantitative measurement

Most users receive the complete benefits of the instrument

For example, in the case of PES, the total amount paid and the number of users can be measured

There has been sufficient dissemination and promotion of the instrument throughout its implementation

Number of announcements on the radio, local promotional campaigns

Cost-benefit ratio is positive for the government Cost-benefit analysis

Cost-benefit ratio is positive for the beneficiary Cost-benefit analysis

Economic resources are sufficient to achieve the established goals

Cost-benefit assessment between the amount allocated by the federation and the achievement of goals

Page 13: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

107

Similarly, it is recommended that the social and economic indicators of con-servation are measured quantitatively, as far as possible. In the case of social indi-cators, for example, the indicator “The instrument has led to social cohesion and unity among members of the community” is a qualitative indicator that can be measured based on the number of resolved conflicts within the community fol-lowing application of this instrument. In the case of the indicator “The instrument has influenced the environmental culture and awareness of the beneficiaries”, the internal regulations can be checked to verify any modifications with specific ac-tions to value the environment.

Indicators of design and implementation

Criterion Indicator Variables

DesignInstrument

planning

There is a specific program that details

the guidelines and objectives of the

conservation instrument

Disagree_____ Slightly

disagree_____ Slightly agree_____

Agree_____

The target population is broad and

appropriate

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There are clear targets and indicators

for the instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The implementation mechanisms

are clearly proposed

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There was participation of the target

population in the design of the

instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The budget is sufficient to carry out

the proposed objectives

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There is a system of monitoring

of the instrument of conservation

Disagree____ Slightly disagree____

Slightly agree____ Agree____

This is proposed as a long-term

instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There is explicit synergy with other

instruments/programs

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There are incentives that promote the

long-term persistence of the instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Page 14: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

108

Criterio Indicador Variables

DesignInstrument

planning

The instrument proposes a scheme

of co-responsibility

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The instrument is suitable for all types

of ecosystems

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Implementation

Fulfilling the

objectives of

the instrument

The objectives of the instrument

are fulfilled

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Services are provided to those who need

them

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Most users receive the complete benefits

of the instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There is an efficient use of financial

resources for the instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Adequate and

efficient imple-

mentation of

the instrument

The administrative infrastructure

and services are appropriate

for the instrument

Disagree_____ Slightly

disagree_____ Slightly agree_____

Agree_____ Efficient issue of

permits_____ Efficient registration

procedures_____ Compliance

with response times_____

Negatives properly founded and

motivated_____ Administrative

simplification_____ Sufficient

administrative personnel_____

Qualified administrative

personnel_____ Offices with

suitable infrastructure_____

The quality of service is maintained with

changes of management

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There is a synergy with other institutions

that assists the implementation of the

instrument

Disagree____ Slightly disagree____

Slightly agree_____ Agree_____

Interinstitutional coordination

good_____ Intra-institutional

coordination good_____

There has been sufficient dissemination

and promotion of the instrument

throughout its implementation

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Page 15: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

109

Criterio Indicador Variables

Implementación

Adequate and

efficient imple-

mentation of

the instrument

The channels of implementation

of the instrument are appropriate

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Quality of dissemination

appropriate____ Depth of

dissemination appropriate____

Sufficient dissemination to enable

easy access to the instrument____

There is synergy with other instruments

of conservation and productive

diversification

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The cost-benefit ratio is positive

for the government

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The cost-benefit ratio is positive

for the user

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The regulatory framework facilitates

achievement of the objectives of the

instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Identified obstacles (if any)______

Alternative approaches could bring

the same benefits at lower cost

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The financial resources are sufficient

to achieve the established goals

Disagree____ Slightly disagree____

Slightly agree____ Agree____

There has been decentralization in the

implementation of the instrument

Disagree____ Slightly disagree____

Slightly agree____ Agree____

If so, identify through which

scheme and institutions_____

Identify any problems faced

with the decentralized

implementation____________

The services provided have unexpected

adverse side effects on the population

served

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The instrument builds the capacity of

local regulation

Disagree____ Slightly disagree____

Slightly agree____ Agree____

The instrument is adapted to the

traditions and customs of the

communities

Disagree____ Slightly disagree____

Slightly agree____ Agree____

Page 16: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

110

Criteria and indicators for measuring the contribution of the instrument to conservation

Criterion Indicator Variables

Management

practices that

contribute to

conservation

The instrument promotes

management practices that

contribute to conservation

Disagree_____ Slightly disagree_____ Slightly agree____

Agree____

The instrument promotes appropriate management

practices_____

The instrument promotes protection against fire______

The instrument promotes protection against pests _____

The instrument promotes the protection against diseases _____

The instrument promotes surveillance_____

The instrument promotes

management practices that

contribute to sustainable use

Disagree____ Slightly disagree____ Slightly agree____ Agree____

The instrument promotes appropriate practices of use____

Conservation of

natural vegetation

The instrument has led to the

increase or reduction of the

primary vegetation cover of

the land under management

Disagree____ Slightly disagree____ Slightly agree____ Agree____

The instrument has led to positive changes in population

densities ______

The instrument has led to positive changes in the composition

of populations ________

The instrument has led to positive changes in population

structures ______

The instrument promotes the non-fragmentation of

habitats_____

The instrument promotes frequent monitoring of the

populations of interest _____

The instrument monitors the state of the habitat of species

of interest ______

The instrument promotes the monitoring of species associated

with habitats of interest________

Biodiversity

conservation

The instrument strengthens

or weakens the presence and

abundance of native species

on the property

Disagree____ Slightly disagree____ Slightly agree____ Agree____

The instrument promotes the presence and abundance of

native species sensitive to changes in their habitat_____

The instrument promotes the presence and abundance

of bigger predators _____

Page 17: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

111

Criteria and indicators for measuring the contribution of the instrument to society

Criterion Indicator Variables

Positive effects on

social organization of

the beneficiary

The instrument has positively

affected community

organization

Disagree_____ Slightly disagree____ Slightly agree____

Agree____ It has led to forms of organization within the

community_____ with other communities _____ between

various communities or producers_____ has strengthened

them _____ has weakened them _____ has strengthened

their relationship with other stakeholders_____ which

__________________________

The instrument has

strengthened the capacity for

better management of natural

resources within the community

Disagree____ Slightly disagree____ Slightly agree____ Agree____

It has led to the training of technicians in the community

______ It has strengthened the management and technical

capacity among community members______ the community

mechanisms of surveillance_____ the imposition of sanctions

for non-sustainable uses_____ the community assembly_____

the adherence to community agreements_____ It has led to

participative land-use planning

Promote social

cohesion

The instrument has led to

social cohesion or unity among

community members

Disagree____ Slightly disagree____ Slightly agree____

Agree____ It has contributed to collaborative relationships

(collective work)_____ the capacity to solve conflicts within the

community____ and with other communities _____

Greater

environmental

culture and

awareness

The instrument has influenced

the environmental culture and

awareness of the beneficiaries

Disagree____ Slightly disagree____ Slightly agree____ Agree____

It has influenced the revaluation of natural resources_____ the

evaluation of conservation_____ the long term vision

of use______ It has led or strengthened these aspects in the

internal regulation _____ has influenced the establishment of

community reserves ______ has promoted the participation

of children in in situ conservation______

The instrument leads to the

participation of community

members who were not

previously involved

Disagree____ Slightly disagree____ Slightly agree____ Agree____

Proportion of women ______ elderly _____ young_____

non-ejidatarios_____ participating in the instrument_____

in making decisions______ in the management, use and

control of resources______ in the economic benefits of the

instrument_____ Always participating _____ sometimes_____

almost never ________

Page 18: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

112

Criteria and indicators for measuring the contribution of the instrument to the economy

Criterion Indicator Variables

Increased and more equitable economic benefits

Incentive of the instrument for generating sources of permanent and/or temporary income

Disagree______ Slightly disagree______ Slightly agree______

Agree______ Temporary______ Permanent______ Both______

Sources of local income______ Sources of regional income

through linkage in productive chains ______

Promotion of productive diversification

Disagree______ Slightly disagree______ Slightly agree______

Agree______ State the other productive activities ___________

The implementation of this instrument allows or facilitates access to the use of resources of other instruments

Disagree______ Slightly disagree______ Slightly agree______

Agree______ Which?______

Subsidies of SAGARPA______ SEDESOL_____ SRA______ Others_________

Insertion into productive markets and chains

The instrument promotes a complete use of the product or exploited asset

Disagree______ Slightly disagree______ Slightly agree______

Agree______ All is used______ almost all______ or only a small

part______ The product, or part thereof, is processed______ is

not processed______

The productive chain of the product is easy to access

Disagree______ Slightly disagree______ Slightly agree______

Agree______ Do you know the intermediaries______ their

prices______ the prices are appropriate______ do you have

access to the intermediaries______ The international market is

easy to access______ difficult to access______

Existence of positive aspects of certification (if they exist)

Disagree______ Slightly disagree______ Slightly agree______

Agree______ It gives prestige______ Opens certain niche

markets______ Leads to better management practices______

It is viable in terms of cost benefit______ Allows better

administrative organization______ Adds value______

Page 19: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

113

Action plan The criteria and indicators generated in this work, and implemented in a pilot test, should be applied more widely in order to determine the efficacy and capacities of various instruments for in situ conservation. However, one of the recommenda-tions that emerged in both workshops was to send a report of the most relevant results of the project and, in particular, the results of the pilot test, to the authori-ties responsible for the implementation of these instruments. Therefore, in Ap-pendix 3.5 a summary of those results is provided in order that they may be sent to the head of the Ministry of Environment and Natural Resources, as well as to the following bodies:

• FederalEnvironmentalProtectionAgency• UnderministryofEnvironmentalPlanningandPolicy• UnderministryofPublicWorksandEnvironmentalRegulations• UndersecretaryofManagementandEnvironmentalProtection• UnitforSocialParticipationandTransparency• CenterforEducationandTraininginSustainableDevelopmentFor SFM• GeneralDirectionofCONAFOR • GeneralDirectionofForestandSoilManagementFor PES • DirecciónGeneraldelaCONAFORFor UMAs• NationalComissionofNaturalProtectedAreas• GeneralDirectionofWildlife

It is strongly recommended that the reports are accompanied by an explanation of the project, as presented in Appendix 3.5. It is important to remember that the results of the pilot test are a preliminary guide to recognizing the strengths and weaknesses of the instruments, but that a more nationally representative evalua-tion is still required. To carry this out, the following action plan is proposed, for which the bodies responsible and a detailed schedule should be assigned prior to implementation.

Page 20: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

114

Objective To design and implement a program to submit these instruments for evaluation at national level, through validated criteria and indicators, and to propose to the relevant authorities the necessary adjustments to improve their efficiency and ca-pacities for in situ conservation in Mexico.

Goals

a) To apply the evaluation criteria and indicators generated in this work to the various relevant stakeholders related to each instrument of in situ conservation, through a sample that is both statistically significant and representative of the national reality.

b) Submit proposals to the relevant authorities to improve the design, form of implementation, and results of these three instruments in the short, medium and long term.

Activities

The activities proposed in this action plan are:

1. Design of the methodology for implementing the evaluation. This activity will include determination of sample size, sampling sites, people

or organizations to analyze, and the methods for implementing the indicators (focus groups, questionnaires, interviews). It also must determine the costs and time required, as well as the scales within which it will operate.

2. Application of the instrument. At this stage, fieldwork is required which will use the methodology determined

in the previous section to apply criteria and indicators to a given sample. This sample should be representative of the national reality.

3. Analysis of results. At this stage, the suitability of weight given to each variable should be deter-

mined and an index estimated; or the results analyzed in a more qualitative manner or via a statistical approach.

4. Development of recommendations. The results should support the recommendations to improve the efficacy and

capacities of the instruments. The recommendations should be aimed at deci-sion makers, and also at the beneficiaries and intermediaries.

5. Presentation of results to the relevant authorities, together with specific pro-posals.

Page 21: Indicators for the instruments of in situ conservation · of the factors that strengthen or block the efforts of communities to confront the dilemmas of the collective management

115

Finally, it is very important that the results of this study are forwarded to the authorities in order to improve the design, implementation and results of the in-struments of conservation. Similarly, the results should be disseminated to the beneficiaries and other relevant intermediaries for the implementation of the in-struments.

Lessons learned and challenges Broad social participation is a key element in the articulation of strategies, projects and actions related to the different instruments of in situ conservation. Therefore, we should encourage and promote the participation of different sectors that make up our society in the related public issues which should be understood as three converging paths; that of the administration, the direct beneficiaries and the indi-rect beneficiaries, who are in a position for dialogue, negotiation and joint effort.

Unfortunately, in the various forums organized to design, implement or even evaluate the instruments, the absence of the direct beneficiaries is notable, espe-cially because it is they who could ultimately make the conservation of biodiver-sity in the Mexican countryside a reality. Knowledge and incorporation of their views and needs is essential for the successful implementation of public policies of in situ conservation. It is also important to note that a pilot test was necessary in order to confirm the relevance of the establishment of criteria and indicators, as well as their variables. How-ever, now arises the challenge of applying the indica-tors both to those decision makers directly involved, as well as to the technicians and direct beneficiaries of the instruments, because only in this way will they be properly evaluated.