managerial self-awareness in high-performing … s… · managerial self-awareness in...

12
Journal of Applied Psychology 1997, Vol. 82, No. 2, 281-292 Copyright 1997 by the American Psychological Association, Inc. 002I-9010OT/$3.00 Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual differences in the construct of managerial self-awareness (MSA) —operation- alized as congruence between self and direct reports' behavioral ratings—were examined in 134 high-performing (HP) and 470 average-performing (AV) managers obtained from 4 independent datasets. Results based on several different approaches to measuring ratings agreement indicated that HPs were significantly more managerially self-aware compared with AVs. This relationship was consistent regardless of data source, organization, or method of assessing managerial performance. No overall relationships were found be- tween congruence and level of item importance, gender, management level, age, or tenure. When compared with other measures for assessing self-focus, the construct of self- monitoring was found to be convergent with managerial self-awareness, whereas the construct of self-consciousness appeared to reflect primarily rating leniency effects. The article concludes with a comparison of the measurement approaches used, limitations, and suggestions for further study. With the rising popularity of multirater or 360 degree feedback systems in organizations (e.g., Church, 1995; Hazucha, Hezlett, & Schneider, 1993; London & Beatty, 1993) designed explicitly to enhance self-knowledge and improve managerial behavior, a number of researchers have begun exploring the psychological concept of self- awareness from an applied ratings-based perspective (e.g., Atwater & Yarnmarino, 1992; Van Velsor, Taylor, & Leslie, 1993; Wohlers & London, 1989). From this perspective, the greater a given individual's level of managerial self- awareness (MSA) (i.B;, the ability to reflect on and accu- rately assess one's own behaviors and skills as they are manifested in workplace interactions), the greater the ex- pected level of congruence between his or her self-assess- ments and those provided by direct reports or by peers. Conceptualized as both a personality trait and a skill, the construct of MSA is likely to interact with the self- perception process prior to assessment (Campbell & Lee, 1988; Figurski, 1987; Yammarino & Atwater, 1993), which in turn moderates the "self-other" rating compari- son. By applying the notion of MSA to performance rat- ings research, this perspective has provided some new and I would like to thank Warner Burke for his theoretical contri- bution, Janine Waclawski for her constructive feedback and en- couragement, and Mary Zippo for her proofing assistance. Correspondence concerning this article should be addressed to Allan H. Church, Principal, W. Warner Burke Associates, Inc., 201 Wolfs Lane, Pelham, New York 10803. Electronic mail may be sent via Internet to [email protected]. interesting insights into the general lack of agreement observed in ratings from multiple sources (e.g., Furn- ham & Stringfield, 1994; Harris & Schaubroeck, 1988; Landy & Fair, 1980). Although MSA is intrinsically interesting, its signifi- cance to researchers and practitioners is limited unless differences in self-awareness, as measured by congruence in ratings, can be linked to other key variables such as individual performance. Unfortunately, although much ap- plied research has explored managers' perceptions of their own behaviors compared with those of their subordinates, peers, and supervisors (e.g., Arnold & Davey, 1992; Bor- man, White, & Dorsey, 1995; Riggio & Cole, 1992; Wohl- ers, Hall, & London, 1993), the number of studies spe- cifically linking levels of self-other ratings congruence to managerial effectiveness or performance are relatively few. Moreover, the generalizability of the findings that do exist (e.g., Atwater & Yammarino, 1992; Van Velsor et al., 1993), although important in establishing a relationship between performance and MSA, has been somewhat lim- ited because of small sample sizes and the unique nature of the observed organizations (i.e., naval officers and hos- pital administrators). Thus, even though practitioners in the field of organizational change and development have been operating according to the principle of enhancing self-awareness through data-based methods for years (e.g., Burke, 1982; Nadler, 1977), and numerous leader- ship, executive, and management development efforts have been initiated on the steadfast belief that enhanced self-awareness leads to increased performance (e.g., Ber- nardin, 1986; Burke, Richley, & DeAngelis, 1985; Ship- 281

Upload: doannhu

Post on 03-Apr-2018

222 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

Journal of Applied Psychology1997, Vol. 82, No. 2, 281-292

Copyright 1997 by the American Psychological Association, Inc.002I-9010OT/$3.00

Managerial Self-Awareness in High-PerformingIndividuals in Organizations

Allan H. ChurchW. Warner Burke Associates

Individual differences in the construct of managerial self-awareness (MSA) —operation-

alized as congruence between self and direct reports' behavioral ratings—were examined

in 134 high-performing (HP) and 470 average-performing (AV) managers obtained from

4 independent datasets. Results based on several different approaches to measuring ratings

agreement indicated that HPs were significantly more managerially self-aware compared

with AVs. This relationship was consistent regardless of data source, organization, or

method of assessing managerial performance. No overall relationships were found be-

tween congruence and level of item importance, gender, management level, age, or tenure.

When compared with other measures for assessing self-focus, the construct of self-

monitoring was found to be convergent with managerial self-awareness, whereas the

construct of self-consciousness appeared to reflect primarily rating leniency effects. The

article concludes with a comparison of the measurement approaches used, limitations,

and suggestions for further study.

With the rising popularity of multirater or 360 degreefeedback systems in organizations (e.g., Church, 1995;Hazucha, Hezlett, & Schneider, 1993; London & Beatty,1993) designed explicitly to enhance self-knowledge andimprove managerial behavior, a number of researchershave begun exploring the psychological concept of self-awareness from an applied ratings-based perspective (e.g.,Atwater & Yarnmarino, 1992; Van Velsor, Taylor, & Leslie,1993; Wohlers & London, 1989). From this perspective,the greater a given individual's level of managerial self-awareness (MSA) (i.B;, the ability to reflect on and accu-rately assess one's own behaviors and skills as they aremanifested in workplace interactions), the greater the ex-pected level of congruence between his or her self-assess-ments and those provided by direct reports or by peers.Conceptualized as both a personality trait and a skill,

the construct of MSA is likely to interact with the self-perception process prior to assessment (Campbell & Lee,

1988; Figurski, 1987; Yammarino & Atwater, 1993),which in turn moderates the "self-other" rating compari-son. By applying the notion of MSA to performance rat-ings research, this perspective has provided some new and

I would like to thank Warner Burke for his theoretical contri-

bution, Janine Waclawski for her constructive feedback and en-

couragement, and Mary Zippo for her proofing assistance.

Correspondence concerning this article should be addressed

to Allan H. Church, Principal, W. Warner Burke Associates,

Inc., 201 Wolfs Lane, Pelham, New York 10803. Electronic mail

may be sent via Internet to [email protected].

interesting insights into the general lack of agreementobserved in ratings from multiple sources (e.g., Furn-ham & Stringfield, 1994; Harris & Schaubroeck, 1988;Landy & Fair, 1980).

Although MSA is intrinsically interesting, its signifi-cance to researchers and practitioners is limited unlessdifferences in self-awareness, as measured by congruence

in ratings, can be linked to other key variables such asindividual performance. Unfortunately, although much ap-plied research has explored managers' perceptions of theirown behaviors compared with those of their subordinates,peers, and supervisors (e.g., Arnold & Davey, 1992; Bor-man, White, & Dorsey, 1995; Riggio & Cole, 1992; Wohl-ers, Hall, & London, 1993), the number of studies spe-cifically linking levels of self-other ratings congruence

to managerial effectiveness or performance are relativelyfew. Moreover, the generalizability of the findings that do

exist (e.g., Atwater & Yammarino, 1992; Van Velsor et al.,1993), although important in establishing a relationshipbetween performance and MSA, has been somewhat lim-ited because of small sample sizes and the unique natureof the observed organizations (i.e., naval officers and hos-pital administrators). Thus, even though practitioners inthe field of organizational change and development havebeen operating according to the principle of enhancingself-awareness through data-based methods for years(e.g., Burke, 1982; Nadler, 1977), and numerous leader-ship, executive, and management development effortshave been initiated on the steadfast belief that enhancedself-awareness leads to increased performance (e.g., Ber-nardin, 1986; Burke, Richley, & DeAngelis, 1985; Ship-

281

Page 2: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

282 RESEARCH REPORTS

per & Neck, 1990), researchers are just beginning to build

evidence to support this contention. Such proof is needed,

however, to (a) justify the staffing and production costs

associated with multirater feedback efforts and (b) ad-

vance understanding of the rating process in general.

The purpose of this article is to replicate and extend

the results of previous studies (e.g., Atwater & Yammar-

ino, 1992; Van Velsor et al., 1993) regarding the construct

of MSA and its link to performance vis-a-vis self-other

ratings congruence. This will be achieved through the use

of (a) several different organizational samples that are

more representative of general management populations

and (b) a variety of different measures of managerial

performance. In addition, given the need to validate the

use of self-other ratings congruence as a means of as-

sessing MSA, the relationship among this operationaliza-

tion and other more established measures of self-directed

attention—for example, self-monitoring (Snyder, 1974)

and self-consciousness (Fenigstein, Scheier, & Buss,

1975)—is also examined. Finally, the impact of various

moderating variables (e.g., gender, management level, age,

and tenure) is explored as well.

More specifically, several research hypotheses were

tested. As noted above, many practitioners and researchers

(e.g., Ashford & Tsui, 1991; McCall, Lombardo, & Mor-

rison, 1988; Sinetar, 1988) have argued that self-aware-

ness is an important ability and skill set for achieving

managerial excellence. Thus, better managers should be

more adept at assessing the level of their own behaviors

and the impact those behaviors have on others. Moreover,

high performers and high potentials in organizations

should also exhibit greater levels of MSA because they

presumably have already been identified as possessing

promising managerial characteristics such as strong inter-

personal, leadership, and communication skills (Den;

Jones, & Toomey, 1988; Garfield, 1986) and are often

given significantly greater developmental opportunities

that serve to enhance their abilities.

There will be a significant relationship between managerialperformance and congruence in self-other behavioral rat-ings. High-performing and/or high-potential individualswill be more managerially self-aware and will, therefore,achieve higher congruence between self-based and otherbehaviorally based ratings compared with average-per-forming individuals. (Hypothesis 1)

The contribution of individual cognitions to the pro-

cessing of information, decision making, and memory

functioning (e.g., Bandura & Jourden, 1991; Hendrick,

1990; Lewicki, 1983) must also be considered as a poten-

tial moderator in any ratings-based self-awareness per-

spective. If a given behavior is not considered meaningful;

that is, its standard of comparison is considerably lower

relative to other behaviors (Carver & Scheier, 1981; Klein,

1989), then the individual is far less likely to monitor,

assess, and cognitively record his or her actions in that

given area (DeNisi & Williams, 1988; Zalesny & High-

house, 1992). Conversely, those behaviors perceived as

important to an individual should receive greater attention

in the observation process, yielding more accurate self-

ratings (i.e., in agreement with others' observations).

There will be a significant relationship between level ofperceived importance of the behaviors being rated and over-all congruence in self-other ratings received. The more anindividual manager identifies a behavior as important to hisor her managerial success, the more perceptual attentionwill be directed to its practice and, therefore, the greaterthe probability that MSA (i.e., overall congruence in self-ratings vs. others' ratings) will be enhanced. (Hypoth-esis 2)

Individual differences in convergent theories of person-

ality must also be considered in any attempt to explain

differences in the level of agreement in performance rat-

ings. In particular, both the self-monitoring (Snyder, 1974,

1987) and the self-consciousness constructs (e.g., Buss,

1980; Fenigstein, 1987; Fenigstein et al., 1975) appear to

have direct relevance to the level of self-other agreement

obtained if this measure in fact reflects an appropriate

operationalization of MSA. In summary, self-monitoring

theory posits that individuals differ on the extent to which

they actively monitor, regulate, and/or control their own

expressive behaviors in the presence of others. Low self-

monitors tend to behave according to their own inner

states rather than external socially driven cues, and high

self-monitors behave in the opposite; that is, they are

driven by interpersonal situations rather than internal con-

victions (Briggs & Cheek, 1988; Snyder, 1987). Thus,

high self-monitors are more likely to attend to and assess

their own behaviors in the workplace.

There will be a significant relationship between self-moni-toring and MSA (agreement in ratings) such that high self-monitors will demonstrate greater congruence. (Hypoth-esis 3)

Similarly, Fenigstein et al.'s (1975) notion of self-con-

sciousness conceptualizes individuals as falling along a

continuum with regard to level of self-focus. They de-

scribed two distinct components of self-focus: public and

private self-consciousness. Public self-consciousness

(SC) occurs when one feels under the scrutiny of a "so-

cial other" in regard to personal appearance, manners,

presentation style, or physical quirks. People high in pub-

lic SC are generally more sensitive to the opinions and

evaluations of others based on their physical appearance

in social situations (Bennett & Buchanan-Barrow, 1993;

Buss, 1980; Schlenker & Weigold, 1990). In comparison,

private self-consciousness reflects an orientation toward

the inner world of ideas, concepts, motives, emotions,

memories, and other types of self-reflection. This focus

Page 3: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

RESEARCH REPORTS 283

on the purely internal aspects of self results in both anintensification of the affective charge, deepening depres-sion, heightening elation, and intensifying pain, and in agreater clarification of the phenomena to the self, thusallowing more precise knowledge about the given experi-ence (Buss, 1980). Individuals high in private SC arebetter able to assess their own behaviors in such areas asaggression, humorous stimuli, speed of processing infor-mation, and compliance; they also have quicker access toand more highly developed self-schemata (e.g., Briere &Vallerand, 1990; Gibbons, 1983; Nasby, 1989).

There will be a significant relationship between private SCand MSA (agreement in ratings) such that people high inprivate SC will achieve greater congruence. (Hypothesis 4)

Method

Participants

Data were collected from 134 high-performing (HPs) and

470 average-performing (AVs) middle- and senior-level manag-

ers and their direct reports from three different organizations and

industries: technological, pharmaceutical, and airline services.

Although three organizations are represented, four independent

datasets were used for analytic purposes (one senior-level sam-

ple and one middle management-level sample from the same

technological firm). All individuals were involved in some form

of leadership, management, or executive training seminar prior

to which various measures of managerial behavior were col-

lected from their direct reports. Responses were collected with

an anonymous distribution process. This process ensured as

much as possible that the ratings obtained from others reflected

an accurate assessment of that manager's behavior in the work-

place. Moreover, because ratings were completed independently

and were not divulged until the conduct of the program, it is

extremely unlikely that direct reports' scores were influenced

by the manager's self-assessments or vice versa. These data were

subsequently delivered to each participant during the course

of the program in the form of individual feedback reports for

development purposes. The selection process for inclusion in

the development programs differed somewhat among the four

samples. In the airline service and pharmaceutical organizations,

the entire senior management population was included in the

feedback process. In the technological organization, both the

senior-executive and middle-manager samples were a combina-

tion of (a) selection by superiors for attendance and (b) interest

in development and training.

In total, high performers were rated by 973 direct reports and

average performers by 3,398 direct reports. The mean age of

the manager sample among the 74.1% that provided this infor-

mation was 49.4 years (SD — 9.44). The average tenure with

the organization, based on responses from 76.8% of respon-

dents, was 16.2 years (SD = 9.14). There were no significant

differences between the two groups in mean age or overall ten-

ure. In terms of gender, the sample was heavily biased, with

87.7% men and 12.3% women. Most women were from the

middle-manager sample in the technological organization

(28.6% of Sample 1). A significant chi-square indicated that

there was a greater proportion of women among the HPs than

in the AVs; 20% vs. 10%; x 2U< N = 514) = 8.3, p < .01.

With respect to management level, 55.6% of the sample were

middle managers, and 44.4% were senior executives. Each of

the three organizations had adequate representation at both lev-

els. For the technological organization, Sample 1 was comprised

entirely of middle managers, whereas Sample 2 included only

senior managers. Sample 3 and Sample 4 were also split between

middle and senior levels at 49.4% versus 50.6% and 64.9%

versus 35.1%, respectively. There were no significant demo-

graphic relationships between level and performance group.

Procedure

Behavior ratings and demographic information were obtained

from a database containing the accumulated scores from each

company's training program. Because individuals were assessed

on a variety of different management behaviors, some of which

were similar in terms of content, individual item-content level

comparisons were not investigated, as the specific wording was

such that direct content comparisons between samples would

have been problematic. Instead, analyses were based on the

overall level of agreement in self-reports' versus direct reports'

average ratings across each organization's instrument.

Individuals in each of the four datasets were assigned to either

a high-performing or an average-performing classification on

the basis of information obtained from their respective organiza-

tions. Table 1 provides an overview of the selection criteria used

for each sample and the resulting number of managers selected

in the HP and jW groups. Methods of performance assessment

ranged from external assessment that was based on case histories

of each manager to a more informal selection by the highest

level managers, a process that despite its subjectivity is a quite

common method of selecting future leaders in organizations

(e.g., Derr et al., 1988; Garfield, 1986). Although quantitative

measures of performance are preferable for analytic purposes,

it was not possible to obtain this level of detail. It should also

be noted that at the time of the self-other data collection pro-

cess, the performance group designation was neither known

nor communicated to individual participants. Thus, the level of

performance and/or the designation of being a high performer

would not have had a direct impact on the actual ratings obtained

from managers or their direct reports.

Measures

The degree of MSA for an individual was operationalized as

the collective level of agreement or congruence between self-

ratings and averaged others' ratings across a number of behav-

iorally based indices. Because there is considerable diversity of

opinion about how such agreement or congruence should be

measured (e.g., Berger-Gross, 1982; Edwards, 1994; Johns,

1981; Tisak & Smith, 1994; Zimmerman, 1994), several differ-

ent methods were generated and compared for analysis pur-

poses.1 The primary method used for the results in this study

consisted of the following.

1 Given the increasing popularity of research on behavioral

ratings, a number of alternative methods of assessing congruence

in ratings are available. Although the measures used in the pres-

ent research represent more traditional methods for comparison,

Page 4: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

284 RESEARCH REPORTS

Table 1

Composition of Dtttasets

Industry, program source, andsample description Peformance group selection criteria

No. high No. average No.performers performers items

Self- Direct reportratings ratings

TechnologyMiddle management

development programs

TechnologySenior executive

development programsPharmaceutical

Senior executivedevelopment programs

Airline serviceSenior and middle

management developmentprograms

Selection into a very competitive high potential 56senior executive service candidate development

program based on work history, performanceand achievements, and supervisor evaluations.Total pool of applicants over 1,000.

Recipient of any one of the following: meritorious, 49distinguished, or other position awards.

Identified by senior most members of the 15organization as being high performers or highpotential for future leadership role.

Independent study by external consulting firm of 14executive performance and future potentialbased on combination of personality assessment,performance history, skills, and one-on-one

interviews.

131 21 .94

23 49 .97

.90

242 40 .90 .97

74 37 .89 .96

.98

Difference score approach. This measure of MSA used a

standard index of similarity that was based on the absolute

average profile difference in the ratings obtained. Referred to

in the literature as d (Edwards, 1994; Nunnally, 1978), this

index is computed with the square root of the sum of squared

(i.e., absolute) differences between self-report and average di-

rect report score for each self-other item comparison divided

by the total number of items for that sample. This measure was

chosen because of its superior sensitivity to differences in profile

level, dispersion, and shape (Nunnally, 1978; Tisak & Smith,

1994; Zimmerman, 1994). For comparison purposes, a second

difference score measure was also generated. It was based on

the relative average item difference between self-reports and

direct reports across each of the behaviorally based questions.

Computed with the actual arithmetic average of the differences

obtained, this measure reflects the degree or direction, as well as

the magnitude of the differences obtained (Wohlers & London,

1989). Difference scores of these types have been one of the

primary means by which ratings congruence has been assessed

in the literature (e.g., Ashford & Tsui, 1991; Wexley & Pulakos,

1983; Wohlers et al., 1993; Zalesny & Highhouse, 1992).2 Be-

cause the formula for both of these measures utilized an average

of uniquely matched self-direct report comparisons across a

series of item ratings for each individual, these data had the

potential to yield more sensitive results than would analyses

that were based on more global comparison of the difference

between total self and total direct reports' scores. Other types

other approaches such as the three-group classification into un-

derraters, accurate-raters, and overraters (e.g., Atwater & Yam-

marino, 1992; Van Velsor et al., 1993), the T index and the six

category scheme (e.g., Brutus, Heenor & Taylor, 1996), and

r-sub(Wo) (e.g., James, Demaree, & Wolf, 1993) are also

available.

of summary driven approaches (e.g., those used by Atwater &

Yammarino, 1992, and Van \felsor et al., 1993) are ultimately

measuring the general rating tendency of an individual—that

is, as an underrater or an overrater—and not the cumulative

degree of congruence across a series of specific comparisons.

Between-manager correlations. Another commonly re-

ported measure of self-other congruence in the literature is

the Pearson correlation between the average self-score and the

corresponding average others' ratings (e.g., Fumham &

Stringfield, 1994; Nowack, 1992; Riggio & Cole, 1992). Al-

though this value has been found to be notoriously low in vari-

ous quantitative reviews (e.g., Harris & Schaubroeck, 1988;

R. L. Heneman, 1986; Mabe & West, 1982) because it reflects

overall standing in a given sample on the total instrument and

not agreement in individual ratings, it is a useful measure to

compute for comparison with previous research.

The behavioral items from each of the organization-specific

instruments ranging from 21 for the middle managers from the

technological firm to 49 for the service executives,3 were gener-

2 Although some researchers (e.g., Edwards, 1994) have ar-

gued that polynomial regression models are the preferred alter-

native to any type of difference score analysis, this approach

was not used because it did not appropriately fit the categoricalnature of the performance data collected. Moreover, this typeof analysis assumes that the predictor is actually intended to

account for the variance in a grouping variable (e.g., perfor-

mance). Such a causal relationship was neither hypothesized inthe present study nor testable, given the type and content of the

data collected.3 The impact of differences in the specific content and number-

of items across the four samples on the various measures ofcongruence in ratings was examined indirectly by including data

source in each of the analyses. None of the results identified

data source as a significant moderating variable.

Page 5: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

RESEARCH REPORTS 285

ated on the basis of a series of individual interviews and focus

groups with cross-sections of managers followed by piloting

and subsequent refinement through statistical and item-re-

sponse techniques. For each item, managers were asked to rate

themselves on a scale of 1 to 5 (where 1 = to a very small

extent and 5 = to a very great extent) as to the extent to which

they engage in a given behavior (see the Appendix for sample

items). These items were also independently rated by direct

reports from individuals who worked closely with that individ-

ual. All items reflected behaviors exhibited by managers in the

work setting. Because research has demonstrated that averaged

ratings are more reliable and therefore better indicators of the

behavior being rated than any single assessment (e.g., Furn-

ham & Stringfield, 1994; London & Wohlers, 1991), the direct

report scores were averaged by item for each manager.

In the technology organization (Samples 1 and 2), additional

information regarding the importance of each of the behaviors

being assessed was also collected. Individuals were also asked

to assess the degree to which the practice of'each behavior was

important for the success of the manager being rated on a 1-to-

5 scale where 1 = not very important and 5 = of critical impor-

tance. An average rating of this type represents the overall de-

gree of perceived importance for a given behavior or set of

behaviors.

Internal consistency coefficients and response analysis tables

were computed for both self-reports and direct reports' average

ratings for all items across each of the four datasets to test for

problematic items. No items were identified for removal. Over-

all, the values of these alpha coefficients ranged from .89 to .97

for self-ratings and .90 to .98 for averaged direct report ratings,

indicating a high degree of internal consistency inherent in the

behavioral measures for each organization.

Additional personality measures reflecting managers' level of

self-focus were assessed with the 18-item true-false revised

version of the self-monitoring questionnaire (Snyder, 1987) and

the original 23-item 0 to 4 Likert-type scale version of the SC

scale (Fenigstein et al., 1975). Both instruments have been

widely used for research purposes and have been tested on

multiple samples. Unfortunately, these additional data were

available only for the high-performing middle managers in the

technology organization (n - 53) assessed at the same time

as the other measures. Thus, the resulting analyses with these

variables were limited to this specific subsample. The internal

reliability of the self-monitoring scale for these managers was

.79. The alpha coefficients for the four self-consciousness mea-

sures were computed at .86 for the total score, .77 for the 10-

item private scale, .79 for the 7-item public scale, and .78 for

the 6-item social anxiety scale.

Analyses

Given the need to accommodate multiple measures of the

level of agreement in self-direct report ratings, it was necessary

to analyze the data with several different statistical approaches.

First, because of the categorical nature of the performance data

as well as the fact that a predictive relationship between perfor-

mance and ratings congruence was neither hypothesized nor

testable given the present data, analysis of variance (ANO\A)

models were selected to test the relationships among the categor-

ical variables (i.e., performance group, gender, level of manage-

ment, and data source) and the two continuous criterion mea-

sures; that is, absolute average profile difference and relative

average item difference score. Additional ANO\As were also

conducted on the total average self-reports and direct reports'

scores by the same grouping variables to look for general trends

in ratings. Simple correlation analyses and Fisher's z scores

were used to test associations among importance scores, be-

tween manager correlations, and other individual variables (e.g.,

age, tenure or personality measures).

Results

Table 2 provides descriptive statistics and correlation

coefficients for all the continuous variables included in the

analyses. As reported in previous research (e.g., Arnold &

Davey, 1992; Mabe & West, 1982; Nowack, 1992; Van

Velsor et al., 1993), there is a general tendency on the part

of managers to rate themselves somewhat higher across all

behaviors than did their direct reports, f(603) = 9.13, p

< .001. This inflation was also evident among importance

ratings between self-reports and direct reports, f(477)

= 12.49, p < .001. The high correlations between total

behavior and importance scores for both self-reports (r

= .63) and direct reports (r — .63) indicated some degree

of common method variance (Mitchell, 1985; Specter,

1987; Williams, Cote, & Buckley, 1989) between the two

sets of ratings as well.

In terms of the overall level of managerial self-aware-

ness vis-a-vis congruence between self-reports and direct

report ratings, the absolute average profile difference for

all managers was 0.82 (SD = 0.32) and a range from

0.32 to 2.13. The relative average item difference score

across these same items was 0.17 (SD = 0.46) and ranged

from —1.12 to 1.86. The correlation between these two

difference score measures was r = .48 (p < .001). Both

approaches reflect the average degree of difference ob-

served across a series of individual item rating compari-

sons. The average between manager correlation, reflecting

similarities in relative standing between self-reports and

direct reports as compared with the total sample, was r

= .25, p < .001. Although relatively weak, this correlation

is similar to those reported in previous research and meta-

analytic comparisons (e.g., Furnham & Stringfield, 1994;

Harris & Schaubroeck, 1988; Wohlers & London, 1989).

In terms of demographic variables, results of a 2 X 2

X 2 X 4 factorial ANOVA model that included manage-

ment level (middle vs. senior manager status), gender,

performance group, and data source as the grouping vari-

ables and profile difference as the criterion yielded no

significant effects for any variable except performance

group. Management level, gender, and data source did not

significantly contribute to the variance explained in the

analysis as either single independent variables or in con-

junction with others. Similar results were found by using

Page 6: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

286 RESEARCH REPORTS

I 2^25

•i r-i "3- -H r~ --•; O (S <N I-H r<

r r r r r

I ^ >-H CO f- ON O C"JI O p q ra — ts cj

r i i i i

i * *ON — t-~^'— "/I'Tf— Mf-l1 • - ' O m O O O O O O O

"I111 ~

the average item difference score as the criterion. Al-

though there were no significant relationships between

age and any of the congruence measures, there was a

small significant positive correlation between age and total

average behavioral ratings for both self-reports and direct

reports (r = .21,p < .001; r = .15,p < .001). Although

the relationship between age and inflation of self-ratings

appears to be a consistent phenomenon, prior research

has suggested that older managers tend to be rated more

negatively (e.g., Lawrence, 1988) or not differentially at

all by others (London & Wohlers, 1991). Organizational

tenure was significantly correlated only with age (r =

.32, p < .001).

Thereupon, analyses testing each of the four research

hypotheses were conducted. Support for Hypothesis 1 was

provided by several different analyses. First, a 2 X 4

factorial ANQ\A model was conducted with the absolute

profile difference measure as the criterion and perfor-

mance group and data source as the grouping variables.

Overall, those individuals identified as HPs yielded sig-

nificantly lower profile difference scores, indicating

greater absolute item level agreement than did №s; M =

.74 versus M = .85, F(l, 596) = 10.70,p < .001. Neither

data source nor the interaction between performance

group and data source was significant. The effect size

(partial r/2) for performance group was .033, somewhere

between a small and medium result (Cohen, 1977; Ste-

vens, 1992). The same 2 x 4 model with average item

difference as the criterion instead yielded exactly the same

result, F(l, 596) = 9.73, p < .01, with HPs (A* = .07)

demonstrating significantly greater average agreement in

ratings compared with №s (M — .20). This significant

effect was also present for the between-manager correla-

tions (r = .38 for HPs vs. r = .20 for AVs, Fisher's z =

2.03, p < .05).

Hypothesis 2 was tested with a correlational approach;

that is, the Pearson correlation between managers' self-

ratings of the degree of behavioral importance and their

level of agreement in ratings. No significant correlations

existed overall between importance ratings by self and

level of profile difference (see Table 2). Interestingly

enough, the relative average item difference between self-

reports and direct reports' ratings was actually positively

correlated with total ratings of item importance by self

(r = .37, p < .001), suggesting instead that the more

important the behaviors the greater the level of difference

observed.

Finally, correlation analyses and one-way ANOVAs

were used to test the remaining two hypotheses. Although

the relationship predicted in Hypothesis 3 between greater

self-monitoring tendencies and agreement in ratings was

supported through a significant correlation with the abso-

lute average profile difference (r - — .31, p < .05), the

relationship with high private self-consciousness specified

Page 7: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

RESEARCH REPORTS 287

in Hypothesis 4 was not significant (see Table 2). The

only significant relationship between any of the self-con-

sciousness scores and the other variables was a negative

Pearson value between average item difference and thetotal self-consciousness scale (r = —.27, p < .05). Not

surprisingly, the two personality constructs (e.g., self-

monitoring and self-consciousness) were not significantly

correlated with one another. Because these additional per-sonality measures were only available for one of the HP

groups, a comparison by performance group was not

possible.

Given the stated concern with the use of differencescores in statistical analyses, additional analyses were

conducted on these same data with the categorical ap-

proach to operationalizing self-awareness following At-

water and Yammarino's (1992) and Van Velsor et al.'s

(1993) research.4 As expected, similar results were ob-

tained with this approach as well; that is, there was a

significantly greater proportion of HPs among accurateraters or self-aware individuals as compared with either

under- or overraters, *2(2, N = 60) = 20.24, p < .001.

When mean scores and correlations for the other measures

of MSA were computed by agreement group, the results

indicated significant convergence among the different

methods. Table 3 provides the details of these additional

analyses.

Discussion

The purpose of this study was to replicate and extend

existing research on the nature and possible moderators of

managerial self-awareness, operationalized as agreement

between self and others' behavioral ratings, and its link

to managerial performance. The results obtained met theseobjectives. With data collected from four independent

samples representing three different types of organiza-

tions and regardless of the nature of the performance crite-

ria, the results consistently indicated that high-performing

managers were able to assess more accurately their own

behaviors in the workplace, yielding greater congruence

in self-reports versus direct reports' ratings compared

with average performers. This relationship was supported

with both item level difference score measures and the

comparison of between manager correlations and the

agreement categorical approach as well. Thus, it is clearfrom this research that high-performing managers have a

greater level of MSA or, at the very least, are better at

assessing and/or rating their own behaviors in the work-place. Although it is impossible given the present data to

assert that enhanced degrees of MSA resulted in their

greater performance, the pattern of enhanced congruenceamong the HPs, regardless of the data source, organiza-tion, criteria for performance group assignment, and num-

ber or content of the items used in the comparison, is

consistent with and lends additional support for the con-

ceptualization of MSA. Moreover, these results serve to

replicate Atwater and Yammarino's (1992) findings be-tween accurate estimators and performance ratings rather

than Van Velsor et al.'s (1993) research. Given the manner

in which performance was operationalized in the latterstudy, however (i.e., as another set of similarly rated

items), this is not surprising. The general tendencies inself-reports' and direct reports' ratings in the present re-

search, however, did replicate trends evident in both these

and other earlier studies.

Though it can be argued that this degree of improve-

ment in ratings congruence by performance group reflects

some other cognitive process (e.g., other-directedness)rather than managerial self-awareness, few other theoreti-

cal orientations explain such differences in performance

as well as does the conceptualization of MSA. For exam-

ple, although it is possible that HPs might merely be more

adept at estimating how their direct reports would rate

them, given the number of direct reports providing ratingsand that the comparison scores were computed with aver-

ages, it is unlikely that managers would be ' 'second guess-

ing" an average direct report rating on each item. For

most individuals, it is probably far easier to assess the

relative degree to which they exhibit a certain behavior

than to calculate some arbitrary average. Moreover, even

if such a self-referenced process were occurring, it wouldhave to be moderated at least to some degree by the man-

ager's own perceptions of how he or she behaves in the

workplace (which reflects the MSA concept as well).

Finally, because both performance groups had sizable por-

tions of overraters and underraters, it is unlikely that sim-

ple measurement issues such as modesty in self-ratings

or inflated direct reports' ratings for HPs in general are

appropriate alternative explanations for the results.With respect to the appropriateness of using any form

of congruence in self—other ratings to measure the con-

struct self-awareness, the significant correlation between

managers' self-scores on the self-monitoring question-

naire (Snyder, 1974,1987) and the absolute profile differ-

ence index support this method of operationalization. Indi-

viduals high in the personality trait of self-monitoring

tended to have more accurate self-assessments, regardless

4 Using this approach, managers were categorized according

to the following parameters: Accurate raters were those manag-

ers whose average total self scores across all items fell within

one-half standard deviation of the mean overall direct report

rating for the entire sample plus or minus the actual rating given

by their direct reports; underraters were those managers whose

self scores were lower than their direct reports' ratings, plus

0.5 SD of the total others' ratings; overraters were those individ-

uals with total self scores 0.5 SD above their direct reports'

overall ratings.

Page 8: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

288 RESEARCH REPORTS

3 r> o\ oV"! t- t—

10 — « iri ou-> vi •fl- in

li>j

O ^^ CO "«D

<N — m •*o d o d

oo r~- o^ ooCN <s fn rnd d d d

in oo en r-

d d d d

— m inON -^ O\

^ -"J- r~oo r-

S rt

Us

» S V

of direction, on an absolute average item level, supporting

Hypothesis 3. Although low self-monitors in this study

tended to behave in consistent ways across situations, it

appears that they are likely to be less focused on these

behaviors. On the other hand, people high in self-monitor-

ing tend to focus on the manner in which they express

themselves, including then: behaviors, in social situations.

Thus, the notion of self-monitoring provides some conver-

gence on the construct of MSA vis-a-vis difference score

ratings comparisons.

Interestingly enough, however, none of the self-con-

sciousness scores, which represent the second alternative

approach to measuring self-awareness, yielded significant

correlations with the absolute profile difference measure.

The only significant correlation among these scale scores

was a negative relationship between the relative average

item difference measure and for the total SC score. Given

the complexities of interpreting a correlation coefficient

that was based on a bipolar measure, a subsequent exami-

nation of the scatterplot of these two variables indicated

that managers high in total self-consciousness tended to

have average difference scores below zero, whereas those

low in the total SC score tended to rate themselves higher

than did their direct reports. In general, the linear trend

in the means and the scatterplot suggest that the SC mea-

sure is more reflective of a modesty or evaluative bias

than a representation of MSA. Given the conceptual un-

derpinnings of the self-consciousness construct (e.g.,

Buss, 1980; Fenigstein et al., 1975), this makes sense.

Individuals high in overall self-consciousness are focused

on the self in terms of internal states, public appearances,

and social anxiety. It seems likely that such a degree of

self-focus can result in a tendency to underrate oneself,

particularly given the evaluative component of the self-

consciousness framework. Thus, the self-monitoring con-

struct seems to reflect more of a self-assessment perspec-

tive, and the self-consciousness approach appears to have

more of a ratings leniency or self-evaluative focus. This

might also explain why these two personality measures

were not significantly correlated in the present sample.

Furthermore, these results provide additional insight into

the present debate in the literature regarding which of the

two conceptualizations represents a truer assessment of

self-focus (e.g., Briggs & Cheek, 1988; Fenigstein, 1987;

Miller & Thayer, 1989; Snyder & Gangestad, 1986;

Wicklund & Gollwitzer, 1987).

Another variable hypothesized to be related to MSA as

measured by congruence concerned the extent to which

a manager perceived a specific set of practices to be criti-

cal to his or her successful performance in the organiza-

tion. In general, the results of the simple correlational

analyses failed to support Hypothesis 2, that is, the rela-

tionship between importance ratings and the absolute pro-

file difference measure was nonsignificant. In fact, the

Page 9: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

RESEARCH REPORTS 289

significant correlation between the relative average item

difference score and total ratings of item importance byself suggested the opposite relationship to the one origi-nally proposed. That is, the more important the behaviorsbeing rated, the greater the average level of differenceobserved between self versus direct reports' ratings. Whilesuch a conclusion might be warranted from these results,it is also possible that scale limitations inherent in the useof importance ratings (e.g., ceiling effects or overratingtendencies) may have contributed to these unanticipatedfindings, particularly given the importance mean value (M= 4.17) observed for self-ratings. Additionally, becausethe correlational approach used to test this hypothesis wasconducted at the summary score rather than individualitem level of analysis, it is also possible that more complexrelationships may have been present but less easily detect-able. In any case, more research is needed to clarify theexact nature of the relationship between importance rat-ings and MSA.

Finally, a few comments are warranted regarding thecomparative utility of each of the different approaches tomeasuring self- and others' ratings agreement. Of the twodifference score measures, both of which reflect item levelcomparisons, the absolute profile difference yielded moresignificant relationships with the grouping variables thandid the relative average item difference score. Althoughthe average item difference provided additional informa-tion regarding the direction of the difference obtained, and

is generally more intuitively interpretable from a ratingsperspective, significant detail is lost due to the averagingprocess; for example, a series of large overratings andlarge underratings for the same individual would net outto an accurate average score indicating little difference.The absolute profile difference measure is not susceptibleto this issue since all differences are squared before beingaveraged. In part, this may explain the greater utility ofprofile difference in the present study. Thus, in general,it is recommended that both the profile difference measureand the item difference measures be used for future itemlevel difference score computations in order to adequatelyaccount for the item-by-item ratings profile, the direction-ality of the ratings obtained, and general level effectsamong different sets of raters.

Limitations of the Research

There are several limitations to this research that needto be addressed. First, although the reliabilities of theitems used to generate the comparison measures werehigh, the content among the different sets (e.g., represent-ing different dimensions of behavior) was not explored.Another limitation concerns the composition and compar-ative sample sizes of the individuals from whom the datawere collected. It is likely that there may have been insuf-

ficient power to detect significant differences among cer-tain groups (e.g., between female and male HPs). Addi-

tionally, other potential moderators, such as education,training, ethnicity, span of control, frequency of contactwith people providing ratings, remain unexamined. Thegeneralizability of the findings obtained is also a concern.Although managers' data from three different organiza-tions were involved in the analyses, all of these individualswere at the very least adequate enough performers to beincluded in some form of developmental training program.How these average individuals actually compare withthose who perform poorly is unknown. Moreover, giventhe imperfect nature of the performance criteria, it is pos-sible that other factors and concerns were involved in theHP identification process. Because HPs did yield signifi-cantly higher congruence in ratings regardless of the selec-tion criteria, however, the results should have some degreeof external validity. Finally, although the differences ob-tained were consistently significant across a variety ofanalyses, it is important to remember that the presentresearch is descriptive rather than causal. Thus, how theHPs actually became more self-aware (e.g., an inherentability or a skill developed through social interactions)or whether the presence of MSA actually resulted in orcontributed to their achieving a high-performance desig-nation are unanswerable questions, given the present re-search design. Although it is plausible that MSA playedat least some part in these individuals' successful perfor-mance, this relationship cannot be stated with absoluteconfidence.

Suggestions for Future Research

Future research is needed to test the assumption thathigher levels of MSA eventually lead to increased perfor-mance in the workplace. The presence of a causal linkagecan be examined through the use of a longitudinal design,whereby MSA is assessed initially and then tracked forseveral years and across various interventions (e.g.,multirater feedback) to determine changes in MSA andcareer success. Such research could also be used to iden-tify the degree to which MSA is an inherent trait versusa skill set, as well as to help clarify conflicting resultsregarding the stability of self-other discrepancies overtime (e.g., London & Wohlers, 1991; Nilsen & Campbell,1993). Future studies could also explore the extent towhich managers differ in assessing themselves in specificcontent areas (e.g., task vs. people behaviors, work groupclimate, leadership skills, or customer service), and withrespect to different constituents in the workplace (e.g.,peers, subordinates, supervisors, and customers). Relatedto this issue is the need to link MSA with other types ofself-awareness and situations in which it might be presentsuch as whether self-awareness in the workplace translates

Page 10: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

290 RESEARCH REPORTS

to self-awareness at home with family and friends. These

types of studies contribute to establishing a theoretical

foundation for MSA, as would research exploring self-

awareness in relation to various other perspectives such

as information processing or other-directedness. Finally,

future work could also be directed at determining alterna-

tive and more direct methods for assessing MSA beyond

the ratings congruence paradigm.

References

Arnold, J., & Davey, K. M. (1992). Self-ratings and supervisor

ratings of graduate employees' competencies during early ca-

reer. Journal of Occupational and Organizational Psychol-

ogy, 65, 235-250.

Ashford, S. J., & Tsui, A. S. (1991). Self-regulation for manage-

rial effectiveness: The role of active feedback seeking. Acad-

emy of Management Journal, 34, 251-280.

Atwater, L. E., & Yammarino, F. J. (1992). Does self-other

agreement on leadership perceptions moderate the validity of

leadership and performance predictions? Personnel Psychol-

ogy, 45, 141-164.

Bandura, A., & Jourden, F. J. (1991). Self-regulatory mecha-

nisms governing the impact of social comparison on complex

decision making. Journal of Personality and Social Psychol-

ogy, 60, 941-951.

Bennett, M., & Buchanan-Barrow, E. (1993). Public self-con-

sciousness in perceptions of disrupted interaction. Journal ofSocial Psychology, 133, 407-409.

Berger-Gross, V. (1982). Difference score measures of social

perceptions revisited: A comparison of alternatives. Organiza-

tional Behavior and Human Performance, 29, 279-285.

Bernardin, H. J. (1986). Subordinate appraisal: A valuable

source of information about managers. Human Resource

Management, 25, 421-439.

Borman, W. C., White, L. A., & Dorsey, D. W. (1995). Effects

of ratee task performance and interpersonal factors on super-

visor and peer performance ratings. Journal of Applied Psy-

chology, 80, 168-177.

Briere, N. M., & Vallerand, R. J. (1990). Effect of private self-

consciousness and success outcome on causal dimensions.

Journal of Social Psychology, 130, 325-331.

Briggs, S. R., & Cheek, J. M. (1988). On the nature of self-

monitoring : Problems with assessment, problems with valid-

ity. Journal of Personality and Social Psychology, 54, 663-

678.

Brutus, S., Fleenor, J. W., & Taylor, S. (1996, April). Impact of

different congruence methodologies on 360-degree feedback

research. Poster presented at the 11th Annual Conference of

the Society for Industrial and Organizational Psychology, San

Diego, CA.

Burke, W. W. (1982). Organization development: Principles

and practices. Glenview, IL: Scott, Foresman.

Burke, W. W., Richley, E. A., & DeAngelis, L. (1985). Chang-

ing leadership and planning processes at the Lewis Research

Center, National Aeronautics and Space Administration. Hu-

man Resource Management, 24, 81-90.

Buss, A. H. (1980). Self-consciousness and social anxiety. San

Francisco: Freeman.

Campbell, D. J., & Lee, C. (1988). Self-appraisal in perfor-

mance evaluation: Development versus evaluation. Academy

of Management Review, 13, 302-314.

Carver, C. S., & Scheier, M. F. (1981). Attention and self-regu-

lation: A control theory approach to human behavior. New

Tfork: Springer-Verlag.

Church, A.H. (1995). First-rate multirater feedback. Train-

ing & Development, 49(8), 42-43.

Cohen, J. (1977). Statistical power analysis for the behavioralsciences (2nd ed.). New 'York Academic Press.

DeNisi, A. S., & Williams, K. J. (1988). Cognitive approaches

to performance appraisal. In G. R. Jferris & K. M. Rowland

(Eds.), Research in personnel and human resources manage-

ment (Vol. 6., pp. 109-155). Greenwich, CT JAI Press.

Derr, C. B., Jones, C., & tbomey, E. L. (1988). Managing high-

potential employees: Current practices in thirty-three U. S.

corporations. Human Resource Management, 27, 273-290.

Edwards, J. R. (1994). The study of congruence in organiza-

tional behavior research: Critique and a proposed alternative.

Organizational Behavior and Human Decision Processes, 58,

51-100.

Fenigstein, A. (1987). On the nature of public and private self-

consciousness. Journal of Personality, 37, 1282-1292.

Fenigstein, A., Scheier, M. F., & Buss, A. H. (1975). Public and

private self-consciousness: Assessment and theory. Journal

of Consulting and Clinical Psychology, 43, 522-527.

Figurski, T. J. (1987). Self-awareness and other-awareness: The

use of perspective in everyday life. In K. Yardley & T. Honess

(Eds.), Self and identity: Psychosocial perspectives (pp.

197-210). New York: Wiley.

Furnham, A., & Stringfield, P. (1994). Congruence of self and

subordinate ratings of managerial practices as a correlate of

supervisor evaluation. Journal of Occupational and Organi-

zational Psychology, 67, 57—67.

Garfield, C. (1986). Peak performers: The new heroes of Amer-

ican business. New \brk: Avon Books.

Gibbons, F. X. (1983). Self-attention and self-report: The

'veridicality' hypothesis. Journal of Personality, 51, 517-

542.Harris, M. M., & Schaubroeck, J. (1988). A meta-analysis of

self-supervisor, self-peer, and peer-supervisory ratings.

Personnel Psychology, 41, 43-62.

Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The

impact of 360-degree feedback on management skills devel-

opment. Human Resource Management, 32(2-3), 325-351.

Hendrick, H. W. (1990). Perceptual accuracy of self and others

and leadership status as functions of cognitive complexity. In

K. E. Clark & M. B. Clark (Eds.), Measures of leadership

(pp. 511-518). Greensboro, NC: Center for Creative

Leadership.

Heneman, H. G., HI. (1974). Comparisons of self- and superior

ratings of managerial performance. Journal of Applied Psy-

chology, 59, 638-642.

Heneman, R. L. (1986). The relationship between supervisoryratings and results-oriented measures of performance: A meta-

analysis. Personnel Psychology, 39, 811-826.James, L. R., Demaree, R. G., & Wolf, G. (1993). r-sub(wg):

An assessment of within-group interrater agreement. Journal

of Applied Psychology, 78, 306-309.

Page 11: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

RESEARCH REPORTS 291

Johns, G. (1981). Difference score measures of organizational

behavior variables: A critique. Organizational Behavior and

Human Performance, 27, 443—463.Klein, H. J. (1989). An integrated control theory model of work

motivation. Academy of Management Review, 14, 150-172.

Landy, E, & Farr, J. (1980). Performance rating. Psychological

Bulletin, 87, 72-107.

Lawrence, B. S. (1988). New wrinkles in the theory of age:

Demography, norms, and performance ratings. Academy of

Management Journal, 31, 309-337.

Lewicki, P. (1983). Self-image bias in person perception. Jour-

nal of Personality and Social Psychology, 45, 384-393.

London, M., & Beatty, R. W. (1993). 360-degree feedback as

a competitive advantage. Human Resource Management,

32(2-3), 353-372.

London, M., & Wohlers, A. J. (1991). Agreement between sub-

ordinate and self-ratings in upward feedback. Personnel Psy-

chology, 44, 375-390.

Mabe, P. A., ffl, & West, S. G. (1982). Validity of self-evalua-

tion of ability: A review and meta-analysis. Journal of Ap-

plied Psychology, 67, 280-296.

McCall, M.W., Jr., Lombardo, M. M., & Morrison, A.M.

(1988). The lessons of experience: How successful executives

develop on the job. Lexington, MA: Lexington Books.

Miller, M. L., & Thayer, J. E (1989). On the existence of dis-

crete classes in personality: Is self-monitoring the correct

joint to carve? Journal of Personality and Social Psychology,

57, 143-155.

Mitchell, T. R. (1985). An evaluation of the validity of correla-

tional research conducted on organizations. Academy of Man-

agement Review, 10, 192-205.

Nadler, D. A. (1977). Feedback and organization development:

Using data-based methods. Reading, MA: Addison-Wesley.

Nasby, W. (1989). Private self-consciousness, self-awareness,

and the reliability of self-reports. Journal of Personality and

Social Psychology, 56, 950-957.

Nilsen, D., & Campbell, D. P. (1993). Self-observer rating dis-

crepancies: Once an overrater, always an overrater? Human

Resource Management, 52(2-3), 265-281.

Nowack, K. M. (1992). Self-assessment and rater-assessment as

a dimension of management development. Human Resource

Development Quarterly, 3, 141-155.

Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New

York: McGraw-Hill.

Riggio, R. E., & Cole, E. J. (1992). Agreement between subor-

dinate and superior ratings on supervisory performance and

effects on self and subordinate job satisfaction. Journal of

Occupational and Organizational Psychology, 65, 151-158.

Schlenker, B. R., & Weigold, M. E (1990). Self-consciousness

and self-presentation: Being autonomous versus appearing au-

tonomous. Journal of Personality and Social Psychology, 59,

820-828.

Shipper, E, & Neck, C. P. (1990). Subordinates' observations:

feedback for management development. Human Resource

Development Quarterly, 1, 371-385.

Sinetar, M. (1988). Building trust into corporate relationships.

Organizational Dynamics, 16(3), 73-79.

Snyder, M. (1974). Self-monitoring of expressive behavior.

Journal of Personality and Social Psychology, 30, 526-537.

Snyder, M. (1987). Public appearances/private realities: The

psychology of self-monitoring. San Francisco: Freeman.

Snyder, M., & Gangestad, S. (1986). On the nature of self-

monitoring: Matters of assessment, matters of validity. Jour-

nal of Personality and Social Psychology, 51, 125-139.

Spector, P. E. (1987). Method variance as an artifact in self-

reported affect and perceptions at work: Myth or significant

problem? Journal of Applied Psychology, 72, 438-443.

Stevens, J. (1992). Applied multivariate statistics for the social

sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

Tisak, J., & Smith, C. S. (1994). Defending and extending dif-

ference score methods. Journal of Management, 20, 675-

682.

Van Velsor, E., Taylor, S., & Leslie, J. B. (1993). An examina-

tion of the relationships among self-perception accuracy, self-

awareness, gender, and leader effectiveness. Human Resource

Management, 32(2-3), 249-263.

Wexley, K. N., & Pulakos, E. E. (1983). The effects of percep-

tual congruence and sex on subordinates' performance ap-

praisals of their managers. Academy of Management Journal,

26, 666-676.

Wicklund, R. A., & Gollwitzer, P.M. (1987). The fallacy of

the private-public self-focus distinction. Journal of Person-

ality, 55, 491-523.

Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of

method variance in self-reported affect and perceptions at

work: Reality or artifact? Journal of Applied Psychology, 74,

462-468.

Wohlers, A. J., Hall, M., & London, M. (1993). Subordinates

rating managers: Organizational and demographic correlates

of self/subordinate agreement Journal of Occupational and

Organizational Psychology, 66, 263-275.

Wohlers, A. J., & London, M. (1989). Ratings of managerial

characteristics: Evaluation difficulty, co-worker agreement,

and self-awareness. Personnel Psychology, 42, 235-261.

Yammarino, E J., & Atwater, L. E. (1993). Understanding self-

perception accuracy: Implications for human resource man-

agement. Human Resource Management, 32(2-3), 231-247.

Zalesny, M. D., & Highhouse, S. (1992). Accuracy in perfor-

mance evaluations. Organizational Behavior and Human De-

cision Processes, 51, 22-50.

Zimmerman, D. W. (1994). A note on interpretation of formulas

for the reliability of differences. Journal of Educational Mea-

surement, 31(2), 143-147.

(Appendix follows on next page)

Page 12: Managerial Self-Awareness in High-Performing … S… · Managerial Self-Awareness in High-Performing Individuals in Organizations Allan H. Church W. Warner Burke Associates Individual

292 RESEARCH REPORTS

Appendix

Sample Behavioral Items Used for Rating Purposes

1. You pay close attention and seek to understand direct reports when interacting.

2. You delegate authority to enable direct reports to make decisions and take action in a timely manner.

3. You provide clarity about individuals' roles and responsibilities.

4. You emphasize a team approach in accomplishing work.

5. You give direct reports the opportunity to learn things and try different activities on the job.

6. You coach and train people in new assignments.

7. You give your direct reports an opportunity to express openly their disagreements or to voice objections to your proposed actions/decisions.

8. You help direct reports to attain rewards and recognition.

9. You try to make the best use of your direct reports' skills and abilities when making assignments.

10. You establish trust and mutual respect in relating with your direct reports.

11. You solicit appropriate information from your direct reports—facts, opinions and concerns about their work.

12. You encourage your direct reports to submit new ideas and suggestions for improvement.

13. You give your direct reports full credit for their ideas.

14. You explain to your direct reports what is required to achieve work objectives.

15. You work with direct reports to establish mutually acceptable performance objectives and requirements.

16. You take time to provide direct reports with informal feedback on their performance.

Received May 10, 1996

Revision received September 25, 1996

Accepted September 26, 1996 I

New Editor Appointed for Contemporary Psychology: 1999-2004

The Publications and Communications Board of the American Psychological Association

announces the appointment of Robert J. Steinberg (Yale University) as editor of Contem-

porary Psychology, for a 6-year term beginning in 1999. The current editor, John H. Harvey

(University of Iowa), will continue as editor through 1998.

All reviews are written by invitation only, and neither the current editor nor the incoming

editor receives books directly from publishers for consideration. Publishers should continue

to send two copies of books for consideration, along with any notices of publication, to

PsycINFO Services Department, APA, Attn: Contemporary Psychology Processing, P.O.

Box 91700, Washington, DC 20090-1700 or (for UPS shipments) 750 First Street, ME,

Washington, DC 20002-4242.