DOCUMENT RESUME

ED 481 972

AUTHOR
TITLE

EA 032 799

Waters, Tim; Marzano, Robert J.; McNulty, Brian

Balanced Leadership: What 30 Years of Research Tells Us about
the Effect of Leadership on Student Achievement. A Working
Paper.

INSTITUTION
PUB DATE
NOTE
AVAILABLE FROM

PUB TYPE
EDRS PRICE
DESCRIPTORS

Mid-Continent Regional Educational Lab., Aurora, CO.

2003-00-00
21p.; Contains small print.
Mid-Continent Research for Education and Learning, 2550 South
Parker Road, Suite 500, Aurora, CO 80014. Tel: 303-337-0990;
Fax: 303-337-3005; Web site: http://www.mcrel.org. For full
text: http://www.mcrel.org/PDF/
LeadershipOrganizationDevelopment/
5031RR_BalancedLeadership.pdf.
Information Analyses (070)
EDRS Price MF01/PC01 Plus Postage.
*Academic Achievement; *Administrative Principles;
Administrator Attitudes; Administrator Qualifications;
*Administrator Responsibility; *Administrator Role;
Educational Administration; Elementary Secondary Education;
*Instructional Leadership; Leadership Responsibility; Meta
Analysis; Principals; School Administration; School Based
Management; School Supervision

ABSTRACT

This paper reports on an examination of the effects of

leadership practices on student achievement. It includes a meta-analysis of
nearly every available study since the 1970s, including doctoral
dissertations, that indicated it examined the effects of leadership on
student achievement. From a total of more than 5,000 studies, 70 met the
researchers' criteria for design, control, data analysis, and rigor. (Reports
on the, 70 studies are reference in an appendix.) From the analysis, the
researchers have created what they call "a balanced leadership framework."
This framework describes the knowledge, skills, strategies, resources, and
tools educational leaders need to improve student achievement. The framework
is predicated on the notion that effective leadership means more than simply
knowing what to do; it means knowing when, how, and why to do it. The data
from the meta-analysis demonstrate that there is, in fact, a substantial
relationship between leadership and student achievement. (The effect size is
discussed and expressed as a correlation.) The paper also contains a listing
of 21 specific leadership responsibilities significantly correlated with
student achievement. The average effect sizes for their affect on student
achievement are also reported. (WFA)

Reproductions supplied by EDRS are the best that can be made

from the ori inal document.

Balanced Leadership:
What 30 years of research tells us about the effect
of leadership on student achievement
Tim Waters, Ed.D.
Robert J. Marzano, Ph.D.
Brian McNulty, Ph.D.

A Working Paper
MOO

IMEL
U.S. DEPARTMENT OF EDUCATION

Office of Educational Research and Improvement

PERMISSION TO REPRODUCE AND

DISSEMINATE THIS MATERIAL HAS
BEEN GRANTED BY

EDUCATIONAL RESOURCES INFORMATION

CENTER (ERIC)

CI This document has been reproduced as

received from the person or organization
originating it.
CI Minor changes have been made to
improve reproduction quality.

ahtteks

Points of view or opinions stated in this

document do not necessarily represent
official OERI position or policy.

TO THE EDUCATIONAL RESOURCES

INFORMATION CENTER (ERIC)

BEST COPY AVAILABLE

ABOUT THE AUTHORS

TIM WATERS has served as CEO for McREL since 1995, following 23 years in public education, the last
seven of which were as the superintendent of the Greeley, CO school system. Dr. Waters serves on the
Board of Directors of the National Education Knowledge Industry Association arid is a past Commissioner
of the Colorado Commission on Higher Education. He received his B.A. from the University of Denver
and his M.A. and Ed.D. from Arizona State University.

ROBERT J. MARZANO is a Senior Scholar at McREL; an Associate Professor at Cardinal Stritch

University in Milwaukee, WI; Vice President of Pathfinder Education, Inc.; and a private consultant operating out of Centennial, CO. He is the author of numerous publications, including What Works in Schools
(2003, ASCD) and Classroom Instruction that Works (Marzano, Pickering, Pollock, 2001, ASCD). He received
his B.A. from Iona College in New York, his M.Ed. from Seattle University, and his Ph.D. from the
University of Washington, Seattle.

BRIAN McNULTY serves as McREL's Vice President of Field Services. Prior to joining McREL, he
served as the Assistant Commissioner of the Colorado Department of Education and as the Executive
Director of Educational Services, Adams County School District 14 in Commerce City, CO. He received his
B.S. from Georgetown University, his M.A. from George Washington University, and his Ph.D. from the
University of Denver.
Other McREL staff members who contributed to the development of this report include JAMES BAILEY, a
former assistant district superintendent, high school principal and elementary principal; GREG CAMERON,
a former elementary school principal and assistant principal; EVELYN CORTEZ-FORD, a doctoral candidate in educational leadership and former master teacher and teacher educator; MIKE GALVIN, a former
teacher leader and elementary school principal; SANDRA GILPIN, a former secondary school mathematics
teacher; and MONETTE McIVER, a former elementary school teacher.

BEST COPY AVAILABLE

2003 McREL

BACKGROUND
More than three decades of research on the effects
of*instruction and schooling on student achievement are creating a new science of education.
Starting in 1998, McREL began synthesizing this
growing body of research through meta-analyses of
research on student characteristics and teacher and
school practices associated with school effectiveness.
The results of our first two meta-analyses have provided practitioners with specific guidance on the
curricular, instructional, and school practices that,
when applied appropriately, can result in increased
student achievement.

framework moves beyond abstraction to concrete

responsibilities, practices, knowledge, strategies,
tools, and resources that principals and others need
to be effective leaders.

Our third research meta-analysis examines the

effects of leadership practices on student achievement. After analyzing studies conducted over a 30year period, McREL identified 21 leadership responsibilities that are significantly associated with student
achievement. We have translated these results into a
balanced leadership framework Which describes the
knowledge, skills, strategies, and tools leaders need
to positively impact student achievement.

Our leadership framework also is predicated on the

notion that effective leadership means more than
simply knowing what to do
it's knowing when,
how, and why to do it. Effective leaders understand
how to balance pushing for change while at the
same time, protecting aspects of culture, values, and
norms worth preserving. They know which policies,
practices, resources, and incentives to align and how
to align them with organizational priorities. They
know how to gauge the magnitude of change they
are calling for and how to tailor their leadership
strategies accordingly. Finally, they understand and
value the people in the organization. They know
when, how, and why to create learning environments
that support people, connect them with one another,
and provide the knowledge, skills, and resources
they need to succeed. This combination of knowledge and skills is the essence of balanced leadership.

Why another leadership framework?

Methodology

Educators have long heard that school leadership

makes a difference. Many early studies on school
effectiveness, for example, reported that leadership,
specifically instructional leadership, was one of several defining characteristics of successful schools.
Nonetheless, this notion of instructional leadership
remained a vague and imprecise concept for many
district and school leaders charged with providing it.
Since the early 1970s, many thoughtful, experienced,
and competent scholars and practitioners have
offered theories, anecdotes, and personal perspectives
concerning instructional leadership. None of this
advice for leaders, however, was derived from the
analysis of a large sample of quantitative data. As a
result, it remained largely theoretical and failed to
provide school leaders with practical guidance for

McREL's balanced leadership framework was developed

from three key bodies of knowledge:

becoming effective leaders.

In this regard, McREL's balanced leadership framework stands apart from previous advice for school
leaders. First, no other frameworks for school leadership have been developed from a more comprehensive analysis of research on school leadership
and student achievement. Second, because it is
grounded in evidence, our balanced leadership

A quantitative analysis of 30 years of research,

An exhaustive review of theoretical literature on
leadership, and
Our research team's more than 100 years of
combined professional wisdom on school
leadership.

As a first step in developing our leadership framework,

we conducted a systematic meta-analysis of nearly
every available study (including doctoral dissertations)
that purported to examine the effects of leadership on
student achievement reported since the early 1970s.

From a total of more than 5,000 studies completed

during this period, 70 (see Appendix A) met the
following criteria for design, controls, data analysis,
and rigor:
Quantitative student achievement data;
Student achievement measured on standardized,
norm-referenced tests or some other objective
measure of achievement;
Student achievement as the dependent variable;
and
Teacher perceptions of leadership as the independent
variable.

BEST COPY AVAILABLE

a.

one standard deviation improvement in leadership

practices is associated with an increase in average
student achievement from the 50th percentile to the
60th percentile. This represents a statistically significant difference in achievement.

These 70 studies involved 2,894 schools approximately 1.1million students, and 14,000 teachers.
In addition, McREL's research team has applied
insights from our own professional wisdom and an
exhaustive review of leadership literature
including
institutional theory, systems theory, organizational
learning theory, transition theory, change theory, and
diffusion theory
to help school leaders understand
how to effectively carry out the 21 key leadership
responsibilities identified in our study. Thus, our findings represent an integration of quantitative research,
theoretical insights, and professional wisdom about
effective leadership.

FINDINGS
The data from our meta-analysis
demonstrate that there is, in fact,
a substantial relationship between
leadership and student achievement. We found that the average
effect size (expressed as a correlation) between leadership and
student achievement is .25.

To interpret this correlation,

consider two schools (school A
& school B) with similar student
and teacher populations. Both
demonstrate achievement on a
standardized, norm-referenced
test at the 50th percentile.
Principals in both schools are
also average
that is, their
abilities in the 21 key leadership
responsibilities are ranked at the
50th percentile. Now assume that
the principal of school B
improves her demonstrated abilities in all 21 responsibilities by
exactly one standard deviation

In addition to the general impact of leadership, we

found 21 specific leadership responsibilities significantly correlated with student achievement. These
21 leadership responsibilities and the average effect
size for their impact on student achievement are
reported in Figure 3.

Principal A
Principal B
2.14

34.13

34.13

13.59

-2

13.59

+1

2.14

+2

I 68%
95%
98%

Figure 1: Illustration of one standard deviation difference in principal ability

. I

ES = .25
School A
School B

(see Figure 1).

Our research findings indicate

that this increase in leadership
ability would translate into mean
student achievement at school B
that is 10 percentile points higher
than school A, as depicted in
Figure 2. Expressed differently, a

-3

.!1

+12

Figure 2: Effect size of leadership on student achievement

BESTCOPYAVAILABLE

Figure 3: Principal leadership responsibilities: Average r and 95% Confidence Intervals

MIN

=1111

Responsibilities

The extent to which the ptincifial ...

Culture

Avg.

95%
CI

schools

fosters shared beliefs & a sense of community

& cooperation

.29

709

13

.23.37

Order

establishes a set of standard operating procedures

& routines

.26

456

17

.17.35

Discipline

protects teachers from issues & influences that

would detract from their teaching time or focus

.24

397

10

.14.33

Resources

provides teachers with materials & professional

development necessary for the successful
execution of their jobs

.26

570

17

.18.34

Curriculum, instruction,
assessment

is directly involved in the design &

implementation of curriculum, instruction,
& assessment practices

.16

636

19

.08.24

Focus

establishes clear goals & keeps those goals in

the forefront of the school's attention

.24

1109

30

.18.29

Knowledge of curriculum,
instruction assessment

fosters shared beliefs & a sense of community

& cooperation

.24

327

.13.35

Visibility

has quality contact & interactions with teachers

& students

.16

432

11

.06.25

Contingent rewards

recognizes & rewards individual accomplishments

.15

420

.05.24

Communication

establishes strong lines of communication with

teachers & among students

.23

245

10

.10.35

Outreach

is an advocate & spokesperson for the school to

all stakeholders

.28

478

14

.19.35

Input

involves teachers in the design & implementation

of important decisions & policies

.30

504

13

.21.38

Affirmation

recognizes & celebrates school accomplishments

& acknowledges failures

.25

345

.14.35

Relationship

demonstrates an awareness of the personal

aspects of teachers & staff

.19

497

12

.10.24

Change agent

is willing to & actively challenges the status quo

.30

479

.22.38

Optimizer

inspires & leads new & challenging innovations

.20

444

.11.29

Ideals/beliefs

communicates & operates from strong ideals &

beliefs about schooling

.25

526

.17.33

Monitors/evaluates

monitors the effectiveness of school practices

& their impact on student learning

.28

1071

30

.23.34

Flexibility

adapts leadership behavior to the needs of the

current situation & is comfortable with dissent

.22

151

.05.37

Situational awareness

is aware of the details & undercurrents in the

running of the school & uses this information
to address current & potential problems

.33

91

.11.37

Intellectual stimulation

ensures that faculty & staff are aware of the

most current theories & practices & makes the
discussion of these a regular aspect of the
school's culture

.32

321

.22.42

studies

BEST COPY AVAILABLE

Figure 4: Differential impact of leadership

Range

Correlation

Change from 50th P for 1 SD

Increase in Leadership

Mean

.25

60th

Highest

.50

69th

Lowest

-.02

49th

The differential impact of leadership

As important as these findings are, there is another
finding that is equally as important. That is, just as
leaders can have a positive impact on achievement,
they also can have a marginal, or worse, a negative
impact on achievement. When leaders concentrate
on the wrong school and/or classroom practices,
or miscalculate the magnitude or "order" of the
change they are attempting to implement, they can
negatively impact student achievement. Figure 4
displays the range of impact leaders can have on
student performance. In some studies, we found an
effect size for leadership and achievement of .50.
This translates mathematically into a one standard
deviation difference in demonstrated leadership
ability being associated with as much as a 19 percentile point increase in student achievement
an
increase that is substantially larger than the 10
percentile point increase mentioned previously.
ENE

In other studies, we found correlations as low as

.02. This indicates that schools where principals
demonstrated higher competence in certain leadership areas had lower levels of student achievement.
In these studies, a one standard deviation improvement in leadership practices was correlated with a
one percentile point decrease in student achievement.

What can we learn from this 20 percentile difference

in the impact of leadership? We have concluded
there are two primary variables that determine
whether or not leadership will have a positive or a
negative impact on achievement. The first is the
focus of change
that is, whether leaders properly
identify and focus on improving the school and
classroom practices that are most likely to have a
positive impact on student achieVement in their

school. The second variable is whether leaders

properly understand the magnitude or "order"
of change they are leading and adjust their leadership practices accordingly. We discuss these variables
in greater detail in the following sections.

The focus of change

Harvard scholar Richard Elmore, in a study commissioned by the National Governor's Association
(NGA), concluded that having the right focus of
change is a key to improving schools and increasing
student achievement. In his report for NGA,
Knowing the Right Things to Do: School Improvement and

Peormance-Based AccountabiliO, he states,

Knowing the right thing to do is the central

problem of school improvement. Holding
schools accountable for their performance
depends on having people in schools with the
knowledge, skill, and judgement to make the
improvements that will increase student
performance. (p. 9)
We reached the same conclusion in our current study
of leadership. Through two previous studies, we have
also identified, "the right things to do" in school
improvement. McREL's earlier meta-analyses of
classroom and school practices, self-published in
reports titled A Theog-Based Meta-Analysis of Research
on Instruction (1998) and A New Era of School Reform:
What 30 Years of Research Tells Us (1999)1, and published by ASCD in two volumes titled Classroom
Instruction that Works (2000) and W hat Works in Schools

(2002), provides guidance for leaders on what the

focus of their improvement efforts should be.

I Both McREL research reports are available online:

A Theory-based Meta-Analysis of Research on Instruction can be downloaded at
www.mcrel.org/PDF/Instruction/5982RR_InstructionMeta_Analysis.pdf;
A New Era of School Reform is available at
w.mcrel.org/PDF/SchoolImprovementReform/5002RR_NewEraSchoolReform.pdf.

a.

Figure 5: School & teacher practices & student factors influencing student achievement
School

1.

2.
3.
4.
5.

Teacher

6.
7.
8.

Student

Guaranteed and viable curriculum

Challenging goals and effective feedback
Parent and community involvement
Safe and orderly environment
Collegiality and professionalism
Instructional strategies
Classroom management
Classroom curriculum design

9. Home environment
10. Learned intelligence / background knowledge
11. Motivation

The school and classroom practices associated with

increased student achievement identified in these
publications are presented in Figure 5. For school
leaders and leadership teams with quesdons about
where they should be focusing their improvement
efforts, these school and teacher practices and student
factors offer a place to start.

need to not only focus improvement efforts on these

key school and classroom practices, but also accurately understand the magnitude of change implied
by these efforts.

Just as we are able to document the relationship

between leadership and student achievement
through our current study, our earlier analyses documented an even stronger relationship between these
school and teacher practices and student factors and
student achievement. The school and classroom
practices in Figure 5 account for 20 percent of the
variance in student achievement. This translates
mathematically into 72 percent of students passing a
standardized assessment that only 50 percent of students are expected to pass. In other words, focusing
on the most effective or most needed practices can
change a school's passing rate from 50 to 72 percent.
Accordingly, the message for leaders is that in order
to have positive impact on student achievement, they

The theoretical literature on leadership, change, and

the adoption of new ideas (including Heifetz,
Fullan, Beckard, Pritchard, Hesslebein, Johnson,
Kanter, Bridges, Rogers, Nadler, Shaw, and Walton)
makes the case that not all change is of the same
magnitude. Some changes have greater implications
than others for staff members,students, parents,
and other stakeholders. Although there are a variety
of labels given to differing magnitudes of change
(technical vs. adaptive challenges, incremental vs.
fundamental, continuous vs. discontinuous), we
have used the terms "first order" and "second
order" change to make this distinction. Figure 6
describes the differences between these orders of

The magnitude or "order" of change

change.

BEST COPY AVAILABLE

Figure 6: Characteristics of first and second order changes

First order change

Second order change

An extension of the past

A break with the past

Within existing paradigms

Outside of existing paradigms

Consistent with prevailing values and norms

Conflicted with prevailing values and norms

Focused

Emergent

Bounded

Unbounded

Incremental

Complex

Linear

Nonlinear

Marginal

A disturbance to every element of a system

Implemented with existing knowledge & skills

Requires new knowledge and skills to implement

Problem- and solution-oriented

Neither problem- nor solution-oriented

Implemented by experts

Implemented by stakeholders

It is important to note that not all changes represent

the same order of change for each individual or
stakeholder group. What will be experienced as a
"first order" change for some may be a "second
order" change for others. Assuming that all change
will have the same implications for all stakeholders,
and/or using practices that might be appropriate for
a first order change when a second order change is
actually implied for stakeholders, will likely result in
a negative impact on student achievement. Thus, in
addition to focusing leadership efforts on school
and classroom practices associated with improved
student achievement, leaders also must tailor their
own leadership practices based on the magnitude or
"order" of change they are leading.
The implications of the change for individuals,
organizations, and institutions determines the
magnitude or order of change. On both individual
and collective levels, changes that are consistent with
existing values and norms, create advantages for
individuals or stakeholder groups with similar interests, can be implemented with existing knowledge
and resources, and where agreement exists on what
changes are needed and on how the changes should
be implemented can be considered first order. In an
educational context, these might be new classroom
instructional practices, instructional materials,
curricular programs, or data collection and reporting

systems that build on established patterns and utilize

existing knowledge.
A change becomes second order when it is not
obvious how it will make things better for people
with similar interests, it requires individuals or groups
of stakeholders to learn new approaches, or it conflicts with prevailing values and norms. To the degree
that individuals and/or stakeholder groups in the
school or school system hold conflicting values, seek
different norms, have different knowledge, or operate
with varying mental models of schooling, a proposed
change might represent a first order change for some
and a second order change for others.

Different perceptions about the implications of

change can lead to one person's solution becoming
someone else's problem. That is, if a change has
first order implications for one person or group of
individuals, yet has second order implications for
another person or group, this latter group may vieW
the change as a problem rather than a solution. This
is true of nearly every educational reform introduced over the last 20 years. The shift from focusing
on the inputs of schooling to the outputs of schooling, which was the core concept in "outcome-based"
education, is a classic and dramatic example of one
person's solution being someone else's problem.

BEST COPY AVAII.ABLE

There are many more current examples. The role

and use of content standards, high-stakes testing
and accountability, adjustments in school days,
weeks, and years, non-graded classrooms, home
schooling, and school vouchers are for some educators, policy makers, and parents, first order changes;
they are appropriate responses to what these individuals see as problems with schools. These "solutions"
are consistent with their prevailing values and norms
and are seen, as natural extensions of their ongoing
efforts to improve schools.

It is also important to note that depending on

school context, both first and second order changes
can lead to gains in student achievement. However,
in many situations, it becomes clear that necessary
changes are in fact, "second order" changes. Thus,
to be effective, school leaders must become adept at
leading both first and second order changes.
As an example, consider the first responsibility listed
in Figure 7, Culture (i.e., the extent to which the
principal fosters shared beliefs and a sense of community and cooperation). The practices associated
with this responsibility include:

However, other policymakers, educators, and parents

may see such changes as dramatic and undesirable
breaks with the past, which conflict sharply with
their prevailing values and norms. In short, they are
viewed as second order changes. That is, instead of
being viewed as "solutions," many see them as problems facing schools and school systems, which have
far greater implications for students and stakeholder
groups than those currently facing the schools.

1. Promotes cooperation among staff,

2. Promotes a sense of well being,
3. Promotes cohesion among staff,
4. Develops shared understanding of purpose,

and
5.

Recognizing which changes are first and second

order for which individuals and stakeholder groups
helps leaders to select leadership practices and
strategies appropriate for their initiatives. Doing so
enhances the likelihood of sustainable initiatives and
a positive impact on achievement. Failing to do so
will just as likely result in the negative impact on
achievement.

RIM

Develops a shared vision of what the school

could be like.

For first order changes, the first three practices

promoting cooperation, a sense of well being, and
cohesion among staff
may be all that is needed
from leadership for successful implementation.

However, for second order changes, these first three

practices will be insufficient to fulfill this responsibility. Second order changes require leaders to work far
more deeply with staff and the community. It is possible that second order changes will disrupt cooperation, a sense of well being, and cohesion. Second
order changes may confront group identities, change
working relationships, challenge expertise and competencies, and throw people into stages of "conscious incompetence," none of which is conducive
to cooperation, cohesion, and a sense of well-being.
In these cases, establishing agreement on the purposes of schooling and the proposed changes, along
with a truly shared vision of possibilities, will be
essential if cooperation among staff, a sense of well
being, and cohesion are to be maintained, or reestablished, as the change is being implemented.

Selecting the appropriate leadership practices

Each of the 21 leadership responsibilities presented in
Figure 3 includes several different leadership practices.
The practices associated with each of the leadership
responsibilities are presented in Figure 7. For instructive purposes, these practices have been plotted along
a continuum based on whether they are most appropriate for first or second order changes.

In reviewing the figure, readers should keep in mind

that while only some of the practices listed here are
required to lead first order change, skillful use of all
practices listed is required to successfully lead second
order change. Effective leaders understand both the
order of change they are leading and how to select
and skillfully use appropriate leadership practices.

10

Figure 7: Leadership practices according to magnitude of change

Leadership Responsibilities &
Effect Sizes (ES)
Culture (.29)
The extent to which the principal
fosters shared beliefs and a sense of
communib, and cooperation.

Practices

Appropriate for
First Order Change

Appropriate for
Second Order Change

Promotes cooperation among staff

Promotes a sense of well-being
Promotes cohesion among staff
Develops shared understanding
of purpose
Develops a shared vision of
what the school could be like

Order (.26)
The extent to which the principal
establishes a set of standard operatin,g
procedures and routines.

Discipline (.24)
The extent to which the prindpal
protects teachers from issues and
influences that would detract from
their teaching time or focus.

Resources (.26)
The extent to which theprincipal
protides teachers with the material
and professional development necessagi
for the succesiful execution of their
jobs.

Curriculum, instruction,
assessment (.16)
The extent to which the principal is
directly involved in the design and
implementation of curriculum,
instruction, and assessment practices.

Provides and enforces clear

structures, rules and procedures
for students
Provides and enforces clear
structures, rules and procedures
for staff
Establishes routines regarding
the running of the school that
staff understand and follow
Protects instructional time
from interruptions
Protects/shelters teachers
from distraction
Ensures that teachers have
necessary materials and
equipment

Ensures that teachers have necessary staff

development opportunities that directly
enhance their teaching
Ensures that teachers have necessary
materials and equipment
Is involved with teachers to address
instructional issues in their classrooms
Is involved with teachers to address
assessment issues

BEST COPY AVAILABLE

11

Leadership Responsibilities &

Effect Sizes (ES)

Practices

Appropriate for
First Order Change

11"

Focus (.24)
The extent to which the principal
establishes clear goals and keeps those
goals in the forefront of the school's
attention

Knowledge of curriculum,
instruction, assessment (.24)
The extent to which the prinapal is
knowledgeable about current cut7icuhim, instruction, and assessment
practices.

Establishes high, concrete goals

and expectations that all students
meet them
Establishes concrete goals for all
curriculum, instruction, and assessment
Establishes concrete goals for the
general functioning of the school
Continually keeps attention on
established goals
Is knowledgeable about instructional
practices
Is knowledgeable about assessment
practices
Provides conceptual guidance for
teachers regarding effective classroom
practice

The extent to which the principal has

qual0, contact and interactions with
teachers and students.

Makes systematic and frequent visits

to classrooms
Maintains high visibility around the
school
Has frequent contact with students

Contingent Rewards (.15)

Recognizes individuals who excel

Visibility (.16)

The extent to which the prinapal

recognizes and rewards individual
accovlishments.

Communication (.23)
The extent to which the prmapal
estabbirhes strong lines of communicalion with teachers and among students,

Outreach (.28)
The extent to which the principal is
an advocate and Jpokeiperson for tbe
school to all stakeholders.

Appropriate for
Second Order Change

Uses performance vs. seniority as the

primary criterion for reward and
advancement
Uses hard work and results as the basis for
reward and recognition
Is easily accessible to teachers
Develops effective means for
teachers to communicate with one
another
Maintains open and effective lines
of communication with staff.

Assures that the school is in

compliance with district and state
mandates
Advocates on behalf of the school
in the community
Advocates for the school with
Parents of the students
Ensures that the central office is
aware of the school's accomplishments

BEST COPY AVAILABLF

10

12

Leadership Responsibilities &

Effect Sizes (ES)
Input (.30)
The extent to which the ihrintipal
involves teachers in the design and

Appropriate for
First Order Change

Practices

I'

Provides opportunity for input on

all important decisions

Provides opportunities for staff to be

involved in developing school policies
Uses a leadership team in decision making

implementation of important decisions and policies.

Affirmation (.25)
Me extent to which the principal
recognizes and celebrates school
accomplishments and acknowledges

failures.

Appropriate for
Second Order Change

Systematically and fairly recognizes

and celebrates accomplishments

of teachers
Systematically and fairly recognizes
and celebrates accomplishments

of students
Systematically acknowledges failures and
celebrates accomplishment of the school

Relationships (.19)
The extent to which the principal
demonstrates an awareness of the
personal aspects of teachers and staff

Remains aware of personal needs

of teachers
Maintains personal relationships
with teachers
Is informed about significant personal
issues within lives of staff
Acknowledges significant events
in the lives of staff
Consciously
challenges the
status quo
Is comfortable leading
change initiatives with
uncertain outcomes
Systematically considers new
and better ways of doing things

Change agent (.30)

'I.& extent to which the principal is
wilkng to and actively challenges the
status quo.

Optimizer (.20)
The extent to which the principal
impires and leads new and challenging innovations.

=1111

Inspires teachers to accomplish

things that might seem beyond
their grasp
Portrays a positive attitude about
the ability of the staff to
accomplish substantial things

Is a driving force behind major

initiatives

BEST COPY AVA

13

r3L

Leadership Responsibilities &

Effect Sizes (ES)

Appropriate for
First Order Change

Ideals/beliefs (.25)

O'

Appropriate for
Second Order Change

Holds strong professional beliefs

about schools, teaching, and learning

The extent to which the prinapal

communicates and operates from
strong ideals and beliefs about
mho-ling.

Shares beliefs about schooling,

teachers, and learning with staff
and parents
Demonstrates behaviors that are
consistent with beliefs

Monitors/evaluates (.28)

Monitors and evaluates the

effectiveness of curriculum,
instruction, and assessment

The extent to which the principal

monitors the effectiveness of school
practices and their impact on student
learning

Practices

Flexibility (.22)

Is comfortable with
major changes in how
things are done
Encourages
people to
express opinions contrary to
those of

The extent to which the prinapal

adapts his or her leadership behavior
to the needs of the current situation
and is comfortable with dissent.

authority
Adapts leadership style
to needs of specific
situations
Can be directive or
non-directive as the
situation warrants

Situational awareness (.33)

NMI

=1111

The extent to which the prindpal is

aware of the details and undercurrents
in the running of the school and uses
thu information to address current and
potential problems.

Intellectual stimulation (.32)

The extent to which the_principal

ensures that facul and staff are

aware of the most current theories and
practices and makes tbe dircussion of
these a regular aspect of the school's

Is aware of informal groups and

relationships among staff of the school
Is aware of issues in the school that
have not surfaced but could create
discord
Can predict what could go wrong
from day to day
Keeps informed about current
research and theory regarding
effective schooling
Continually exposes staff
to cutting edge ideas about
how to be effective
SystematicaLly engages staff
in discussions about current
research and theory

culture,

Continuously involves staff in

reading articles and books about
effective practices

BEST COPY AVAILABLE

14

a_

Ongoing development of McREL's "balanced leadership" framework

Our work on this framework continues through the
development of a "knowledge taxonomy" to organize the theoretical research mentioned earlier in this
paper. Our taxonomy organizes this literature into
the following four types of knowledge, which can be
applied to the 21 leadership responsibilities and
associated practices:
Experiential knowledge
knowing why this
is important;
Declarative knowledge
knowing what to do;
Procedural knowledge
knowing how to do it;
and
Contextual knowledge
knowing when to do it.

MEIN

NNW

The value of the taxonomy, we believe, is in organizing the knowledge in the theoretical research on
leadership, change, systems, organizational learning,
diffusion, supervision, and institutions so it can be
applied to the 21 leadership responsibilities. Based
on our review of the theoretical research in these
domains, it is clear that many people in leadership
positions lack the experiential, declarative, procedural, and/or contextual knowledge necessary to
lead both first and second order change. The literature is replete with examples of bright, powerful,
well intentioned leaders who fail in their leadership
initiatives because they simply did not understand
what they needed to know, how to proceed with
implementation, or when they needed to use various
practices and strategies.
Nowhere may this be more true than in the field of
educational leadership. For years, educators have
worked to apply theories from these domains to
schools and school systems. However, there has been
no consistent approach to and structure for this
application. We are using the knowledge taxonomy as
the tool for this purpose.

The meta-analysis gives us 21 research-based

responsibilities and associated practices that are
significantly associated with student achievement.
These responsibilities and practices make up one
half of a "balanced leadership framework." The
taxonomy is our tool for organizing the experiential,
declarative, procedural, and contextual knowledge iri
the theoretical research, to be applied to the 21
responsibilities and associated practices found in the
quantitative research. This is the other half of the
"balanced leadership framework."
Again selecting one of the leadership responsibilities,
Communication (i:e., the extent to which the principal establishes strong lines of communication with
teachers and among staff), Figure 8 is a partially
developed example of how the taxonomy will be
used to further develop this work.

In addition to pulling the theoretical research into

the framework using the knowledge taxonomy, we
continue to collect data on. the 21 leadership responsibilities. Assuming that the 21 responsibilities are
highly interrelated, we are currently collecting data
from practitioners which we will use to conduct
factor analyses. Additionally, we will use these data
for the purpose of structural equation modeling. In
subsequent reports, we anticipate sharing the results
of our factor analyses, which we expect will produce
a smaller number of responsibilities after "teasing
out" the underlying factor structure. Furthermore,
we expect to report on the strength of relationships
between leadership responsibilities and practices to
the school and classroom practices presented in
Figure 5. For information about the status of these
efforts, and the release of future reports, readers can
access McREL's Resource Center at [email protected].

BESTCOPYAVAILABLE

Figure 8: Example of the knowledge taxonomy

Responsibility
Communication
(ES .23)

Establish effective lines

of communication to

and from staff

Knowledge & Skills

Strategy & Tools

Experiential (why)
People adopt ideas or innovations
partially based on the effectiveness
of communication channels (i.e.,
who they hear it from, what they
learn, and how they hear it.)

Defining consequences

Declarative (what)
Leaders need to know the attributes
of innovations, i.e.

Manage disequilibrium
Increase access to
Information
Innovation evaluations
Resource utilization
Using the categories of adopters

Desirable vs. undesirable

Direct vs. indirect
Anticipated vs. unanticipated

Relative advantage
Compatibility
Complexity
Trialability

Resources
Diffusion of
Innovations, 4th
Ed. (1995)
Everett M. Rogers

Observability and how these

attributes affect the rate of
adoption.

Procedural (how)

Develop network of key communicators

Leaders need to effectively use the

channels of communication to
capitalize on the research on the
adoption of ideas/innovations.
They need to use:
Knowledge
Persuasion
Decisions
Implementation
Confirmation

Identify and brief opinion leaders

Ethnographic studies
Metaphors
Reframing

Contextual (when)
Whenever people are being asked to
adopt new practices, leadership
needs to assess both the readiness
for change and the level of that

Assess magnitude of leadership

Use of dialogue

initiative

McREL change
initiative assessment
protocol

change.

CONCLUSION
There are no fail-safe solutions to educational and
organizational problems. This is as true in the area of
leadership as it is in other areas of educational
effectiveness. However, research findings that are
organized, accessible, and easily applied by practitioners can enhance the likelihood of effective education
leadership. We believe the McREL balanced leadership

framework is the most comprehensive, rigorous, and

useful integration of research and theory into a practical format available to education leaders today.
McREL's framework is not a silver bullet. It can
become, however, a tool that will help leaders and
leadership teams add value to the work of all stakeholders to improve student achievement.

BEST COPY AVAILABLE

14

16

BIBLIOGRAPHY
Beckard, R. & Pritchard, W. (1992). Changing the essence: The art of creatiq and leading fundamental change in
organizations. San Francisco:. Jossey-Bass.

Bridges, W. (1991). Managing transitions: Making the most of change. Reading, MA: Addison-Wesley.
Elmore, R. (2003). Knowing the nght thing to do: School ivrovement and pegrormance-based accountabiliO. Washington,

DC: NGA Center for Best Practices.

Fullan, M. G. (1993). Change forces: Probing the depths of educational reform. Bristol, PA: Falmer Press.

Heifetz, R. (1994). Leadership without eag answers. Cambridge, MA: Belknap Press.
Hesslebein, E & Johnston, R. (Eds.). (2002). On leading change: A leader to leader guide. San Francisco: Jossey-Bass.
Marzano, R. J. (2000). A new era of school reform: Going where the research takes us. Aurora, CO: Mid-continent

Research for Education and Learning.

Marzano, R. J., Gaddy, B. B., & Dean, C. (2000). What works in classroom instruction. Aurora, CO: Mid-conti-

nent Research for Education and Learning.

Marzano, R. J. (2003). What works in schools: Translating research into action. Alexandria, VA: Association for

Supervision and Curriculum Development.

Nadler, D. A., Shaw, R. B., Walton, A. E., & Associates. (1994). Discontinuous change. San Francisco: Jossey-Bass.

Rogers, E. (1995). Diffusion of innovations. New York: The Free Press.

APPENDIX A: REPORTS ON THE 70 STUDIES INCLUDED IN THE MCREL LEADERSHIP

META-ANALYSIS
Andrews, R. L., & Soder, R. (1987, March). Principal leadership and student achievement. Educational
Leadership, 4 4 (6) 9-11.

Ayres, R. E. (1984). The relationship between principal effectiveness and student achievement. Unpublished doctoral

dissertation, University of Missouri, Columbia.

Balcerek, E. B. (2000, May). Principals' effective leadership practice in high peorming and inadequately peorming schools.

Unpublished doctoral dissertation, University of Tennessee, Knoxville.

Bedford, \X/. R, Jr. (1987). Components of school climate and student achievement in Georgia middle schoolr. Unpublished

doctoral dissertation, University of Georgia.

Benoit, J. D. (1990). Relationships between principal and teacher perceptions of principal instructional management and student
achievement in selected Texas school districts with an emphasis on an index of effectiveness (school effectiveness).

Unpublished doctoral dissertation, New Mexico State University.

Berry, F. A. (1983). Perceived leadership behavior of school principals in selected California public elementag schools with a
high Hilpanic student population and high or low sixth grade reading achievement scores. Unpublished doctoral

dissertation, University of the Pacific, Stockton, CA.

Blank, R. K. (1987). The role of principal as leader: Analysis of variation in leadership of urban high
schools. Journal of Educational Research, 81(2), 69-80.
Braughton, R. D., & Riley, J. D. (1991, May). The relationship between principals' knowledge of reading process and

elementag school reading achievement. (ERIC Document Reproduction Service No. ED341952)

Brookover, W. B., Schweitzer, J. H., Schneider, J. M., Beady, C. H., Flood, P. K., & Wisenbaker, J. M. (1978,
Spring). Elementary school social climate and school achievement. American Educational Research Journal,
15(2), 301-318.
Brooks, F. K. (1986). Relationships between school effectiveness and the perceptions of teachers on leadership effectiveness and

school climate. Unpublished doctoral dissertation, Memphis State University.

Cantu, M. M. I. (1994, May). A study of principal instructional leadership behaviors manifested in succesy'ul and not

successful urban elementary schools. Unpublished doctoral dissertation, University of Texas at Austin.
Combs, M. W. (1982). Perceptions of principal leadership behaviors related to the reading program in elementag schools

with high and low student achievement. Unpublished doctoral dissertation, University of Florida.

Crawford, J., & Watson, R J. (1985, February). Schools make a difference: Within and between-school
effects. Journal of Research and Evaluation of the Oklahoma COI Public Schools, 15(8), 1-98.

Crawford, J., Kimball, G., & Watson, P. (1985, March). Causal modeling of school effects on achievement.
Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.
Czaja, M. D. (1985). The relationship of selected principals' motive patterns to school climate and school climate to effectiveness.

Unpublished doctoral dissertation, University of Texas at Austin.

Dixon, A. E., Jr. (1981). The relationship of elementag principal leadership peormance to reading achievement of students

in two counties in California. Unpublished doctoral dissertation, University of San Francisco.

Duggan, J. P. (1984). The impact of differing principal supervisory communication soles on teacher and student outcomes

(consensus, achievement, leadership). Unpublished doctoral dissertation, Rutgers the State University of New
Jersey, New Brunswick.

16

BESTCOPYAVAILABLE

18

Durr, M. T. (1986). The effects of teachers' perceptions of principal performance on student cognitive gains. Unpublished

doctoral dissertation, Indiana University.

Edwards, P I., Jr. (1984). Perceived leadership behaviors and demographic characteristics of principals as Mg relate to student

reading achievement in elementary schools. Unpublished doctoral dissertation, University of South Florida.
Erpelding, C. J. (1999). School vision, teacher autonomy, school climate, and student achievement in elementary schools.

Unpublished doctoral dissertation, University of Northern Iowa.

Ewing, T. M. (2001, December). Accountable leadership: The relationship of principal leadership sole and student
achievement in urban elementary schools. Unpublished doctoral dissertation, Northern Illinois University,

Dekalb.
Finklea, C. W. (1997). Principal leadership sole and the effective school (secondary school principals). Unpublished doctoral

dissertation, University of South Carolina.

Floyd, J. E. (1999). An investigation of the leadership sole of principals and its relation to teachers' perceptions of school

mission and student achievement. Unpublished doctoral dissertation, North Carolina State University, Raleigh.
Freeman, E. (1987). The relationship between school effectiveness and elementary school principals' behaviors. Unpublished

doctoral dissertation, University of Washington.

Friedkin, N. E., & Slater, M. R. (1994, April). School leadership and performance: A social network approach.
Sociology of Education, 67, 139-157.
Gentile, M. (1997). The relationship between middle school teachers' perceptions of school climate and reading and mathematics

achievement. Unpublished doctoral dissertation, Widener University, Chester, PA.

Gray, C. S. (2001, August). Involvement of the principal in elementary school reading programs in the
Mississippi region. Unpublished doctoral dissertation, Mississippi State University.
Griffin, G. D. (1996). An examination of factors contributing to exemplary schools in an urban public school district in the

Midwest (urban education). Unpublished doctoral dissertation, Western Michigan University.

Ballinger, R, Bickman, L., & Davis, K. (1996, May). School context, principal leadership, and student reading
achievement. The Elementary School Journal, 96(5), 527-549.
Hauser, B. B. (2001). A coVarison of principal perceiver themes between highly successful and less succes.fful princitals in a

selection of public elementary schools in Kentu* Unpublished doctoral dissertation, University of Kentucky,
Lexington.

Heck, R. H., & Marcoulides, G. A. (1990). Examining contextual differences in the development of instructional leadership and school achievement. The Urban Review, 22(4), 247-265.
Heck, R. H., Larsen, T. J., & Marcoulides, G. A. (1990, May). Instructional leadership and school achievement
validation of a causal model. Educational Administration .,Quarterly, 26(2), 94-125.
Hedges, B. J. (1998), Tramformational and transactional leadership and the school principal: An analysis of Catholic K-8

school principals (Catholic schools). Unpublished doctoral dissertation, University of Maryland, College Park.
Hopkins-Layton, J. K. (1980). The relationships between student achievement and the characteristics of perceived leadersh0
behavior and teacher morale in minorio, low socio-economic, and urban schools. Unpublished doctoral dissertation,

University of Houston.
Hurwitz, N. F. (2001). The effects of elementary school principal instructional leadership on reading achievement in effective

versus ineffective schools. Unpublished doctoral dissertation, St. John's University, Jamaica, NY

BEST COPY AVAILABLE

LEI

19

Jackson, S. A. C. (1982). Instructional leadership behaviors that characterize schools that are effective for low socioeconomic

urban black students. Unpublished doctoral dissertation, Catholic University of America, Washington, DC.
Jones, P. A. (1987, May). The relationship behveen principal behavior and student achievement in Canadian secondary

schools. Unpublished doctoral dissertation, Stanford University.

Jun, Sung-Yun (1981). Principal leadership, teacherjob satisfaction and student achievement in selected Korean elementary

schools. Unpublished doctoral dissertation, Florida State University.

Knab, D. K. (1998). ConOarison of the leadership practices of principals of blue ribbon schoolr with principalr of randomly

selected schoolr. Unpublished doctoral dissertation, The American University.

Kolakowski, R. E. L. (2000). Instructional leadership and home-school relations in high- and low-peorming schools

SBM team perceptions. Unpublished doctoral dissertation, University of Maryland, College Park.
Krug, Frances S. (1986, May). The relationship between the instructional management behavior of elementary school prinapals

and student achievement. Unpublished doctoral dissertation, University of San Francisco.

LaFontaine, V. T. C. (1995). Implementation of effective schools correlates by Bureau of Indian Affairs Elementary Pilot
Schools: Staff perceptions and achievement scores (Native Americans). Unpublished doctoral dissertation, The

University of North Dakota.

Larsen, T. J. (1984). Identification of instructional leadership behaviors and the impact of their brolementation on academic
achievement ffictive Schools, High Achieving Schools; Los Angeles Couv, California). Unpublished doctoral disser-

tation, University of Colorado at Boulder.

Lee, C. M. (2001). Teacher percotions of factors inoacting on student achievement in effective and less effective urban elementary

schools. Unpublished doctoral dissertation, Wayne State University, Detroit, MI.

Lewis, L. W. Jr. (1983). Relationship between principalr' leadership style and achievement scores of third-grade students from low-

income families. Unpublished doctoral dissertation, Duke, University, Durham, NC.

MIN

Madison, T., Jr. (1988). A correlational study of the leadership behavior of school principals and the reading achievement of
sixth grade students from the low and upper social classes. Unpublished doctoral dissertation, Georgia State

University
McCord, H. C. (1982). Title I school prinapals' characteristics and behaviors and their relationship to student reading

achievement. Unpublished doctoral dissertation, Northern Illinois University, Dekalb.

McMahon-Dumas, C. E. (1981). An investigation of the leadership soles and effectiveness dimensions of principals, and
their relationship with reading gain scores of students in the Washington, D. C., public schools. Unpublished doctoral

dissertation, George Washington University, Washington, D. C.

Meek, J. P. (1999). Relationship between principal instructional leadership and student achievement outcomes in North

Carolina public elementary schools. Unpublished doctoral dissertation, North Carolina State University, Raleigh.
Morey, M. (1996). The relationships among student science achievement, elementary science teaching efficag, and school climate

(bublic schools). Illinois State University.

Norvell, C. A. (1984). Characteristics of perceived leadership, job satisfaction, and central life interests in high-achieving,
low-achieving, and improving Chapter I Schools (Los Angeles, California). Unpublished doctoral dissertation,

University of California, Los Angeles.

O'Day, K. A. (1984). The relationship between principal and teacher perceptions of principal instructional management

behavior and student achievement. Unpublished doctoral dissertation, Northern Illinois University.

18

20

BEST COPY AVAILABLE

Pounder, D. G. & Ogawa, R. T. (1995, November). Leadership as an organization-wide phenomenon: Its

impact on school performance. Educational Administration Quarterly, 31(4), 564-588.
Prouty, R. S. (1987). Mathematics achievement and self-esteem at secondary schools in Zaire: The effects of principals'

emphasis on instructional leadership. Unpublished doctoral dissertation, Michigan State University.

Reed, D. E. (1987). Organkational characteristics, principal leadership behavior and teacherjob satisfaction: An investigation

of the effects on student achievement. Unpublished doctoral dissertation, University of Rochester.

Rigell, C. D. (1999, May). Leadership behaviors of principals and student achievement. Unpublished doctoral disserta-

tion, University of Tennessee, Knoxville.

Ruzicska, J. K. (1989). The relationships among principals' sense of efficary, instructional leadership, and student achievement.

Unpublished doctoral dissertation, University of San Francisco.

Skilling, W C. (1992). A study of the relationship between middle school principal leadership behavior and seventh-grade

student reading achievement. Unpublished doctoral dissertation, Michigan State University.

Skrapits, V. A. (1986). School leadership, interpersonal communication, teacher satisfaction, and student achievement.

Unpublished doctoral dissertation; Fordham University, Bronx, NY.

Smith, C. L. (1995). Secondary prinapals: A study of relationships, leadership soles, and student achievement. Jinpublished

doctoral dissertation, Wayne State University, Detroit, MI.

Smith, W. E, & Andrews, R. L. (1989). Instructional leadership: How principals make a difference. Alexandria, VA:

Association of Supervision and Curriculum Development.

Soltis, G. J. (1987). The relationship of a principal's leadership sole in decision patterns to teacher percotion

of building leadership and to student learning. Unpublished doctoral dissertation, Temple University,
Philadelphia, PA.

BEST COPY AVAILABLE

19

-0

U.S. Department of Education

Office of Educational Research and Improvement (0ERI)
National Library of Education (NLE)
Educational Resources Information Center (ERIC)
Educational Resources lnlormallon Center

REPRODUCTION RELEASE
(Specific Document)

I. DOCUMENT IDENTIFICATION:
Title:

Balanced Leadership: What 30 Years of Research Tells Us About the Effect of

Leadership on Student Achievement

Author(s):

Tim Waters, Robert J. Marzano, and Brian McNulty

EA 032 799

Corporate Source:

NU

Publication Date:

Con1V4N-rgi-SMIZuf- PVgEPI,c4-1)6f

2003

4N9

II. REPRODUCTION RELEASE:

In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents announced in the
monthly abstract journal of the ERIC system, Resources in Education (RIE), are usually made available to users in microfiche, reproduced paper copy, and
electronic media, and sold through the ERIC Document Reproduction Service (EDRS). Credit is given to the source of each document, and, if reproduction
release is granted, one of the following notices is affixed to the document.
If permission is granted to reproduce and disseminate the identified document, please CHECK ONE of the following three options and sign at the bottom
of the page.
The sample sticker shown below will be
affixed to all Level 1 documents

The sample sticker shown below will be

affixed to all Level 2A documents

PERMISSION TO REPRODUCE AND

DISSEMINATE THIS MATERIAL HAS
BEEN GRANTED BY

PERMISSION TO REPRODUCE AND

DISSEMINATE THIS MATERIAL IN
MICROFICHE, AND IN ELECTRONIC MEDIA
FOR ERIC COLLECTION SUBSCRIBERS ONLY,
HAS BEEN GRANTED BY

PERMISSION TO REPRODUCE AND

DISSEMINATE THIS MATERIAL IN
MICROFICHE ONLY HAS BEEN GRANTED BY

TO THE EDUCATIONAL RESOURCES

INFORMATION CENTER (ERIC)

TO THE EDUCATIONAL RESOURCES

INFORMATION CENTER (ERIC)

TO rHE EDUCATIONAL RESOURCES

INFORMATION CENTER (ERIC)

The sample sticker shown below will be

affixed to all Level 28 documents

2A

Level 1

2B
Level 2A

Level 2B
1

Check here for Level 1 release, permitting reproduction

and dissemination in microfiche or other ERIC archival
media (e.g., electronic) and paper copy.

Check here for Level 2A release, permitting reproduction

and dissemination in microfiche and in electronic media for
ERIC archival collection subscribers only

Check here for Level 28 release, permitting reproduction

and dissemination in microfiche only

Documents will be processed as indicated provided reproduction quality permits

If permission to reproduce is granted, but no box is checked, documents will be processed at Level 1.

I hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate this
document as indicated above. Reproduction from the ERIC microfiche or electronic media by persons other than ERIC employees and
its system contractors requires permission frcm the copyright holder. Exception is made for non-profit reproduction by libraries and other
service agencies to satisfy information needs of educators in response to discrete inquiries.

Sign

here, 4
please

Printed Name/Positionffitle:

P.
Organization/Address:

IA4 toimp_s

0 4A-toW
MI 0- C60.-ndb4r V-FrEmz,c1+ fo-EptAc4-7J2-0
Yurri- 5-0, 4 tr i6P-4-, co SP

2-S56 S", 1,4114,2-

(,

a It

TVOrtl.ss*)&a

4,4 0 CE

163.337.360g

EiMail Apdress

-tWeel

ff-ic re(.0r

DM
((.30..Lerl

III. DOCUMENT AVAILABILITY INFORMATION (FROM NON-ERIC SOURCE):

If permission to reproduce is not granted to ERIC, or, if you wish ERIC to cite the availability of the document from another
source, please
provide the following information regarding the availability of the document. (ERIC will not announce a document unless it is publicly
available, and a dependable source can be specified. Contributors should also be aware that ERIC selection criteria are significantly more
stringent for documents that cannot be made available through EDRS.)
Publisher/Distributor:

Address:

Price:

IV.REFERRAL OF ERIC TO COPYRIGHT/REPRODUCTION RIGHTS HOLDER:

If the right to grant this reproduction release is held by someone other than the addressee, please provide the appropriate
name and
address:
Name:

Address:

V.WHERE TO SEND THIS ORM:

Send this form to the following E IC Clearinghouse:

ERIC Clearinghouse on Educational Management

5207 University of Oregon
Eugene OR 97403-5207
Attn: Acquisitions
However, if solicited by the ERIC Facility, or if ma
contributed) to:

t....Tsolicited contribution to

, return this form (and the document being

ERIC Processing and Reference Facility

4483-A Forbes Boulevard
Lanham, Maryland 20706

EFF-088 (Rev. 2/2001)

Telephone: 301-552-4200
Toll Free: 800-799-3742
FAX: 301-552-4700
e-mail: [email protected]
WWW: http://ericfacility.org