Metaeval Form

Metaevaluation Form
(Adapted from Worthen et al, 1997)

Utility Standards. These standards cover the requirements of the expected users.

U1. Stakeholder Identification.

A. Name of Evaluand:	__________________________________________________________________________________
B. List of Stakeholders:	__________________________________________________________________________________

U2. Evaluator Credibility.

A. Name of Evaluator:_______________________________________________________________________________

B. Check all characteristics that apply to the evaluator:

___ trustworthy
___ competent

___ questionable trustworthiness
___ questionable competence

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

U3. Information Scope and Selection. Check all that apply to the scope and selection of the information.

___ covers broad range
___ addresses pertinent questions about the evaluand

___ responds to the needs of the client
___ responds to the needs of the stakeholders

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

U4. Values Identificaiton. Check all that are clearly described within the evaluation for value judgment purposes.

___ perspectives used to interpret the findings
___ rational used to interpret the findings

___ procedures used to interpret the findings

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

U5. Report Clarity. The evaluand has clearly been described in the following areas (Check all that apply.):

___ context
___ purpose(s)

___ procedures
___ findings (results)

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

U6. Report Timeliness and Dissemination.

The evaluation report was disseminated to the intended users in a timely fashion.

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

U7. Evaluation Impact. The planning, conduction, and reporting of this help to encourage the stakeholders to follow through with the use
of the evaluation findings.

A. Planning
B. Cunduction
C. Reporting

A. ___ yes     ___ no
B. ___ yes     ___ no
C. ___ yes     ___ no

Feasibility Standards. These standards are "...intended to insure that anevaluation will be realistic, prudent, diplomatic, and frugal"
(Worthen et al, 1997).

F1. Practical Procedures.

Are the procedures practical and easy?

___ yes ___ no

Comments__________________________________________________________________________________________
__________________________________________________________________________________________________

F2. Political Viability.

The evaluation (check all that apply):

___ is well-planned
___ is well-conducted
___ anticipates different points of view

___ encourages cooperation
___ controls bias

Comments:_________________________________________________________________________________________
__________________________________________________________________________________________________

F3. Cost-Effectiveness.

The evaluation is (check all that apply):

___ efficient
___ productive

___ valuable

Comments:__________________________________________________________________________________________
__________________________________________________________________________________________________

Propriety Standards. These standards cover the legal and ethical issues of conducting an evaluation.

P1. Service Orientation.

Does the evaluation address the needs all participants?

___ yes ___ no

Comments:__________________________________________________________________________________________
___________________________________________________________________________________________________

P2. Formal Agreements.

Are there writing documents stating the responsibilities and obligations of all parties involved?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

P3. Rights of Human Subjects.

A. Does this evaluation contain information obtained from human subjects?
B. If yes, have the rights and welfare of the human subjects been considered and protected?

A.___ yes ___ no
B.___ yes ___ no ___ n/a

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

P4. Human Interactions.

Have the dignity and worth of the subjects been preserved?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

P5. Complete and Fair Assessment.

The evaluation (check all that apply):

___ completely examines the evaluand's strengths
___ fairly examines the evaluand's strengths

___ completely examines the evaluand's weaknesses
___ fairly examines the evaluand's weaknesses

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

P6. Disclosure of Findings.

Have the stakeholders and/or any other interested parties received a full report of the results of this evaluation?

___ yes ___ no

Comments_________________________________________________________________________________________
_________________________________________________________________________________________________

P7. Conflict of Interest.

A. Is there a conflict of interest?
B. If yes, explain.

C. If there is a conflict of interst, has it been dealt with openly and honestly?

A. ___ yes ___ no
B.______________
______________
C. ___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

P8. Fiscal Responsibility.

The evaluation (check all that apply):

___ has sound accountability procedures
___ is prudent

___ is ethically responsible
___ accounts for appropriate expenditures

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

Accuracy Standards. These standards "...are intended to ensure that an evaluation will reveal and convey technically adequate information
about the features that determine worth or merit of the program being evaluated" (Worthen et al, 1997).

A1. Program Documentation.

Does the evaluation clearly and accurately describe the evaluand?

___ yes ___ no

Comments:_________________________________________________________________________________________
__________________________________________________________________________________________________

A2. Context Analysis.

Are the likely influences on the evaluand indentified within the evaluation?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A3. Described Purposes and Procedures.

A. Are the purposes described in detail?
B. Are the procedures described in detail?

A. ___ yes ___ no
B. ___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A4. Defensible Information sources.

Are the sources of the data collected described in detail for accuracy purposes?

___ yes ___no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A5. Valid Information.

A. Were the information-gathering procedures adequate?
B. Are the information-gathering procedures valid?

A. ___ yes ___ no
B. ___ yes ___ no

Comments:__________________________________________________________________________________________
__________________________________________________________________________________________________

A6. Reliable Information.

Are the information-gathering procedures reliable?

___ yes ___ no

Comments:_________________________________________________________________________________________
__________________________________________________________________________________________________

A7. Systematic Information.

Has this evaluation been continuously reviewed for any possible errors?

___ yes ___no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A8. Analysis of Quantitative Information.

Has the quantitative information been periodically reviewed in order to effectively answer the evaluation questions?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A9. Analysis of Qualitative Information.

Has the qualitative information been periodically reviewed in order to effectively answer the evaluation questons?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A10. Justified Conclusions.

Are the conclusions explicitly justified?

___ yes ___ no

Comments_________________________________________________________________________________________
_________________________________________________________________________________________________

A11. Impartial Reporting.

A. Does the evaluation report contain any instances of biases?
B. Are the findings/results reported fairly?

A. ___ yes ___ no
B. ___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________

A12. Metaevaluation.

Was the evaluation subject to formative and/or summative evaluations?

___ yes ___ no

Comments:_________________________________________________________________________________________
_________________________________________________________________________________________________