Skip to main content

more options

Systems Perspective

We use a systems perspective as the framework for developing evaluation capacity, enhancing evaluation quality and ultimately improving programs. Several theoretical systems constructs have guided our work including complexity theory, evolutionary theory and natural selection, general systems theory, ecology, system dynamics, developmental systems theories, and ideas on researchpractice integration (including evidence-based practice and translational research).

The field of evaluation can itself be viewed as an evaluation system, and refers to the comprehensive and integrated set of capabilities, resources, activities and support mechanisms for conducting evaluation work. This should not be confused with systems evaluation, which refers to the assessment of the functions, products, outcomes and impacts of a system (set of programs, activities or interventions). Systems evaluation is an approach to conducting program evaluation that considers the complex factors that are inherent within the larger "structure" or "system" within which the program is embedded. Systems evaluation provides both a conceptual framework for thinking about evaluation systems and a set of specific methods and tools that enhances our ability to accomplish high-quality evaluation with integration across organizational levels and structures.

It was the examination of some of our beliefs about evaluation that led to our work in systems evaluation. Here are some of our assumptions about evaluation, which were precursors to developing a systems perspective of evaluation:

  • Evaluation is a dynamic on-going process (see Survival of Programs with Fitness) that is applied to programs that are (themselves) dynamic and changing.
  • Evaluation is a form of feedback that can be used for program or organizational improvement (see "Driving with your Eyes Open" ).
  • A formalized and standardized evaluation framework utilizing a systems perspective is needed to develop consistent and high-quality evaluations (see Simple Rules and Causal Pathways).
  • Program Evaluation is best viewed as a three-phase process, beginning with Evaluation Planning, followed by Evaluation Implementation, and completing the cycle with Evaluation Utilization (which leads back to planning for the next iteration of the program).
  • The Evaluation Planning phase is a critical step for systems evaluation. This is where introducing the systems perspective will shape how evaluators and program staff view the program, program boundaries, stakeholders, and its evaluation (see Inside - Outside).
  • Because of the need to evaluate multiple programs within an organization, there is value in developing systems for evaluation that encompass multiple programs, rather than conducting isolated evaluations of individual programs.

A Systems Perspective on Programs and Program Evaluation.

Below are some key points that we believe should anchor a systems evaluator's perspective.

  • An organization is a system, and is composed of a collection of parts (see "Greater Than the Sum") Systems involve parts, wholes, and their interrelationships.
  • Any program necessarily occurs within a complex environment composed of "nested systems". "Nested systems" refers to the structure where a system is embedded within another system, which is embedded within yet another system
  • For example, Ms. Smith's third grade class is a system within the entire third grade, which is part of the elementary school, which is part of the school district, which is part of the state school system, and so on.
    Human systems are dynamic (see "The Rock and The Bird"). A dynamic systemis necessarily composed of evolving relationships and programs.
    Consequently, evaluation needs to be dynamic and should change in order to successfully link with the needs and maturity of the program being evaluated (see "The Flower and the Bee").
    Programs have lifecycles, and move through various phases. Different evaluation approaches are appropriate for different program phases. In other words, like programs, evaluations should evolve (see "In the Course of a Lifetime").
  • Many organizations have multiple programs and many programs are implemented in multiple organizations - perhaps the third grade consists of Ms. Smith's class, Mrs. Jones' class, and Mr. Perez's class, and at the same time there are many schools with numerous other third grade classes. But each school also has multiple grade levels, and you quickly see that systems can rapidly become complicated.
  • Nested and dynamic systems create an environment where there are multiple perspectives. Each stakeholder has their own perspective (see sidebar "Eye of the Beholder"). Each stakeholder of a program has specific expertise, and brings a distinct perspective and motivation for evaluation. The comprehensive set of stakeholders should be identified and included in the evaluation design and/or evaluation planning process. A stakeholder within the organization would have a local perspective, and one that is placed further away would have a more global perspective (see "The Local and the Global").