This page attempts to
bring
together online resources for those considering, working with and/or
otherwise
engaged in an examination of standards and reporting issues in adult
education.
Inclusion of particular sites in no way connotes tacit or explicit
endorsement
of those sites or their underlying approaches, assumptions or
instruments
of assessment. If you feel that a site has been omitted, or would like
to add sites that support these linee of inquiry, please contact Janet
Isserlis
Swearer
Language and Literacy Program Rubrics for Placement and Assessment
- developed by Marie Cora and her team of language and literacy
coordinators,
May, 2000.
recent additions to
this page:
Access for all
- standards for adult learning, including adult literacy core
curriculum, standards and level descriptors from DFES in England;
particular attention is paid to a range of disabilities.
REEP Adult ESL Level Descriptions; part of a larger assessment piece from the REEP Program
An
Annotated
Bibliography
of Program Standards for Adult ESL - Compiled by MaryAnn
Cunningham
Florez, National Center for ESL Literacy Education , March, 2002
Assessment
and
Evalution
in adult ESOL programs - digests from the National
Clearinghouse
for ESL Literacy Education (now CAELA)
Best Program Practices - a framework to help programs examine their practice, reflect upon it and see how things could be improved. Includes program standards, indicators and outcome measures.
CASAS - the Comprehensive
Adult Student Assessment System has as its mission "to provide
learner-centered
curriculum management, assessment, and evaluation systems to education
and training programs in the public and private sector. These systems
are
designed to meet the diverse and rapidly-changing functional life skill
needs of adults and youth in today's technological and multi-cultural
society
through accurate identification of learner needs, monitoring progress,
and certification of competency attainment. CASAS is committed to
carrying
out its mission through a field-based consortium involved in the
identification
of needs and in the research and development of system components."
Common European Framework of Reference for Languages: Learning, teaching, assessment - from a testing site, but interesting sets of levels: "Assessment of the Cambridge examinations is linked to a Common European Framework established by the Association of Language Testers in Europe (ALTE) and used for a wide range of European languages."
Content Standards in Adult Education - " Dr. Roberta McKnight, of the Virginia Literacy Institute, conducted a thorough review of the literature to prepare a comprehensive report regarding the development of content standards. The report summarizes current developments across the United States, discusses issues related to content standards, and provides an interactive matrix of links to each state's website."
From: Lisa Levinson Director Equipped for the Future National Center 5766 Shibles Hall University of Maine Orono, ME 04469-5766 207-581-260 [NLA list Mon, 7 Feb 2000] ... you can now order the official Equipped for the Future Content Standards: What Adults Need to Know and Be Able to Do in the 21st Century.This document describes the EFF development process, how the EFF Standards work, examples of how teachers from our field development process used EFF for teaching and learning with the EFF framework, and where EFF is headed in the next few years as we develop the EFF assessment system and continue our research and data collection process as we work towards standards-based system reform.
To order single copies of the Standards, please call ED Pubs at 1-877-433-7827 and request publication number NIFL EX 0099P. (If 877 is not available in your area, call 1-800-872-5327). If you want to use the TTY/TDD line, please call 1-800-437-0833. You can also e mail ED Pubs to request the Standards at edpubs@inet.ed.gov. Please request the publication number no matter how you order.
To order multiple copies, please send your request to the new Equipped for the Future National Center housed at the University of Maine. The new Center is responsible for training, staff development, technical assistance and materials and materials development for EFF implementation. Please e mail your requests with your mailing address, number of copies requested to Faye Olsen, the Center's assistant director, at mco@mint.net or call her at 207-581-2458. You can also call Faye to inquire about staff development events or to discuss customizing staff development for your system.
by Peggy McGuire, EFF Assessment Coordinator, Philadelphia, PA
Originally published in Adventures in Assessment, Volume 12 (Winter
2000), SABES/World Education, Boston, MA, Copyright
2000,
Posted to SABES Web site: May 2000.
On Common Ground - Video Correlation to Equipped for the Future, 2000 This crosswalk is designed to help instructors use Equipped for the Future (Common Activities, Content Standards, and Citizen/Community Member Role map) and On Common Ground together. Episodes in the On Common Ground series are presented in a convenient at-a-glance format. Correlation is to videos only in the series.
To participate in the National Institute for Literacy's online
discussion
group focusing on EFF, go to http://www.nifl.gov/lincs/discussions/discussions.html
and click on the link to EFF.
To follow conversations between Ron Pugsley and the field around standards and related issues, see the archive for the NLA list at http://lists.literacytent.org/
EFF meets the National Reporting System
The following letter, from the directors of the National Institute for Literacy and the Division of Adult Education and Literacy, U.S.Department of Education is of interest as we continue to consider standards, outcomes and other reporting measurements for adult education.
October 12, 1999
Dear Colleagues:
Many of you have asked about the relationship between DAEL's National Reporting System (NRS) and NIFL's Equipped for the Future (EFF). Recently the directors and staff of both DAEL and [continued] NIFL spent the better part of a day discussing the two projects in order to refine our mutual sense of the ways in which they can complement one another. By the end of our meeting we all felt we had a richer understanding of the projects and the contributions each can make to a stronger, more effective adult education delivery system. We want to share the highlights of our discussions with you.
One important conversation centered on the kinds of standards NRS and EFF currently offer. Here we acknowledged a fundamental distinction. The NRS project focuses on program performance standards that reflect how well adults perform, while EFF has developed content standards - standards that specify what adults need to know and be able to do. Basically, NRS will collect information from programs that reveals how learners are progressing in the core indicator areas defined by the Workforce Investment Act. The EFF project seeks to define the skills and knowledge adults need in order to carry out their roles as parents, citizens, and workers.
The projects' goals are clearly related. Some of the core indicators NRS must measure reflect mastery of the skills EFF has identified as essential content knowledge. In addition to profiling employment and training attainments, NRS records progress of adult learners in 12 levels of language and basic skills development. EFF is developing a performance continuum for each of EFF's 16 content standards, and plans to develop assessments of learner progress, all of which ultimately may prove useful to NRS. The projects' paths cross, and we can ensure they do so in sensible, mutually beneficial ways.
Our discussion identified three primary areas in which each project's next steps can help support development of the other. The first area involves defining and measuring performance for NRS core indicators and EFF's content standards. We agreed we should work to make NRS performance levels required by the Workforce Investment Act and EFF mastery of essential content knowledge compatible. In this way evidence collected to document student mastery of EFF standards can also be used to respond to NRS reporting requirements where the EFF standards meet the statutory requirements of the Act. We don't want programs to have to make multiple kinds of measurements.
The second area involves assessments. Both projects acknowledge the need for improved forms of assessment capable of accurately determining learner performance. Among the items EFF and NRS are considering is how to make both standards more inclusive of persons with disabilities. As EFF and NRS staff proceed with this work, they will share their findings. Program improvement was the third common area identified. Although the primary purpose of the NRS is to collect data to improve program accountability, DAEL staff is exploring how to put the data to additional use to support program improvement. EFF approaches program improvement directly by linking teaching and learning to what adults need to know and do to be effective parents, citizens, and workers. Evaluation of EFF, which will begin within the next six months, also may contribute to program improvement by identifying factors that support effective teaching and learning.
We hope this letter sheds some light on how DAEL and NIFL staff are thinking about NRS and EFF. If you have any further questions or thoughts about the projects and how they might support one another, we invite you to let us know.
Sincerely, Andrew J. Hartman Executive Director, National Institute for Literacy and Ronald Pugsley, Director Division of Adult Education & Literacy
FairTest: The National Center
for Fair & Open Testing - advocacy organization working to
end the abuses, misuses and flaws of standardized testing and ensure
that
evaluation of students and workers is fair, open, and educationally
sound,
placing " special emphasis on eliminating the racial, class, gender,
and
cultural barriers to equal opportunity posed by standardized tests, and
preventing their damage to the quality of education. Based on four
Goals
and Principles, we provide information, technical assistance and
advocacy
on a broad range of testing concerns, focusing on three areas:
K-12,
university admissions, and employment tests, including teacher
testing."
Family Literacy Indicators of Program Quality (FLIPQs) - a self-assessment tool based on the Missouri Family Literacy Indicators of Program Quality and Standards of Performance.
Focus on Basics - Volume 3, Issue C on Standards Based Education, September 1999
Focus on Basics - Volume 3, Issue B on Accountability, March 1999
includes: Learners First by Shirley Wright, Performance
Accountability:
For What? To Whom? And How? by Juliet Merrifield, The National
Reporting
System by Barbara Garner, Accountability in a Multiple-Faceted
Program
by Jan Goethel & Carol Gabler, Focus on Research: Voices of
Learners:
Learner Identified Impacts Study.
and, FOB's topic index on standards.
Language Testing at the Center for Applied Linguistics, including the Basic English Skills Test (BEST), one of the standardized tests used by many ESOL programs.
also see: Where
Does It Fit In? The Massachusetts ESOL Curriculum Framework by
Heide Spruck Wrigley
the site contains documents on the IALS, [the International Adult Literacy Survey; the bigger picture of which theNALS is one piece), issues of accountability, full text documents, including the following; check this page frequently as resources as added regularly:
NALS
Raises
Vital Equity Issues - summary (1994) of Stephen Reder's
presentation
at the Congressional Black Caucus Foundation's Twenty-third
Annual Legislative Weekend, chaired by the Hon. Donald M. Payne
of New Jersey, September 16, 1993 in Washington, DC.
Adult Literacy in the United States: A compendium of quantitative data and interpretive comments by Thomas G. Sticht and William B. Armstrong, with copies of test items fromWWI to the present along with data on program pre- and post-tests, literacy and work and intergeneratinal data.
The State of
Literacy
in America Synthetic Estimates of Adult Literacy Proficiency at
the
local, state and national levels - Stephen Reder
The good news, the bad news. Reder's estimates have assisted
programs in establishing 'need'; Reder likely understands that these
numbers
represent a particular idea of what 'counts' (or counted) during the original
NALS undertaking. Will the new
survey reveal substantive information about what adults can and
want to do?
Date: Wed, 08 Dec 1999 17:32:15 -0800
As a background for thinking about testing and accountability issues in the Workforce Investment Act and the National Reporting System, NLA list members may find useful a report I have prepared that is available online at www.nald.ca under full text documents. Following is a brief overview of the report. - Tom Sticht
Testing and Accountability in Adult Literacy Education: Focus on Workplace Literacy Resources for Program Design, Assessment, Testing, & Evaluation
Thomas G. Sticht November 1999
Recent national and international surveys of adult literacy skills have raised questions about workforce readiness for international competitiveness. This report provides information on the design and evaluation of workplace literacy programs to improve workforce readiness, and an overview of concepts about the nature, uses and abuses of standardized tests in program evaluation and accountability. This is not a "how to do it" guidebook. Rather, it discusses concepts and issues and provides bibliographic resources for those readers who want to learn more about how to design, develop, and evaluate literacy programs in the workplace and other contexts.
Workplace literacy or basic skills programs are programs offered at a given workplace and generally are aimed at preparing employees for performing job-linked literacy and numeracy tasks, such as filling out requisition forms in a clerical position or preparing to learn statistical process control. However, much of the discussion is applicable to other types of programs for workforce education and lifelong learning, including family literacy, academic literacy and other aspects of basic skills education (reading, writing, mathematics, English as a Second Language-ESL). Chapters include:
Chapter 1 Knowledge Resources for Designing and Delivering Workplace Literacy Programs
Chapter 2 Q & A on the Evaluation of Workplace Literacy Programs
Chapter 3 Case Study Using the "DO ED" Approach for Evaluating Workplace Literacy Programs
Chapter 4 Testing and Accountability in Adult Literacy Programs in the Workforce Investment Act of 1998
Chapter 5 Determining How Many Adults Are Lacking in Workforce Literacy: The National and International Adult Literacy Surveys
Appendix Reviews of Eight Tests Used in ABE & ESL
Thomas G. Sticht Applied Behavioral & Cognitive Sciences, Inc. 2062 Valley View Blvd. El Cajon, CA 92019-2059 (619) 444-9595 tsticht@aznet.net
Matching
Literacy Testing with Social Policy: What are the Alternatives?
Author: Richard L. Venezky, University of Delaware and National Center
on Adult Literacy, 1992, NCAL
This list is deliberately small and attempting to tailor itself to
this
page. There are hundreds of documents worth reviewing about a number of
topics, as well as those that focus on workplace assessment and other
more
general issues. The site NALD is fully searchable and well worth
repeated
visits, not only for issues of accountability, etc., but also for a
very
broad range of perspectives and information regarding adult literacy in
English and in French.
Synthetic estimates for the states - 1992 - go to http://www.casas.org/
and search for 'synthetic' to see synthetic analysis of literacy rates
by state
National Assessment of Adult Literacy 2002 Home Page - The National Center for Education Statistics has posted a new Webpage devoted to the National Assessment of Adult Literacy 2002 program which will assess the current status of the English-language literacy skills of adults in the US. The site offers a description of the purposes and goals of the program; posted and forthcoming working papers on adult literacy assessment; and previews of the published reports the program will produce over the next 3 years, including data on national, state, and inter-national comparisons of literacy, results by major population subgroups, and relationships between background variables and literacy attainment. The site also provides links to related literacy sites and a link to the full text of the 1992 National Assessment of Adult Literacy, which includes an overview of all of the program's adult literacy statistics and conclusions about long- and short-term literacy trends.
The National Reporting System for Adult Education
The National Reporting System for Adult Education (NRS) is an outcome-based reporting system for the state-administered, Federally funded adult education program. Developed with the support of the U.S. Department of Education's Division of Adult Education and Literacy (DAEL), the NRS continues a cooperative process by state adult education directors and DAEL to identify appropriate learner outcomes for adult education. The project is being conducted by the American Institutes for Research's Pelavin Research Center in Washington, DC.
The goals of the NRS were to establish a national accountability system for adult education programs by identifying measures for national reporting and their definitions, establishing methods for data collection, developing software standards for reporting to the U.S. Department of Education and developing training materials and activities on NRS requirements and procedures. The NRS established the accountability system for the adult education program required by Title II of the Workforce Investment Act.
Using a common set of outcome measures and a uniform data collection system, the states will measure and document learner outcomes resulting from adult education instruction through the NRS. Local programs will collect and aggregate data from students at each instructional site, using an individual student record system. These data will be submitted to the state for statewide aggregation and submission to DAEL. DAEL will combine state data into a national database describing outcomes of adult education.
The National Reporting System will improve the public accountability of the adult education program by documenting its ability to meet Federal policy and programmatic goals. The collection of state outcome data will enable states to correlate effective practices and programs with successful outcomes, and will also assist states in assessing progress in meeting their adult education goals. For local providers, the NRS will help instructors and administrators plan instructional activities and services to enhance student outcomes and to correlate effective practices and programs with successful outcomes.
NRS (US) Online
-
yet more about how to report nationally, as well as online tasks and
activities
for those learning to navigate the national reporting system.
The National Reporting
System
online - Australia's "nationally recognised mechanism for
reporting
outcomes of adult english language, literacy and numeracy programmes."
New York State Adult Education standards - "intended to enhance programming for adults in New York State. The focus of this guide is to link New York's learning standards with the curriculum goals and objectives developed by adult education practitioners. Its purpose is to raise the standards of adult education in New York State with the belief that adult learners will be better prepared as parents and individuals to tackle the economic, social, and familial challenges and realities existing today. The Adult Education Resource Guide and Learning Standards includes the learning standards for English language arts and mathematics. These two areas were identified by adult education practitioners as the most important for beginning adult learners. Curriculum supplements for ESOL and GED are also provided. For the veteran adult educator, this first section is a reprise, a reminder of the creativity and skill required for this most important work. New teachers and new adult educators will find the introduction to be the foundation of everything they will be doing with adult learners. Clearly, it will be the beginning of further work and study."
No Levels out There - a messgae posted on November 15/99 by Tom Sticht, elucidating the fact that "there are no 'literacy levels' to be 'described' in the adult populations of nations. Instead, there are various ways of conceptualizing the nature of literacy and different procedures of measurement that can lead to the construction of alternative representations of adult literacy in society." Read the message in its entirety, and follow the thread on this archive from the National Literacy Advocacy list.
[Also see Dr. Sticht's Levels Metaphor, November 14, 1999).
Ohio's assessment system: from Gloria Gillette, to the
National
Literacy Advocacy List, November 2, 2001
: Ohio decided to implement statewide use of a portfolio system last
year
in response to the NRS. An overview is available at http://literacy.kent.edu/NEABLE/ESOL_OPAS_UPS.htm.
There you will find an overview, the content standards the system is
based
on and the documentation logs used for the system. (Under
ESOL/OPAS Support
Activites is dynamite piece with simple activites and suggestions
correlated to the NRS levels). I can speak for ESOL as that was
my
area of expertise and experience. We were more fortunate in that we had
had a committee working on standards when the NRS came in to
being.
The standards were field driven, we had an NIFL
Fellow working on assessment instruments and we worked very hard
to
provide support for the implementation. It requires work and
change
in approach for many of our teachers.There was a great deal of
grumbling
and as we all know, change does not always come easily. But I also
think
they have welcomed the opportunity to more fully participate in a more
comprehensive approach to adult learning. After a year of use, people
have
grown to accept the portfolio system, and many have embraced it, found
it to be an incredibly useful tool.
Pennsylvania's adult education information documents, including standards/accountability
[ from NCLE Notes, Vol. 8, No. 1, Spring/Summer 1999: "A useful resource in these days of systemic change is Performance-Based Curricula and Outcomes: The MELT Project Updated for the 1990s and Beyond by CAL's Allene Guss Grognet. This work updates the listening and speaking competencies compiled by CAL's Mainstream English Language Training (MELT) project of the early '80s. Its four sections include an introduction, the core curriculum, student performance levels, and a section on assessment and accountability. Order a free copy from the Spring Institute for International Studies (303) 863-0178 or get it from the Web at www.springinstitute.com/elt/. Also available from the Spring Institute is English Language Training Program Self Review: A Tool for Program Improvement."
| literacy/ESOL and beginning ESOL | basic literacy / ABE |
| low and high intermediate ESOL | citizenship |
employability
standards - across levels
Using informal assessments for English
language learners - while focused on K-12 learners, includes
useful approaches and resources for adult education contexts.
Arizona Adult Education Standards
The Arizona Adult Education Standards Project is a proactive effort by Arizona's Adult Education Community to ensure consistency in program content and student outcomes for adult learners throughout the state. The fundamental goal of the project is to ensure high levels of achievement for all adult learners.
In recent years, state and federal legislatures, and the general
public,
have increasingly demanded that adult educators provide evidence that
the
learners enrolled in their programs are achieving high levels of
educational
gains. In order to accomplish this, the Arizona Adult Education
community-
through this multi-year Standards Project ? will develop components of
a comprehensive, state wide, student performance accountability
system. (more information about the standards http://www.c-pal.net/build/candi/basic/standards.asp
)
Splendid Web Home -
everything you need to teach the functions of the Arizona Content
Standards in the ESOL classroom with complementary computer activities.
Choose a lesson:
STANDARDS for Teachers of Adult
Learners
(DRAFT)
ESOL Task Force
on Adult Teacher Standards Issues Draft - A Firsthand Report
from TESOL 2002 in Salt Lake City
US K - 12 Standards - A compilation of content standards for K-12 curriculum in both searchable and browsable formats.
Massachusetts
ABE teachers licensure home page
SABES ABE License support -
delineation of standards, part of an overall License Support resource
compendium .
Pennsylvania 's Adult Teacher Competencies
FENTO - one of 71 UK-wide National Training Organisations (NTOs). It is the national lead body responsible for the development, quality assurance and promotion of national standards for the Further Education sector.
QCA -
National adult literacy and numercay qualifications for adult
educators
in the U.K.
page
created October 29, 1999
last updated April 29, 2008
lr/ri home