Assessment and Accreditation
Annual Reporting Measures
- Completer Impact and Effectiveness
- Employer Satisfaction and Stakeholder Involvement
- Candidates Competency at the Time of Program Completion
- Ability of Completers to be Hired in Positions for Which They Were Prepared
The EPP’s Self-Study Report will provide analysis of trends, comparisons with benchmarks, identification of changes made in the preparation curricula and experiences, how/where/with whom results are shared, resources allocations affected by the EPP’s uses of the information, and indications of future directions.
Measure 1 (Initial): Completer Impact and Effectiveness
The EPP developed a data collection plan for this measure as follows:
New York State does not offer the EPP access to teacher effectiveness data at a state level. The EPP has used the NYC teacher effectiveness data for graduates and sampled program-level data to cobble together a narrative. We have since fleshed out a more comprehensive model that includes four data sources:
- NYCDOE HEDI growth scores
- The Employer Survey
- Alumni Follow-Up Survey
- The Alumni Impact Study
NYCDOE HEDI Growth Scores are annual ratings received by all teachers in the New York City Department of Education (NYCDOE), with “HEDI” standing for Highly Effective (4), Effective (3), Developing (2), and Ineffective (1). It’s a multiple-measure system combining Measures of Teacher Practice (MOTP) and Measures of Student Learning (MOSL) to assess teacher contributions holistically. The HEDI rating is plotted on a matrix, where Highly Effective requires ratings of Highly Effective on both MOSL and MOTP axes or a mix of Highly Effective and Effective. Effective ratings require either Effective on both axes or a mix of Effective and Developing. Advance, NYC’s teacher development and evaluation system, utilizes MOTP and MOSL to provide feedback and determine personnel decisions, including tenure and Teacher Improvement Plans. As part of a data sharing agreement, CUNY Central provides the EPP with HEDI data on Queens College completers working in DOE schools. Data tables below show HEDI ratings distribution 2 years post-completion of EPP programs
NOTE: The Governor signed Chapter 112 (2021) and Chapter 201 (2022) of the laws. These bills, which passed unanimously in both the senate and assembly, eliminated the requirement for school districts and BOCES to complete an annual professional performance review (APPR) for any classroom teacher or building principal for the 2020-21 & 2021-2022 school years. The bill also assures that state funding will not be withheld from any school district for not completing the APPR in the 2020-21 & 2021-22 school years. Fact Sheet 21-11 (updated): Changes to Annual Professional Performance Review (APPR) (nysut.org)
HEDI Ratings of EPP Completers of Initial Programs 2 Years after Program Completion, by Academic Year of Program Completion
Employer Survey – Impact on Student Learning
The EPP has developed an Employer Survey that aligns with both the Completer Survey and the Alumni Follow-Up Survey, enabling data triangulation. This survey, piloted in Fall 2023, is now being distributed to employers who participated in various on-campus meetings throughout the 2023-2024 academic year. This approach, based on stakeholder feedback, is deemed the most effective means to gather data and elicit actionable responses from a larger pool of employers. The resulting data will be included in next year’s reporting.
Alumni Follow-Up Survey – Impact on Student Learning
In 2021, the EPP worked to develop a new Alumni Follow-Up Survey after data from the NExT Alumni Follow-Up Survey was not useful to the continuous improvement efforts of the EPP. The newly developed Alumni Follow-Up Survey aligns with the EPP-developed Completer Survey and Employers Survey to allow for data triangulation. In the Summer of 2022, the EPP piloted the new Alumni Follow-Up Survey with completers from 2020-2021. This allowed the EPP to survey certified alumni who would be teaching for at least a year when receiving the survey.
The survey was sent to 396 initial program completers and 77 advanced program completers who were certified by New York State. Of the 396 initial program completers that received the survey, 15 completers responded. Of the 77 advanced program completers, 9 responded. The data tables below show the responses from alumni related to their satisfaction of their impact on students’ learning growth and their actual APPR ratings (if they were willing to share their ratings with the EPP).
Alumni Impact Study
During the 2022-2023 academic year, the EPP conducted the Alumni Impact Study (AIS) alongside the Alumni Follow-Up Survey and Employer Survey to gauge the influence of completers on student learning. The AIS explores how completers utilize reflective practices and data to enhance instruction and student interactions, fostering growth in academic and non-academic domains. Using interviews, artifacts, and assessments, the study employs rubrics aligned with the Queens College Teacher Portfolio Assessment to track impact on student learning over time. Employing a nested case study approach, the AIS examines individual cases within a broader framework, revealing positive impacts across diverse EPP programs.
Completers who participated in the AIS for the 2022-23AY demonstrated positive impacts on student learning through teaching, assessment, and reflective practice. These alumni represented diverse programs across the EPP suggesting that the mission and conceptual framework of the EPP is integrated throughout our EPP programs.
Measure 2 (Initial & Advanced) Employer Satisfaction and Stakeholder Involvement
In the spring 2021, the EPP decided to develop a new Employer Survey aligned with its mission and goals. This survey, in line with Completer and Alumni Follow-Up Surveys, assesses program completers’ instructional practices, ability to work with diverse learners, classroom environment establishment, and professionalism. To optimize response rates, the EPP strategized ways to strengthen partnerships with districts hosting many teacher candidates during the 2022-23 academic year. By inviting them to campus, the EPP aims to assess program effectiveness and candidates’ impact on student learning. Data collection is underway with the new survey, slated for reporting next academic year.
NExT Employer Survey Results 2020
The NExT Employer Survey was administered every year following the administration of the NExT Transitions to Teaching Survey to Alumni. The NExT Transitions to Teaching Survey was administered 1 year after program completion in which candidates were asked to provide information regarding their current employment. The first administration of the NExT Transitions to Teaching Survey was during the spring of 2020 and the NExT Employer Survey was first administered during the summer of 2020.
In spring 2020, the NExT: Transition to Teaching Survey was sent via SurveyMonkey to alumni. The EPP had access to valid emails for 400 of the 2018-2019 completers. The EPP received 90 responses from the pool of 400, with 28 providing valid employer school names. During a major health crisis, the low response rate, while not ideal was also not surprising. Nine respondents provided supervisor emails and of the nine employers, 2 completed the NExT Employer Survey. Only one employer responded to the additional questions added to the survey by the EPP. The low response rate triggered the EPP to move away from the NExT surveys and develop surveys that were more aligned to the needs of the EPP. The EPP-developed Employer Survey was first administered in Fall 2023. We continue to collect data on out Employers’ satisfaction. This data will be made available during the next reporting cycle.
Please view the results of the prior EPP Employer survey for prior years at the links below.
2019 EPP Employer Survey Results
2018 EPP Employer Survey Results
Measure 3 (Initial & Advanced) Candidates Competency at the Time of Program Completion
Teacher Certification Exams
This report contains the pass rates for EPP Completers for the certification exams required for NY State Teacher Certification. The data files were obtained from edReports Results Analyzer. If a candidate took an exam more than once only the best attempt is included in the results. The data is disaggregated by Licensure Area and academic year of program completion.
EAS
In the past 3 academic years completers of an EPP Undergraduate Initial program have had an average 92% pass rate on the EAS exam. The completers of Graduate Initial programs had an overall pass rate of 96% for the past 3 academic years.
CST
The data is disaggregated for Initial and Advanced programs and by licensure area and academic year of completion. A completer may be required to take more than one exam, i.e., for Elementary Initial Certification, a candidate is required to take the MS 1-6 Part One Lit/ELA, the MS 1-6 Part Two Math, and the MS Part Three Arts & Science exams. Overall, the completers of an EPP Undergraduate Initial program had an average 89% pass rate on the CST exam for the past 3 academic years. The completers of a Graduate Initial programs have had a 92% pass rate on the CST exams. The completers of Graduate Advanced programs had an overall pass rate of 92% for the past 3 academic years.
Measure 4 (Initial & Advanced) Ability of Completers to be Hired in Positions for Which They Were Prepared
Total Queens College EPP Completers Hired by NYC DOE by Completer Year
As part of the CUNY-DOE data sharing agreement, CUNY Central annually provides the EPP with data on Queens College completers that are working as pedagogues in DOE schools. The table below contains the counts and percentages of completers that have obtained employment with the NYC DOE.
As of as of March 2023, 61% of the 2019-2020 Completers of an EPP program had been employed by the NYC DOE. Of the initial completers that were employed by the DOE, approximately 90% received employment within 3 years of program completion. Candidates of Graduate Advanced programs are more likely to already be employed with the NYC DOE prior to program completion.
Please note that the most recent years of data provided to the EPP are represented below. Data for 2022-2023 will be available to the EPP next year.
Total Queens College EPP Completers Hired by NYC DOE by Completer Year
When are Queens College EPP Completers Hired by NYC DOE in Relation to Program Completion?
4.24