Edcheckup Standard Reading Passages

Maze

Rating Summary

Classification Accuracyhalf bubble
GeneralizabilityModerate High
Reliabilityfull bubble
Validityempty bubble
Disaggregated Reliability and Validity Datafull bubble
Efficiency
AdministrationGroup
Administration & Scoring Time20 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Each license (or “set”) allows you to access materials, enter data, and generate reports for up to 35 students.

The cost per set is as follows:

  • If purchasing 1 – 10 sets, $100 per set
  • If purchasing 11 – 20 sets, $95 per set
  • If purchasing 21 – 100 sets, $90 per set
  • If purchasing 101 – 200 sets, $85 per set
  • If purchasing 201+ sets, $8 per set

This includes all materials and full data/reporting functionality for all subjects, which includes the following: 138 Controlled Reading passages; 23 Beginning Reading passages; 23 Writing probes; and 23 Math probes.

Computer and Internet access are required for full use of product services.

Testers will require less than 1 hour of training.

Paraprofessionals can administer the test.

Edcheckup, LLC
7701 York Ave S, Ste 250
Edina, MN 55435

Phone: 952-229-1441
Web Site:  www.edcheckup.com

Field-tested training manuals are included and should provide all implementation information.

Ongoing technical support is available.

Edcheckup Maze consists of equivalent sets of 23 reading passages for each grade level. Each passage is formatted as a maze passage where every seventh word has been deleted and replaced with a multiple choice option consisting of three words from which the correct choice is to be selected by the reader.

Three of each set of passages are used for screening to establish students’ current level of proficiency in reading aloud from text and are used to establish cut scores for identifying students who are academically at risk as readers.

Edcheckup is group administered and requires 15 minutes for administration and 5 additional minutes per student for scoring.

Scores available include: raw, standard, developmental benchmarks, and error analysis.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)
Study 1 Total Sample Grade 2 Grade 3 Grade 4 Grade 5 Grade 6
False Positive Rate 0.35 0.26 0.43 0.28 0.43 0.41
False Negative Rate 0.20 0.15 0.21 0.18 0.22 0.21
Sensitivity 0.80 0.85 0.79 0.82 0.78 0.79
Specificity 0.65 0.74 0.57 0.72 0.57 0.59
Positive Predictive Power 0.35 0.44 0.32 0.36 0.32 0.31
Negative Predictive Power 0.93 0.95 0.91 0.96 0.91 0.92
Overall Classification Rate 0.68 0.76 0.61 0.74 0.62 0.63
AUC (ROC) 0.83 0.89 0.80 0.90 0.80 0.81
Base Rate 0.19 0.19 0.20 0.16 0.21 0.19
Cut Points: 97.80 6.33 8.60 7.17 12.60 11.60
At 90% Sensitivity, Specificity equals 0.51 0.65 0.43 0.66 0.46 0.50
At 80% Sensitivity, Specificity equals 0.65 0.79 0.55 0.75 0.64 0.58
At 70% Sensitivity, Specificity equals 0.75 0.88 0.69 0.94 0.81 0.70

 

Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)
Study 2 Total Sample Grade 2 Grade 3 Grade 4 Grade 5 Grade 6
False Positive Rate 0.27 0.39 0.22 0.22 0.25 0.26
False Negative Rate 0.21 0.18 0.21 0.22 0.25 0.20
Sensitivity 0.79 0.82 0.79 0.79 0.75 0.80
Specificity 0.73 0.61 0.78 0.78 0.75 0.74
Positive Predictive Power 0.47 0.31 0.56 0.56 0.43 0.44
Negative Predictive Power 0.92 0.94 0.92 0.91 0.92 0.93
Overall Classification Rate 0.75 0.65 0.79 0.78 0.75 0.75
AUC (ROC) 0.86 0.86 0.87 0.85 0.85 0.83
Base Rate 0.23 0.18 0.26 0.26 0.20 0.21
Cut Points: 97 101 95 96 95 97
At 90% Sensitivity, Specificity equals 0.60 0.45 0.58 0.62 0.57 0.67
At 80% Sensitivity, Specificity equals 0.74 0.63 0.76 0.75 0.74 0.74
At 70% Sensitivity, Specificity equals 0.84 0.93 0.86 0.81 0.79 0.76

 

Generalizability

Description of Sample:

Study 1

  • Number of States: 1
  • Size: 465
  • Gender:
    • 51.8% Male
    • 48.2% Female 
  • SES: 15.8% Eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 68.4% White, Non-Hispanic
    • 13.5% Black, Non-Hispanic
    • 11.5% Hispanic
    • 0.9% American Indian/Alaska Native
    • 5.6% Asian/Pacific Islander
  • Disability classification: 13.8% (includes Federal Setting 1 & 2 LD, EBD, OHD, ASD and Speech students)
  • First Language: 85.1% have home language of English. Other languages represented include Spanish (4.5%)

Study 2

  • Number of States: 1
  • Size: 282
  • Gender:
    • 53.4% Male
    • 46.6% Female 
  • SES: 15.3% Eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 68.0% White, Non-Hispanic
    • 13.2% Black, Non-Hispanic
    • 12.8% Hispanic
    • 1.1% American Indian/Alaska Native
    • 5.0% Asian/Pacific Islander
  • Disability classification: 11.0% (includes Federal Setting 1 & 2 LD, EBD, OHD, ASD and Speech students)
  • First Language: 84.0% have home language of English. Other languages represented include Spanish (3.9%)

Cross Validation Study Description of Sample:

Study 1

  • Number of States: 1
  • Size: 553
  • Gender:
    • 53.5% Male
    • 46.5% Female 
  • Race/Ethnicity:
    • 86.9% White, Non-Hispanic
    • 8.4% Black, Non-Hispanic
    • 2.5% Hispanic
    • 0.4% American Indian/Alaska Native
    • 1.8% Asian/Pacific Islander
  • Disability classification: 12.7% (includes LD, EBD, OHD, ASD and Speech)
  • First Language: 94.7% have English as First Language. Other languages include: Spanish (1.3%)

Study 2

  • Number of States: 1
  • Size: 522
  • Gender:
    • 52.9% Male
    • 47.1% Female 
  • Race/Ethnicity:
    • 87.4% White, Non-Hispanic
    • 7.9% Black, Non-Hispanic
    • 2.5% Hispanic
    • 0.4% American Indian/Alaska Native
    • 1.8% Asian/Pacific Islander
  • Disability classification: 12.1% (includes LD, EBD, OHD, ASD and Speech)
  • First Language: 94.8% have English as First Language

Reliability

Type of Reliability Age or Grade n (range) Coefficient SEM Information / Subjects
range median
Cronbach’s
Alpha
2 211 0.7266-0.8106 0.7529 Median = 0.22 Alpha = 0.9016
Standardized Item Alpha = 0.9063
17.9% Students of Color, 7.6% Students of Poverty, 13.4% Students with Disabilities
Cronbach’s
Alpha
3 233 0.4661-0.7269 0.5849 Median = 0.23 Alpha = 0.8023
Standardized Item Alpha = 0.8136
19.7% Students of Color, 7.5% Students of Poverty, 15.1% Students with Disabilities
Cronbach’s
Alpha
4 206 0.6872-0.7653 0.7589 Median = 0.23 Alpha = 0.8910
Standardized Item Alpha = 0.8938
23.8% Students of Color, 6.0% Students of Poverty, 13.1% Students with Disabilities
Cronbach’s
Alpha
5 249 0.7409-0.8600 0.7823 Median = 0.27 Alpha = 0.9125
Standardized Item Alpha = 0.9206
21.8% Students of Color, 5.6% Students of Poverty, 11.6% Students with Disabilities
Cronbach’s
Alpha
6 74 0.7098-0.7541 0.7300 Median = 0.45 Alpha = 0.8829
Standardized Item Alpha = 0.8909
33.3% Students of Color, 16.7% Students of Poverty, 11.5% Students with Disabilities
Split-Half 2 211 0.7266-0.8106 0.7529 Median = 0.22 Guttman Split-half = 0.8519, Unequal-length Spearman-Brown = 0.9130, 17.9% Students of Color, 7.6% Students of Poverty, 13.4% Students with Disabilities
Split-Half 3 233 0.4661-0.7269 0.5849 Median = 0.23 Guttman Split-half = 0.7074, Unequal-length Spearman-Brown = 0.8054, 19.7% Students of Color, 7.5% Students of Poverty, 15.1% Students with Disabilities
Split-Half 4 206 0.6872-0.7653 0.7589 Median = 0.23 Guttman Split-half = 0.8164, Unequal-length Spearman-Brown = 0.8851, 23.8% Students of Color, 6.0% Students of Poverty, 13.1% Students with Disabilities
Split-Half 5 249 0.7409-0.8600 0.7823 Median = 0.27 Guttman Split-half = 0.8620, Unequal-length Spearman-Brown = 0.9306, 21.8% Students of Color, 5.6% Students of Poverty, 11.6% Students with Disabilities
Split-Half 6 74 0.7098-0.7541 0.7300 Median = 0.45 Guttman Split-half = 0.8410, Unequal-length Spearman-Brown = 0.8925, 33.3% Students of Color, 16.7% Students of Poverty, 11.5% Students with Disabilities
Alternate Form 2 67 0.613-0.756 0.681   School A
Alternate Form 3 93 0.649-0.790 0.737   School A
Alternate Form 4 69 0.700-0.817 0.772   School A
Alternate Form 5 112 0.747-0.851 0.794   School A
Alternate Form 6 75 0.710-0.754 0.731   School A
Alternate Form 2 142 0.784-0.841 0.804   School B
Alternate Form 3 140 0.415-0.704 0.556   School B
Alternate Form 4 135 0.694-0.738 0.721   School B
Alternate Form 5 137 0.735-0.866 0.793   School B

Validity

Type of Validity Age or Grade Test or Criterion n Coefficient Information / Subjects
Construct 2 Measure of Academic Progress 211 0.628 16.6% Students of Color, 7.1%, Students of Poverty, 13.3% Students with Disabilities
Construct 3 Measure of Academic Progress 233 0.502 19.5% Students of Color, 7.1%, Students of Poverty, 14.2% Students with Disabilities
Construct 4 Measure of Academic Progress 204 0.566 22.3% Students of Color, 5.9%, Students of Poverty, 11.9% Students with Disabilities
Construct 5 Measure of Academic Progress 249 0.591 20.4% Students of Color, 5.4%, Students of Poverty, 11.2% Students with Disabilities
Construct 6 Measure of Academic Progress 75 0.502 34.7% Students of Color, 17.3%, Students of Poverty, 10.7% Students with Disabilities
Predictive 2 Measure of Academic Progress 200 0.648 16.4% Students of Color, 5.8%, Students of Poverty, 12.6% Students with Disabilities
Predictive 3 Measure of Academic Progress 224 0.550 18.7% Students of Color, 5.9%, Students of Poverty, 14.2% Students with Disabilities
Predictive 4 Measure of Academic Progress 193 0.533 22.1% Students of Color, 5.1%, Students of Poverty, 11.3% Students with Disabilities
Predictive 5 Measure of Academic Progress 158 0.511 17.2% Students of Color, 3.2%, Students of Poverty, 8.3% Students with Disabilities

 

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)
Study 1 African American Hispanic American Poverty
False Positive Rate 0.368 0.600 0.359
False Negative Rate 0.200 0.111 0.222
Sensitivity 0.800 0.889 0.778
Specificity 0.632 0.400 0.641
Positive Predictive Power 0.462 0.500 0.600
Negative Predictive Power 0.889 0.842 0.806
Overall Classification Rate 0.679 0.597 0.697
AUC (ROC) 0.842 0.792 0.776
Base Rate 0.283 0.403 0.409
Cut Points: CBM Standard Score 95.3 96.0 94.5
At 90% Sensitivity, Specificity equals 60.5% 44.9% 36.5%
At 80% Sensitivity, Specificity equals 71.1% 59.4% 53.5%
At 70% Sensitivity, Specificity equals 80.3% 79.2% 77.7%

 

Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)
Study 2 African American Hispanic American Poverty
False Positive Rate 0.194 0.400 0.261
False Negative Rate 0.00 0.176 0.074
Sensitivity 1.00 0.824 0.926
Specificity 0.806 0.600 0.739
Positive Predictive Power 0.571 0.636 0.806
Negative Predictive Power 1.00 0.800 0.895
Overall Classification Rate 0.846 0.703 0.840
AUC (ROC) 0.940 0.821 0.826
Base Rate 0.502 0.459 0.540
Cut Points: CBM Standard Score 88 94 91
At 90% Sensitivity, Specificity equals 90% 50% 82%
At 80% Sensitivity, Specificity equals 90% 65% 87%
At 70% Sensitivity, Specificity equals 91% 65% 92%

Disaggregated Reliability

Type of Reliability Grade n Coefficient SEM Information Subjects
range median
Cronbach’s
Alpha
2 19 0.9554-
0.9658
0.9633   African American Students
Alpha = 0.9844
Standardized item Alpha = 0.9868
Cronbach’s
Alpha
3 20 0.8162-
0.8811
0.8173   African American Students
Alpha = 0.9382
Standardized item Alpha = 0.9396
Cronbach’s
Alpha
4 25 0.8720-
0.9018
0.8989   African American Students
Alpha = 0.9543
Standardized item Alpha = 0.9608
Cronbach’s
Alpha
5 25 0.9011-
0.9289
0.9241   African American Students
Alpha = 0.9671
Standardized item Alpha = 0.9711
Split-half 2 19 0.9554-
0.9658
0.9633 Median =
9.50
African American Students
Guttman Split-half = 0.8853, Unequal-length Spearman-Brown = 0.98900.
Split-half 3 20 0.8162-
0.8811
0.8173 Median =
8.51
African American Students
Guttman Split-half = 0.8167, Unequal-length Spearman-Brown = 0.9224,
Split-half 4 25 0.8720-
0.9018
0.8989

Median = 7.01

African American Students
Guttman Split-half = 0.8652, Unequal-length Spearman-Brown = 0.9556,
Split-half 5 25 0.9011-
0.9289
0.9241 Median =
6.40
African American Students
Guttman Split-half = 0.8675, Unequal-length Spearman-Brown = 0.9772,

Disaggregated Validity

Type of Validity Grade Test or Criterion n Coefficient Information/Subjects
median
Construct 2 Measure of Academic Progress 18 0.854 African American Students
Construct 3 Measure of Academic Progress 20 0.774 African American Students
Construct 4 Measure of Academic Progress 25 0.688 African American Students
Construct 5 Measure of Academic Progress 25 0.580 African American Students
Construct 3 Minnesota Comprehensive Assessment 20 0.518 African American Students
Construct 4 Minnesota Comprehensive Assessment 25 0.637 African American Students
Construct 5 Minnesota Comprehensive Assessment 25 0.514 African American Students
Predictive 3 Minnesota Comprehensive Assessment 15 0.634 African American Students
Predictive 4 Minnesota Comprehensive Assessment 19 0.436 African American Students
Predictive 5 Minnesota Comprehensive Assessment 26 0.511 African American Students
Predictive 6 Minnesota Comprehensive Assessment 16 0.437 African American Students