mCLASS

Math

Rating Summary

Classification Accuracyempty bubble
GeneralizabilityModerate High
Reliabilityfull bubble
Validityempty bubble
Disaggregated Reliability and Validity Dataempty bubble
Efficiency
AdministrationIndividual Group
Administration & Scoring Time1 - 12 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Cost per student for Year 1: $13.90 per student (includes $8.90 platform subscription)

$75 for complete mCLASS:Math kit, which includes Teacher’s Guide, Student Materials, and Instructional Activities Guide (80 classroom activities for small-group or individual instruction).

Each teacher administering mCLASS:Math needs a handheld computer which typically costs $200-$300 from national resellers.

$400 remote installation fee per campus. Includes telephone guidance through the installation of the software on teacher handhelds and desktop computers, troubleshooting, and verification of installation process.

Onsite installation, including onsite installation of mCLASS software onto teacher handhelds, setup of up to three central sync stations per campus and preparation of a training room, is available for $1,400 per campus.

Cost per student for subsequent years: $13.90 per student for annual student license.

All materials can be downloaded for free as PDF files by licensed users at http://www.amplify.com/assessment/mclass-math

Computer and Internet access are required for full use of product services.

Testers will require 4-8 hours of training.

Paraprofessionals can administer the test.

Amplify
55 Washington St. Suite 900
Brooklyn, NY 11201
Phone #: 1-800-823-1969, option 1

Website: http://www.amplify.com/

Amplify’s Customer Care Center offers complete user-level support from 7:00 a.m. to 7:00 p.m. EST, Monday through Friday. Customers may contact a customer support representative via telephone, e-mail, or electronically through the mCLASS Website. Calls to the Customer Care Center’s toll-free number are answered immediately by an automated attendant and routed to customer support agents according to regional expertise.  Additionally, customers have self-service access to instructions, documents, and frequently asked questions on our Website.

mCLASS:Math is a set of screening and progress monitoring measures for grades K-3. Measures in grades K and 1 are administered individually by a teacher using a handheld computer. While the student performs an assessment task using paper-based assessment materials or verbally presented prompts, the teacher follows along on the handheld, tapping with the stylus to record the student’s performance. The handheld software offers a pre-loaded class list indicating required assessment tasks, provides the teacher with directions and prompts to ensure standardized, accurate administration, and automates the precise timing requirements.  Upon completion of each task, the handheld automatically calculates the student’s score and provides a risk evaluation.  Measures in grades 2 and 3 are group administered on paper with online entry of scores to http://www.amplify.com/assessment/mclass-math

mCLASS:Math Computation takes 1 minute to administer to a group of students or one-on-one in grades K and 1. Administration is 2 minutes for grades 2 and 3.

Scoring time is 0 minutes for grades K and 1, and 10 minutes for grades 2 and 3.

20 alternate forms are available.

Raw, percentile, developmental benchmarks; subscale/subtest, and composite scores are available.

Raw scores on each measure are the number of all correct responses within the time limit (1 or 2 minutes). For Computation in grades 2-3, the raw score is the correct number of digits in the student’s responses (e.g. 25+8 = 23 is worth 1 point, 25+8=33 is worth 2 points).

Percentile ranks for each measure and time of year are calculated at the district-level.

Developmental benchmarks for each measure, grade, and time of year (beginning, middle, end) report each score as deficit, emerging, or established.

Composite score: Based on the number of measures on which the student performs at deficit, emerging, or established given time of year, an overall instructional support recommendation is reported for each student.

Slopes of student performance over the course of a year on any measure are automatically graphed on web based reports at http://www.amplify.com/assessment/mclass-math. An aimline is charted from the student’s screening score to an end of year goal.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Woodcock-Johnson III Broad Math
  K
n = 198
Grade 1
n = 225
Grade 2
n = 244
Grade 3
n = 200
Benchmark Intensive Benchmark Intensive Benchmark Intensive Benchmark Intensive
False Positive Rate 0.28 0.35 0.26 0.34 0.00 0.33 0.18 0.43
False Negative Rate 0.33 0.30 0.27 0.00 0.49 0.21 0.43 0.26
Sensitivity 0.67 0.70 0.73 1.00 0.51 0.79 0.57 0.74
Specificity 0.72 0.65 0.74 0.66 1.00 0.68 0.82 0.57
Positive Predictive Power 0.51 0.24 0.38 0.03 1.00 0.56 0.97 0.50
Negative Predictive Power 0.83 0.93 0.93 1.00 0.10 0.86 0.15 0.79
Overall Classification Rate 0.71 0.66 0.74 0.66 0.54 0.71 0.60 0.64
AUC (ROC) 0.68 0.68 0.66 0.66 0.73 0.73 0.67 0.67
Base Rate 0.30 0.14 0.18 0.01 0.95 0.34 0.92 0.37
Cut Points: * * * * * * * *
At 90% Sensitivity, Specificity equals 0.00 0.00 0.00 0.00 0.10 0.10 0.15 0.15
At 80% Sensitivity, Specificity equals 0.00 0.00 0.00 0.00 0.10 0.10 0.15 0.15
At 70% Sensitivity, Specificity equals 0.83 0.83 0.00 0.00 0.86 0.86 0.79 0.79

*The cut points are either “Benchmark” or “Intensive”. Using “Benchmark” as the cut point any results above the cut point indicate no risk. Using “Intensive” as the cut point any results below the cut point indicate highest risk.

Generalizability

Description of study sample:

  • Number of States: 2
  • Size: 867
  • Gender:
    • 45% Male
    • 47% Female 
    • 8% Unknown
  • SES: 33% Eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 58% White, Non-Hispanic
    • 22% Black, Non-Hispanic
    • 9% Hispanic
    • 0% American Indian/Alaska Native
    • 1% Asian/Pacific Islander
    • 1% Other
    • 9% Unknown
  • Language proficiency status:
    • 85% English
    • 6% Spanish
    • 1% Other

Cross Validation Study Description of study sample:

  • Number of States: 1
  • Size: 13,919
  • Gender:
    • 47% Male
    • 45% Female 
    • 8% Unknown
  • SES: 40% Eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 58% White, Non-Hispanic
    • 15% Black, Non-Hispanic
    • 10% Hispanic
    • 0% American Indian/Alaska Native
    • 1% Asian/Pacific Islander
    • 4% Other
    • 13% Unknown
  • Disability classification:
    • 7% disabled
    • 38% unknown

Reliability

Type of Reliability Age or Grade n (range) Coefficient SEM Information / Subjects
range median
Alpha K 291 0.87-0.98 0.94 1.81-3.18 Data were collected in NYC and Missouri in January 2008.
Alpha 1 319 0.79-0.98 0.935 1.33-2.91 Data were collected in NYC and Missouri in January 2008.
Alpha K 68 0.87-0.97 0.915 0.37-1.42 Data were collected in Alabama in October 2006.
Alpha 1 69 0.8-0.98 0.93 1.23-2.2 Data were collected in Alabama in October 2006.
Alpha 2 286 0.7-0.94 0.86 1.3-2.21 Data were collected in NYC and Missouri in January 2008.
Alpha 3 259 0.69-0.92 0.84 1.51-2.27 Data were collected in NYC and Missouri in January 2008.
Test-retest K 94 0.7-0.86 0.74 2.08-3.95 Data were collected in NYC and Missouri in January 2008.
Test-retest 1 99 0.68-0.82 0.7 1.6-4.28 Data were collected in NYC and Missouri in January 2008.
Test-retest 2 72 0.36-0.83 0.6 1.47-4.14 Data were collected in NYC and Missouri in January 2008.
Test-retest 3 87 0.44-0.72 0.6 1.94-4.24 Data were collected in NYC and Missouri in January 2008.
Split-half K 68 0.87-0.97 0.88 1.14-1.93 Data were collected in Alabama in October 2006.
Split-half 1 69 0.84-0.98 0.92 1.12-1.54 Data were collected in Alabama in October 2006.

 

Validity

Type of Validity Age or Grade Test or Criterion n Coefficient Information (including normative data)/Subjects
range median
Content K-3         Alignment of mClass: Math to the Common Core State Standards in Mathematics
Concurrent K WJ-III (Broad Math) 318   0.53 Data were collected in NYC and Missouri in January 2008.
Concurrent 1 WJ-III (Broad Math) 314   0.52 Data were collected in NYC and Missouri in January 2008.
Concurrent 2 WJ-III (Broad Math) 351   0.45 Data were collected in NYC and Missouri in January 2008.
Concurrent 3 WJ-III (Broad Math) 338   0.34 Data were collected in NYC and Missouri in January 2008.
Concurrent K TEMA-3 (Overall Scale Score) 68   0.62 Data were collected in Alabama in October 2006.
Concurrent 1 TEMA-3 (Overall Scale Score) 69   0.53 Data were collected in Alabama in October 2006.
Predictive K TEMA-3 (Overall Scale Score) 63   0.53 Data were collected in Alabama in May 2007.
Predictive 1 TEMA-3 (Overall Scale Score) 56   0.39 Data were collected in Alabama in May 2007.

 

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Woodcock-Johnson III Broad Math
  White
n = 507
Black or African American
n = 187
Hispanic-Latino
n = 75
Benchmark Intensive Benchmark Intensive Benchmark Intensive
False Positive Rate 0.23 0.35 0.24 0.38 0.38 0.43
False Negative Rate 0.46 0.27 0.33 0.19 0.37 0.24
Sensitivity 0.54 0.73 0.67 0.81 0.63 0.76
Specificity 0.77 0.65 0.76 0.62 0.62 0.57
Positive Predictive Power 0.78 0.31 0.86 0.54 0.63 0.34
Negative Predictive Power 0.53 0.92 0.51 0.85 0.62 0.89
Overall Classification Rate 0.63 0.67 0.70 0.68 0.63 0.61
AUC (ROC) 0.70 0.70 0.75 0.75 0.66 0.66
Base Rate 0.60 0.17 0.69 0.36 0.51 0.23
Cut Points: * * * * * *
At 90% Sensitivity, Specificity equals 0% 0% 51% 51% 0% 0%
At 80% Sensitivity, Specificity equals 53% 53% 51% 51% 62% 62%
At 70% Sensitivity, Specificity equals 53% 53% 85% 85% 62% 62%

*The cut points are either “Benchmark” or “Intensive”. Using “Benchmark” as the cut point any results above the cut point indicate no risk. Using “Intensive” as the cut point any results below the cut point indicate highest risk.

Disaggregated Validity

Type of Validity Grade Test or Criterion n Coefficient Information/Subjects
median
Concurrent K-3 WJ-III (Broad Math) 812 0.42 White; Data were collected in NYC and Missouri in January 2008.
Concurrent K-3 WJ-III (Broad Math) 224 0.50 Black or African-American; Data were collected in NYC and Missouri in January 2008.
Concurrent K-3 WJ-III (Broad Math) 107 0.37 Hispanic-Latino; Data were collected in NYC and Missouri in January 2008.