AIMSweb

Test of Early Numeracy - Quantity Discrimination

Rating Summary

Classification Accuracyempty bubble
GeneralizabilityBroad
Reliabilityfull bubble
Validityfull bubble
Disaggregated Reliability and Validity DataN A
Efficiency
AdministrationIndividual
Administration & Scoring Time2 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Annual cost per student:
AIMSweb assessment materials are included with an AIMSweb System software subscription:

AIMSweb ProComplete/Pro Math

Grades K–1: $3.00–$5.00 per student per year.

Included in the price are manuals and test materials, directions for administration, test forms, technical manuals, and protocol per student. All materials are provided via download in PDF format

Internet access is required for full use of product services.

Testers will require 4–8 hours of training.

Paraprofessionals can administer the test.

Alternate forms available for benchmarking.

Pearson Assessments
19500 Bulverde Road
San Antonio, TX 78259
Phone: 210-339-5247

Visit AIMSweb.com
Tech support: aimswebsupport@pearson.com

Field tested training manuals are included and should provide all implementation information.

AIMSweb Training sessions are available.

Ongoing technical support is provided.

 

Raw scores are determined by computing the total number of numerals identified as the larger quantity correctly within the 1 minute time period. This data can be interpreted in a norm-referenced way via percentiles or categorically in a standard interpretive format (e.g., below average, average, above average, etc.). Scores are also interpreted by converting progress over time into a Rate of Improvement (ROI) index, typically derived by using an ordinary least squares regression line through the data. A composite score is not calculated

TEN has 33 alternate forms per skill, per grade.

Group administered.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on AIMSweb Mathematics Curriculum-Based Measurement
  Kindergarten Grade 1
Fall Winter Spring Fall Winter Spring
False Positive Rate 0.08 0.01 0.02 0.24 0.22 0.21
False Negative Rate 0.50 0.67 0.78 0.54 0.54 0.57
Sensitivity 0.50 0.33 0.22 0.46 0.46 0.43
Specificity 0.92 0.99 0.98 0.76 0.78 0.79
Positive Predictive Power 0.66 0.86 0.71 0.20 0.32 0.40
Negative Predictive Power 0.81 0.88 0.83 0.92 0.87 0.81
Overall Classification Rate 0.78 0.89 0.82 0.73 0.72 0.70
AUC (ROC) 0.85 0.88 0.87 0.83 0.86 0.87
Base Rate 0.30 0.17 0.21 0.11 0.18 0.24
Cut Points: 1 6 11 5 17 22
At 90% Sensitivity, Specificity equals Not available Not available Not available Not available Not available Not available
At 80% Sensitivity, Specificity equals Not available Not available Not available Not available Not available Not available
At 70% Sensitivity, Specificity equals Not available Not available Not available Not available Not available Not available

 

Classification Accuracy in Predicting Proficiency on Georgia Criterion-Referenced Competency Test
  Kindergarten Grade 1
Fall Winter Spring Fall Winter Spring
False Positive Rate 0.29 0.29 0.24 0.22 0.16 0.21
False Negative Rate 0.25 0.21 0.17 0.19 0.15 0.57
Sensitivity 0.75 0.79 0.83 0.81 0.85 0.43
Specificity 0.71 0.71 0.76 0.78 0.84 0.79
Positive Predictive Power 0.15 0.18 0.22 0.22 0.31 0.40
Negative Predictive Power 0.98 0.98 0.98 0.98 0.98 0.81
Overall Classification Rate 0.72 0.72 0.77 0.79 0.84 0.70
AUC (ROC) 0.81 0.83 0.85 0.90 0.93 0.87
Base Rate 0.06 0.07 0.07 0.07 0.08 0.24
Cut Points: 4 16 25 15 27 22
At 90% Sensitivity, Specificity equals 0.67 0.66 0.72 0.74 0.84 Not available
At 80% Sensitivity, Specificity equals 0.71 0.78 0.84 0.81 0.97 Not available
At 70% Sensitivity, Specificity equals 0.77 0.84 Not available 0.91 0.96 Not available

Generalizability

Description of Study 1 Sample (analyses that used Mathematics Calculation Curriculum-Based Measurement as the criterion):

  • Number of States: 48
  • Size: 165,818
  • Region: All
  • Gender:
    • 48% Male
    • 52% Female
  • SES: about 30% eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 88% White, Non-Hispanic
    • 5% Black, Non-Hispanic
    • 2% Hispanic
    • 3% American Indian/Alaska Native
    • 2% Asian/Pacific Islander

Description of Study 2 Sample (analysis that used the Georgia CRCT Grade 1 as the criterion):

  • Number of States: 1
  • Size: 325
  • Gender:
    • 55% Male
    • 45% Female
  • SES: 5% Eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 60% White, Non-Hispanic
    • 17% Black, Non-Hispanic
    • 14% Hispanic
    • 1% Asian/Pacific Islander
    • 7% Other
  • Disability classification: 3% were receiving special education services in Grade 1
  • Language proficiency status: 14% ELL

Cross Validation Study Description of study sample:

  • Number of States: 48
  • Size: 32,957
  • Region: All
  • Race/Ethnicity:
    • 88% White, Non-Hispanic
    • 5% Black, Non-Hispanic
    • 2% Hispanic
    • 3% American Indian/Alaska Native
    • 2% Asian/Pacific Islander

Reliability

Type of Reliability Age or Grade n Coefficient SEM Information (including normative data)/Subjects
range median
Alternate form K 23   0.80   Martinez et al. (2009). Rural Midwest.
Gender: not reported
Ethnicity
African American 1%
Multiracial 4%
White 95%
Free/reduced lunch 30%
Retest K 25   0.77  
Alternate form K (W) 61   0.91   Baglici (2010). Suburban Northeast.
Gender: F 44% M 56%
Ethnicity:
African American 25%
Asian 8%
Hispanic 23%
White, non-Hispanic 44%
Receiving special education services: 13%
ESL: 3%
K (S) 61   0.89  
Alternate form 1 52 0.92, 0.93 0.92 6.8 Clarke & Shinn (2004). Medium-size school district in the Pacific Northwest.
Gender: F 23 M 29
Ethnicity:
Native American 2
Hispanic 3
White, non-Hispanic 47
Free/reduced lunch: 58%
Receiving special education services: 6%
Retest 1 52   0.85 8.4

Validity

Type of Validity Age or Grade Test or Criterion n Coefficient
Range Median
Concurrent 1st Grade WJ Applied Problems 52 0.71 – 0.79 0.75
Concurrent 1st Grade Number Knowledge Test 52   0.80
Concurrent 1st Grade M-CBM 52 0.71 – 0.75 0.73
Predictive 1st Grade M-CBM 52 0.70 – 0.79 0.76