Measures of Academic Progress (MAP) for Primary Grades

Mathematics

Rating Summary

Classification Accuracyfull bubble
GeneralizabilityModerate High
Reliabilityhalf bubble
Validityhalf bubble
Disaggregated Reliability and Validity Datahalf bubble
Efficiency
AdministrationIndividual Group
Administration & Scoring Time40 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Annual per-student subscription fees start at $13.50 for a bundled assessment suite of Mathematics and Reading tests. Discounts are available based on volume and other factors. Annual subscription fees include the following:

  • Math and Reading computer adaptive tests – Each subject-area test can be administered up to 3 times per year.
  • Mathematics and Reading diagnostic tests – Each subject-area diagnostic test can be administered as often as needed throughout the year.
  • Scoring and Reporting – Because MAP for Primary Grades is a computer-delivered assessment, no additional scoring fees are incurred.
  • NWEA Software – all MAP for Primary Grades software components are provided at no additional charge.

$3,700/session for onsite start up training or professional development for up to 40 attendees. 

NWEA offers two assessment delivery platforms (web-based and client-server).

Testers will require 1 – 4 hours of training.

Paraprofessionals can administer the test.

Accommodations:
The adaptive nature of MAP makes it an appropriate assessment for students with a wide range of skills and needs. Additionally, the MAP system is compatible with third‐party software to provide capabilities that address the visually impaired. These capabilities include magnification, highlight, and color contrast.

Local schools and districts may determine that certain testing accommodations are appropriate for an individual student. Twenty separate accommodations to the test are considered allowable.  These accommodations include, but are not limited to, reading the test directions, providing auditory amplification, testing in alternate settings, dictating responses to a scribe, and so on.  

NWEA
121 NW Everett Street
Portland, OR 97209

Phone: 503-624-1951
Website: www.nwea.org

Field-tested training manuals are included and should provide all implementation information.

A set of online training courses for teachers and administrators are available online through the NWEA Knowledge Academy.

NWEA provides implementation support for the first testing season and ongoing account management support. Toll-free phone and email technical support is provided for the duration of the contract.

MAP for Primary Grades system is an integrated collection of computerized assessments designed for students in kindergarten through second grade. These assessments include screening tests, diagnostic skills checklist tests, and an adaptive survey with goals tests in reading and mathematics.

The MAP for Primary Grades Survey with Goals assessments are designed to provide educators with instructional information about what students are ready to learn. These tests, which are appropriate for students who have a firm grasp on foundational skills, adapt to the level of difficulty for each student.

The MAP for Primary Grades assessments meet the unique needs of early learners by displaying interactive elements and providing audio for beginning readers. Four item types are used in MAP for Primary Grades:

  • Multiple choice and “hot spot” items ask the student to choose one or more answers from a given set of possible answers.
  • “Sticky click” items ask the student to create or place manipulatives in order to form an answer.
  • “Click and pop” items asks the student to create or place manipulatives in a designated order to form an answer.

 

MAP for Primary Grades is computer administered and administration time averages 40 minutes per student or group.

Scores on MAP for Primary Grades tests are reported as RIT scores – shorthand for "Rasch units." The testing model underlying the MAP for Primary Grades tests is a one-parameter IRT (Rasch) model, and the RIT scale is a transformation of the Rasch ability estimates; the scale on which scores are actually reported ranges from approximately 100 to 300.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
  Grade K
n = 416
Grade 1
n = 2,559
Grade 2
n = 1,745
False Positive Rate 0.17 0.10 0.10
False Negative Rate 0.50 0.39 0.46
Sensitivity 0.50 0.61 0.54
Specificity 0.83 0.90 0.91
Positive Predictive Power 0.21 0.59 0.64
Negative Predictive Power 0.95 0.91 0.86
Overall Classification Rate 0.80 0.84 0.82
AUC (ROC) 0.79 0.86 0.87
Base Rate 0.08 0.19 0.24
Cut Points: 140 148 166
At 90% Sensitivity, Specificity equals 0.47 0.63 0.64
At 80% Sensitivity, Specificity equals 0.65 0.77 0.76
At 70% Sensitivity, Specificity equals 0.73 0.86 0.85

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
  Grade K
n = 10,919
Grade 1
n = 66,052
Grade 2
n = 44,093
False Positive Rate 0.14 0.13 0.10
False Negative Rate 0.49 0.43 0.38
Sensitivity 0.51 0.57 0.62
Specificity 0.86 0.87 0.90
Positive Predictive Power 0.42 0.51 0.61
Negative Predictive Power 0.90 0.90 0.91
Overall Classification Rate 0.80 0.82 0.85
AUC (ROC) 0.79 0.83 0.88
Base Rate 0.17 0.19 0.20
Cut Points: 136 151 170
At 90% Sensitivity, Specificity equals 0.47 0.57 0.67
At 80% Sensitivity, Specificity equals 0.62 0.71 0.79
At 70% Sensitivity, Specificity equals 0.72 0.80 0.86

 

Generalizability

Description of Study 1 Sample: Measures of Academic Progress

  • Number of States: 49
  • Size: 121,064
  • Gender:
    • 48.8% Male
    • 51.2% Female 
  • Race/Ethnicity:
Race/Ethnicity Kindergarten 1st Grade 2 Grade
African American 14.4% 14.3% 12.2%
Asian Pacific Islander 1.6% 3.9% 5.3%
Hispanic 9.3% 13.5% 15.4%
Native American 2.3% 2.1% 2.5%
White 72.4% 66.3% 64.6%

Description of Study 2 Sample: Wisconsin Knowledge and Concepts Test

  • Number of States: 1
  • Size: 4,720
  • Gender:
    • 53.3% Male
    • 46.7% Female 
  • Race/Ethnicity:
Race/Ethnicity Kindergarten 1st Grade 2 Grade
African American 5.6% 15.6% 25.0%
Asian Pacific Islander - 2.0% -
Hispanic 3.7% 15.6% 25.0%
Native American - - 46.6%
White 90.7% 65.6% -

 

Reliability

Type of Reliability Age or Grade n (range) Coefficient Information / Subjects
range
Coefficient alpha   109 – 2,678 0.674 – 0.928  
Test-retest 1 398 – 108,579 0.705 – 0.870  
Marginal   0.918 – 0.933 112,659 – 361,851  

These data reflect a summary of the total reliability data presented in the Technical Manual (Technical Manual For Measures of Academic Progress (MAP) and Measures of Academic Progress for Primary Grades (MPG). Portland, OR: Northwest Evaluation Association).

Validity

Type of Validity Grade Test or Criterion n (range) Coefficient Information / Subjects
range
Construct/ Criterion Related 1-2 MAP Math 302 – 12,844 0.641 – 0.806 These data reflect a summary of the total validity data presented in the Technical Manual (Technical Manual For Measures of Academic Progress (MAP) and Measures of Academic Progress for Primary Grades (MPG). Portland, OR: Northwest Evaluation Association).
Construct   AIMSweb Math Computation 867 0.40  
Construct   AIMSweb Math Concepts & Applications 44 0.45  
Construct   AIMSweb TEN Missing Number 1,449 0.41  
Construct   AIMSweb TEN Number Identification 1,824 0.41  
Construct   AIMSweb TEN Quantity Discrimination 1,670 0.43  
Construct   AIMSweb TEN Oral Counting 2,080 0.49  
Construct   AIMSweb Math Computation 107 0.56  
Construct   AIMSweb TEN Quantity Discriminationu 107 0.57  

Correlations Between PG-Mathematics Goal Scores and AIMSweb Scores

  MPG Math Goal Survey
Problem Solving Number Sense Computation Measurement & Geometry Statistics & Probability Algebra
Math Computation 0.34 0.31 0.39 0.32 0.30 0.31
Math Concepts & Applications 0.42 0.18 0.31 0.42 0.37 0.36
Missing Number 0.32 0.35 0.36 0.35 0.34 0.35
Number Identification 0.33 0.35 0.35 0.36 0.35 0.33
Quantity Discrimination 0.36 0.36 0.36 0.36 0.37 0.36
Oral Counting 0.42 0.41 0.43 0.42 0.42 0.41
Math Computation 0.49 0.56 0.47 0.47 0.44 0.37
Quantity Discrimination 0.49 0.55 0.43 0.53 0.42 0.43

 

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Kindergarten Boys
n = 223
Girls
n = 193
African American
n = 23
White
n = 372
False Positive Rate 0.19 0.15 0.53 0.14
False Negative Rate 0.43 0.62 0.33 0.56
Sensitivity 0.57 0.39 0.67 0.44
Specificity 0.81 0.85 0.47 0.86
Positive Predictive Power 0.24 0.16 0.31 0.18
Negative Predictive Power 0.95 0.95 0.80 0.96
Overall Classification Rate 0.79 0.82 0.52 0.83
AUC (ROC) 0.80 0.77 0.66 0.79
Base Rate 0.94 0.70 0.26 0.70
Cut Points: 140 140 140 140
At 90% Sensitivity, Specificity equals 0.56 0.37 0.24 0.43
At 80% Sensitivity, Specificity equals 0.68 0.47 0.24 0.66
At 70% Sensitivity, Specificity equals 0.71 0.67 0.24 0.72

 

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Grade 1 Boys
n = 1,369
Girls
n = 1,190
African American
n = 401
Asian Pacific Islander
n = 47
Hispanic
n = 399
White
n = 1,681
False Positive Rate 0.13 0.08 0.26 0.15 0.15 0.07
False Negative Rate 0.36 0.43 0.32 0.33 0.40 0.46
Sensitivity 0.64 0.57 0.68 0.67 0.60 0.54
Specificity 0.87 0.93 0.74 0.85 0.85 0.93
Positive Predictive Power 0.55 0.65 0.68 0.40 0.61 0.51
Negative Predictive Power 0.91 0.90 0.75 0.95 0.84 0.94
Overall Classification Rate 0.83 0.86 0.72 0.83 0.78 0.89
AUC (ROC) 0.85 0.89 0.87 0.81 0.67 0.67
Base Rate 0.19 0.19 0.44 0.13 0.28 0.12
Cut Points: 148 148 148 148 148 148
At 90% Sensitivity, Specificity equals 0.58 0.68 0.45 0.71 0.51 0.63
At 80% Sensitivity, Specificity equals 0.73 0.83 0.62 0.73 0.66 0.77
At 70% Sensitivity, Specificity equals 0.84 0.88 0.74 0.73 0.76 0.88

 

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Grade 2 Boys
n = 925
Girls
n = 820
African American
n = 444
Hispanic
n = 443
White
n = 814
False Positive Rate 0.11 0.08 0.15 0.12 0.07
False Negative Rate 0.42 0.51 0.40 0.50 0.50
Sensitivity 0.58 0.49 0.60 0.50 0.50
Specificity 0.89 0.92 0.85 0.88 0.94
Positive Predictive Power 0.62 0.67 0.73 0.60 0.53
Negative Predictive Power 0.87 0.85 0.75 0.82 0.93
Overall Classification Rate 0.82 0.82 0.74 0.77 0.88
AUC (ROC) 0.86 0.88 0.90 0.75 0.86
Base Rate 0.24 0.24 0.41 0.27 0.13
Cut Points: 166 166 166 166 166
At 90% Sensitivity, Specificity equals 0.64 0.65 0.56 0.49 0.74
At 80% Sensitivity, Specificity equals 0.74 0.78 0.68 0.67 0.80
At 70% Sensitivity, Specificity equals 0.83 0.87 0.80 0.76 0.88

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Kindergarten Boys
n = 5,561
Girls
n = 5,358
African American
n = 1,513
Asian Pacific Islander
n = 166
Hispanic
n = 977
Native American
n = 243
White
n = 7,601
False Positive Rate 0.16 0.13 0.24 0.21 0.29 0.23 0.11
False Negative Rate 0.48 0.51 0.39 0.43 0.30 0.53 0.59
Sensitivity 0.52 0.49 0.61 0.57 0.70 0.47 0.42
Specificity 0.85 0.87 0.76 0.79 0.71 0.77 0.89
Positive Predictive Power 0.43 0.41 0.53 0.11 0.44 0.47 0.37
Negative Predictive Power 0.89 0.90 0.82 0.98 0.88 0.77 0.91
Overall Classification Rate 0.79 0.81 0.71 0.78 0.71 0.68 0.83
AUC (ROC) 0.78 0.79 0.74 0.74 0.75 0.70 0.79
Base Rate 0.18 0.16 0.31 0.04 0.25 0.31 0.13
Cut Points: 136 136 136 136 136 136 136
At 90% Sensitivity, Specificity equals 0.48 0.48 0.38 0.00 0.38 0.30 0.49
At 80% Sensitivity, Specificity equals 0.61 0.63 0.55 0.63 0.58 0.48 0.62
At 70% Sensitivity, Specificity equals 0.71 0.72 0.68 0.69 0.71 0.57 0.71

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Grade 1 Boys
n = 33,736
Girls
n = 32,316
African American
n = 8,968
Asian Pacific Islander
n = 2,439
Hispanic
n = 8,458
Native American
n = 1,301
White
n = 41,587
False Positive Rate 0.15 0.10 0.24 0.13 0.25 0.19 0.09
False Negative Rate 0.40 0.47 0.33 0.25 0.34 0.41 0.53
Sensitivity 0.60 0.53 0.67 0.75 0.66 0.59 0.47
Specificity 0.85 0.90 0.76 0.87 0.75 0.81 0.91
Positive Predictive Power 0.50 0.53 0.59 0.38 0.51 0.64 0.46
Negative Predictive Power 0.90 0.90 0.82 0.97 0.85 0.77 0.92
Overall Classification Rate 0.80 0.83 0.73 0.86 0.73 0.73 0.85
AUC (ROC) 0.83 0.84 0.79 0.91 0.78 0.77 0.83
Base Rate 0.20 0.18 0.34 0.10 0.28 0.37 0.14
Cut Points: 151 151 151 151 151 151 151
At 90% Sensitivity, Specificity equals 0.55 0.58 0.47 0.76 0.45 0.41 0.54
At 80% Sensitivity, Specificity equals 0.71 0.72 0.64 0.84 0.62 0.59 0.71
At 70% Sensitivity, Specificity equals 0.79 0.81 0.75 0.89 0.72 0.71 0.80

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Grade 2 Boys
n = 22,583
Girls
n = 21,510
African American
n = 5,030
Asian Pacific Islander
n = 2,181
Hispanic
n = 6,362
Native American
n = 1,054
White
n = 26,744
False Positive Rate 0.11 0.09 0.18 0.06 0.17 0.16 0.07
False Negative Rate 0.37 0.39 0.29 0.35 0.34 0.36 0.44
Sensitivity 0.63 0.61 0.71 0.65 0.66 0.64 0.57
Specificity 0.89 0.91 0.82 0.94 0.83 0.84 0.93
Positive Predictive Power 0.60 0.63 0.65 0.57 0.63 0.68 0.58
Negative Predictive Power 0.90 0.91 0.86 0.95 0.85 0.81 0.92
Overall Classification Rate 0.84 0.86 0.79 0.91 0.78 0.77 0.87
AUC (ROC) 0.88 0.88 0.86 0.93 0.84 0.83 0.88
Base Rate 0.21 0.19 0.32 0.11 0.31 0.35 0.15
Cut Points: 170 170 170 170 170 170 170
At 90% Sensitivity, Specificity equals 0.67 0.68 0.61 0.80 0.57 0.59 0.68
At 80% Sensitivity, Specificity equals 0.79 0.80 0.74 0.87 0.72 0.72 0.80
At 70% Sensitivity, Specificity equals 0.85 0.87 0.83 0.92 0.80 0.80 0.87