Measures of Academic Progress (MAP) for Primary Grades

Reading

Rating Summary

Classification Accuracyfull bubble
GeneralizabilityModerate High
Reliabilityhalf bubble
Validityhalf bubble
Disaggregated Reliability and Validity Datahalf bubble
Efficiency
AdministrationIndividual Group
Administration & Scoring Time40 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Annual per-student subscription fees start at $13.50 for a bundled assessment suite of Mathematics and Reading tests. Discounts are available based on volume and other factors. Annual subscription fees include the following:

  • Math and Reading computer adaptive tests – Each subject-area test can be administered up to 3 times per year.
  • Mathematics and Reading diagnostic tests – Each subject-area diagnostic test can be administered as often as needed throughout the year.
  • Scoring and Reporting – Because MAP for Primary Grades is a computer-delivered assessment, no additional scoring fees are incurred.
  • NWEA Software – all MAP for Primary Grades software components are provided at no additional charge.

$3,700/session for onsite start up training or professional development for up to 40 attendees. 

NWEA offers two assessment delivery platforms (web-based and client-server).

Testers will require 1 – 4 hours of training.

Paraprofessionals can administer the test.

Accommodations:
The adaptive nature of MAP makes it an appropriate assessment for students with a wide range of skills and needs. Additionally, the MAP system is compatible with third‐party software to provide capabilities that address the visually impaired. These capabilities include magnification, highlight, and color contrast.

Local schools and districts may determine that certain testing accommodations are appropriate for an individual student. Twenty separate accommodations to the test are considered allowable.  These accommodations include, but are not limited to, reading the test directions, providing auditory amplification, testing in alternate settings, dictating responses to a scribe, and so on.  

NWEA
121 NW Everett Street
Portland, OR 97209

Phone: 503-624-1951
Website: www.nwea.org

Field-tested training manuals are included and should provide all implementation information.

A set of online training courses for teachers and administrators are available online through the NWEA Knowledge Academy.

NWEA provides implementation support for the first testing season and ongoing account management support. Toll-free phone and email technical support is provided for the duration of the contract.

MAP for Primary Grades system is an integrated collection of computerized assessments designed for students in kindergarten through second grade. These assessments include screening tests, diagnostic skills checklist tests, and adaptive survey with goals tests in reading and mathematics.

The MAP for Primary Grades Survey with Goals assessments are designed to provide educators with instructional information about what student are ready to learn. These tests, which are appropriate for students who have a firm grasp on foundational skills, adapt to the level of difficulty for each student.

The MAP for Primary Grades assessments meet the unique needs of early learners by displaying interactive elements and providing audio for beginning readers. Four item types are used in MAP for Primary Grades:

  • Multiple choice and “hot spot” items ask the student to choose one or more answers from a given set of possible answers.
  • “Sticky click” items ask the student to create or place manipulatives in order to form an answer.
  • “Click and pop” items asks the student to create or place manipulatives in a designated order to form an answer.

 

MAP for Primary Grades is computer administered and administration time averages 40 minutes per student or group.

Scores on MAP for Primary Grades tests are reported as RIT scores – shorthand for "Rasch units." The testing model underlying the MAP for Primary Grades tests is a one-parameter IRT (Rasch) model, and the RIT scale is a transformation of the Rasch ability estimates; the scale on which scores are actually reported ranges from approximately 100 to 300.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
  Grade K
n = 340
Grade 1
n = 2,554
Grade 2
n = 1,765
False Positive Rate 0.17 0.11 0.10
False Negative Rate 0.50 0.40 0.47
Sensitivity 0.50 0.60 0.53
Specificity 0.83 0.89 0.91
Positive Predictive Power 0.25 0.56 0.64
Negative Predictive Power 0.94 0.91 0.86
Overall Classification Rate 0.80 0.84 0.82
AUC (ROC) 0.75 0.86 0.86
Base Rate 0.10 0.19 0.24
Cut Points: 137 149 162
At 90% Sensitivity, Specificity equals 0.28 0.62 0.65
At 80% Sensitivity, Specificity equals 0.53 0.74 0.77
At 70% Sensitivity, Specificity equals 0.68 0.84 0.83

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
  Grade K
n = 10,533
Grade 1
n = 66,618
Grade 2
n = 45,112
False Positive Rate 0.17 0.12 0.09
False Negative Rate 0.58 0.47 0.40
Sensitivity 0.42 0.53 0.60
Specificity 0.83 0.88 0.92
Positive Predictive Power 0.35 0.50 0.65
Negative Predictive Power 0.87 0.89 0.90
Overall Classification Rate 0.76 0.81 0.85
AUC (ROC) 0.73 0.82 0.88
Base Rate 0.18 0.19 0.21
Cut Points: 137 150 165
At 90% Sensitivity, Specificity equals 0.39 0.53 0.69
At 80% Sensitivity, Specificity equals 0.54 0.68 0.80
At 70% Sensitivity, Specificity equals 0.65 0.77 0.87

 

Generalizability

Description of Study 1 Sample: Measures of Academic Progress

  • Number of States: 49
  • Size: 122,263
  • Gender:
    • 48.8% Male
    • 51.2% Female 
  • Race/Ethnicity:
Race/Ethnicity Kindergarten 1st Grade 2nd Grade
African American 14.6% 14.2% 12.2%
Asian Pacific Islander 1.5% 4.0% 5.3%
Hispanic 8.9% 12.5% 15.4%
Native American 2.6% 2.1% 2.5%
White 72.4% 67.1% 64.6%

Description of Study 2 Sample: Wisconsin Knowledge and Concepts Test

  • Number of States: 1
  • Size: 4,659
  • Gender:
    • 52.9% Male
    • 47.1% Female 
  • Race/Ethnicity:
Race/Ethnicity Kindergarten 1st Grade 2nd Grade
African American 8.2% 15.6% 25.4%
Asian Pacific Islander - - 2.0%
Hispanic - 3.2% 24.5%
Native American 6.1% - 47.5%
White 86.1% 66.2% -

 

Reliability

Type of Reliability Age or Grade n (range) Coefficient Information / Subjects
range
Test-retest 1st 542 – 105,065 0.712 – 0.863  
Marginal K - 2 106,732 – 355,698 0.949 – 0.969  

These data reflect a summary of the total reliability data presented in the Technical Manual (Technical Manual For Measures of Academic Progress (MAP) and Measures of Academic Progress for Primary Grades (MPG). Portland, OR: Northwest Evaluation Association).

Validity

Type of Validity Grade Test or Criterion n (range) Coefficient Information / Subjects
range
Construct/ Criterion Related 1-2 MAP Math 326 – 11,401 0.567 – 0.748 These data reflect a summary of the total validity data presented in the Technical Manual (Technical Manual For Measures of Academic Progress (MAP) and Measures of Academic Progress for Primary Grades (MPG). Portland, OR: Northwest Evaluation Association).
Construct   DIBELS Phonemic Segmentation Fluency 31 0.64  
Construct   DIBELS Nonsense Word Fluency 33 0.52  
Construct   DIBELS Letter Naming Fluency 35 0.45  
Construct   DIBELS Phonemic Segmentation Fluency 911 0.12  
Construct   DIBELS Nonsense Word Fluency 911 0.47  
Construct   DIBELS Retell Fluency 911 0.58  
Construct   DIBELS Word Use Fluency 911 0.25  
Construct   DIBELS Oral Reading Fluency 911 0.69  
Construct   AIMSweb Oral Reading Fluency 911 0.69  

Correlations Between PG-Reading Goal Scores and DIBELS and AIMSweb Oral Reading Fluency Scores

  MPG Reading Goal Survey
Phonological Awareness Phonics Concepts of Print Vocabulary & Word Structure Comprehension Writing
DIBELS Phonemic Segmentation Fluency 0.58 0.38 0.44 0.49 0.50 0.40
DIBELS Nonsense Word Fluency 0.30 0.38 0.34 0.45 0.40 0.54
DIBELS Letter Naming Fluency 0.31 0.46 0.27 0.19 0.24 0.38
AIMSweb Oral Reading Fluency 0.55 0.65 0.49 0.59 0.59 0.66

 

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Disaggregated Classification Accuracy

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Kindergarten Boys
n = 178
Girls
n = 162
African American
n = 28
White
n = 293
False Positive Rate 0.21 0.12 0.38 0.15
False Negative Rate 0.38 0.69 0.43 0.60
Sensitivity 0.62 0.31 0.57 0.41
Specificity 0.79 0.88 0.62 0.85
Positive Predictive Power 0.28 0.18 0.33 0.18
Negative Predictive Power 0.94 0.94 0.81 0.95
Overall Classification Rate 0.77 0.83 0.61 0.82
AUC (ROC) 0.73 0.78 0.82 0.80
Base Rate 0.12 0.08 0.25 0.08
Cut Points: 137 137 137 137
At 90% Sensitivity, Specificity equals 0.22 0.48 0.14 0.28
At 80% Sensitivity, Specificity equals 0.53 0.50 0.14 0.50
At 70% Sensitivity, Specificity equals 0.65 0.64 0.24 0.70

 

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Grade 1 Boys
n = 1,355
Girls
n = 1,199
African American
n = 399
Asian Pacific Islander
n = 47
Hispanic
n = 381
White
n = 1,693
False Positive Rate 0.13 0.09 0.22 0.10 0.21 0.07
False Negative Rate 0.38 0.43 0.32 0.38 0.46 0.43
Sensitivity 0.62 0.57 0.68 0.63 0.55 0.57
Specificity 0.87 0.91 0.78 0.90 0.79 0.93
Positive Predictive Power 0.57 0.53 0.68 0.56 0.48 0.52
Negative Predictive Power 0.89 0.93 0.78 0.92 0.83 0.94
Overall Classification Rate 0.81 0.86 0.74 0.85 0.73 0.89
AUC (ROC) 0.84 0.87 0.75 0.86 0.98 0.71
Base Rate 0.22 0.15 0.41 0.17 0.26 0.12
Cut Points: 149 149 149 149 149 149
At 90% Sensitivity, Specificity equals 0.59 0.66 0.42 0.62 0.39 0.63
At 80% Sensitivity, Specificity equals 0.72 0.76 0.65 0.66 0.53 0.77
At 70% Sensitivity, Specificity equals 0.82 0.84 0.76 0.77 0.67 0.84

 

Classification Accuracy in Predicting Proficiency on the Wisconsin Knowledge and Concepts Test
Grade 2 Boys
n = 933
Girls
n = 832
African American
n = 450
Asian Pacific Islander
n = 30
Hispanic
n = 443
White
n = 839
False Positive Rate 0.11 0.08 0.12 0.08 0.17 0.06
False Negative Rate 0.43 0.52 0.42 0.75 0.47 0.53
Sensitivity 0.57 0.48 0.58 0.25 0.53 0.47
Specificity 0.89 0.92 0.88 0.92 0.84 0.94
Positive Predictive Power 0.66 0.61 0.75 0.33 0.56 0.59
Negative Predictive Power 0.84 0.88 0.77 0.89 0.82 0.91
Overall Classification Rate 0.80 0.83 0.77 0.83 0.75 0.87
AUC (ROC) 0.86 0.87 0.87 0.75 1.00 1.00
Base Rate 0.28 0.20 0.38 0.13 0.28 0.15
Cut Points: 162 162 162 162 162 162
At 90% Sensitivity, Specificity equals 0.64 0.63 0.62 0.85 0.47 0.72
At 80% Sensitivity, Specificity equals 0.75 0.78 0.75 0.85 0.62 0.83
At 70% Sensitivity, Specificity equals 0.80 0.86 0.82 0.82 0.74 0.86

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Kindergarten Boys
n = 5,349
Girls
n = 5,184
African American
n = 1,478
Asian Pacific Islander
n = 156
Hispanic
n = 899
Native American
n = 268
White
n = 7,336
False Positive Rate 0.19 0.15 0.23 0.21 0.33 0.23 0.14
False Negative Rate 0.55 0.63 0.56 0.33 0.41 0.58 0.63
Sensitivity 0.45 0.37 0.45 0.67 0.59 0.42 0.37
Specificity 0.81 0.85 0.77 0.79 0.67 0.77 0.86
Positive Predictive Power 0.39 0.29 0.41 0.21 0.43 0.43 0.30
Negative Predictive Power 0.84 0.89 0.79 0.97 0.80 0.76 0.89
Overall Classification Rate 0.73 0.79 0.68 0.78 0.65 0.67 0.79
AUC (ROC) 0.72 0.73 0.69 0.74 0.70 0.67 0.73
Base Rate 0.21 0.14 0.27 0.08 0.30 0.30 0.14
Cut Points: 137 137 137 137 137 137 137
At 90% Sensitivity, Specificity equals 0.38 0.39 0.36 0.14 0.37 0.24 0.38
At 80% Sensitivity, Specificity equals 0.54 0.55 0.47 0.64 0.51 0.44 0.55
At 70% Sensitivity, Specificity equals 0.63 0.64 0.58 0.73 0.59 0.56 0.65

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Grade 1 Boys
n = 34,062
Girls
n = 32,556
African American
n = 8,966
Asian Pacific Islander
n = 2,547
Hispanic
n = 7,934
Native American
n = 1,347
White
n = 42,492
False Positive Rate 0.15 0.10 0.22 0.11 0.26 0.20 0.09
False Negative Rate 0.44 0.52 0.38 0.33 0.34 0.47 0.56
Sensitivity 0.56 0.48 0.62 0.67 0.66 0.53 0.44
Specificity 0.85 0.90 0.78 0.89 0.74 0.80 0.91
Positive Predictive Power 0.52 0.46 0.56 0.42 0.50 0.61 0.47
Negative Predictive Power 0.87 0.91 0.83 0.96 0.85 0.74 0.90
Overall Classification Rate 0.79 0.84 0.74 0.86 0.72 0.70 0.84
AUC (ROC) 0.81 0.82 0.78 0.90 0.77 0.76 0.82
Base Rate 0.22 0.15 0.30 0.11 0.28 0.37 0.15
Cut Points: 150 150 150 150 150 150 150
At 90% Sensitivity, Specificity equals 0.52 0.54 0.44 0.75 0.43 0.38 0.54
At 80% Sensitivity, Specificity equals 0.67 0.70 0.61 0.81 0.59 0.58 0.68
At 70% Sensitivity, Specificity equals 0.77 0.78 0.73 0.87 0.71 0.67 0.78

 

Classification Accuracy in Predicting Proficiency on Measures of Academic Progress
Grade 2 Boys
n = 23,185
Girls
n = 21,927
African American
n = 5,221
Asian Pacific Islander
n = 2,122
Hispanic
n = 6,404
Native American
n = 1,042
White
n = 27,332
False Positive Rate 0.10 0.07 0.14 0.06 0.17 0.15 0.06
False Negative Rate 0.37 0.45 0.37 0.33 0.28 0.39 0.47
Sensitivity 0.63 0.55 0.63 0.67 0.72 0.61 0.53
Specificity 0.90 0.93 0.86 0.94 0.83 0.85 0.94
Positive Predictive Power 0.67 0.62 0.64 0.60 0.66 0.67 0.64
Negative Predictive Power 0.88 0.91 0.85 0.95 0.86 0.82 0.91
Overall Classification Rate 0.83 0.87 0.79 0.91 0.79 0.77 0.87
AUC (ROC) 0.88 0.88 0.85 0.94 0.86 0.83 0.89
Base Rate 0.24 0.17 0.29 0.12 0.32 0.33 0.17
Cut Points: 165 165 165 165 165 165 165
At 90% Sensitivity, Specificity equals 0.67 0.69 0.59 0.82 0.61 0.53 0.70
At 80% Sensitivity, Specificity equals 0.80 0.80 0.73 0.89 0.75 0.66 0.81
At 70% Sensitivity, Specificity equals 0.86 0.87 0.82 0.93 0.84 0.78 0.88