edSpring

Nonsense Word Fluency

Rating Summary

Classification Accuracyempty bubble
GeneralizabilityModerate Low
Reliabilityempty bubble
Validityhalf bubble
Disaggregated Reliability and Validity DataN A
Efficiency
AdministrationIndividual
Administration & Scoring Time1-2 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes

 

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on Oral Reading Fluency assessments

 

1st Grade

False Positive Rate

0.20

False Negative Rate

0.24

Sensitivity

0.82

Specificity

0.75

Positive Predictive Power

0.77

Negative Predictive Power

0.81

Overall Classification Rate

0.78

AUC (ROC)

0.86

Base Rate

0.50

Cut Points:

Target scores on NWF Winter Grade 1 = green – 80; yellow – 52

Target scores on NWF Fall Grade 1 = green – 50; yellow - 30

At 90% Sensitivity, Specificity equals

0.68

At 80% Sensitivity, Specificity equals

0.77

At 70% Sensitivity, Specificity equals

0.83

 

Generalizability

Description of study sample:

  • Number of States: 1
  • Gender
    • 49% Male
    • 51% Female
  • SES: 19% eligible for free or reduced-price lunch
  • Race/Ethnicity:
    • 93.4% White, Non-Hispanic
    • 1.2% American Indian/Alaska Native
    • 4.2% Black, Non-Hispanic
    • 3.3% Asian, Pacific Islander
    • 3.3% Hispanic
  • Disability status: 9.3% identified special education

Reliability

Type of Reliability

Age or Grade

n (range)

Coefficient Range

Coefficient Median

SEM

Information (including normative data)/Subjects

Test-retest

K

330

0.72

 

 

Subsample of students receiving NWF screening in Winter and Spring of grade K

Test-retest 1 45 0.73     Subsample of students receiving NWF screening in Fall and Winter of grade 1

 

Validity

Type of Validity

Age or Grade

Test or Criterion

n (range)

Coefficient Range

Coefficient Median

Information (including normative data)/Subjects

Predictive

K

ORF

333

0.72

 

NWF Winter with ORF Spring

Concurrent

1

ORF

405

0.74

 

NWF Winter with ORF Winter