STAR

Reading

Rating Summary

Classification Accuracyfull bubble
GeneralizabilityBroad
Reliabilityfull bubble
Validityfull bubble
Disaggregated Reliability and Validity Datafull bubble
Efficiency
AdministrationIndividual Group
Administration & Scoring Time10 Minutes
Scoring KeyComputer Scored
Benchmarks / NormsYes
Cost Technology, Human Resources, and Accommodations for Special Needs Service and Support Purpose and Other Implementation Information Usage and Reporting

Cost per student for year 1: $9.00 per student (based on start up, per student fees based on minimum of 203 students. $1,599.00 + $200.00 fee = $1799.00)

The one time fee for STAR Reading is $1,599.00. It is web-based and includes the tool, software/technical manual, installation guide, testing instructions, remote installation and setup.

Cost for subsequent years:

$0.99 per student per year (203 student minimum).

Computer access is required.

Testers will require less than 1 hour of training.

Paraprofessionals can administer the test.

Accommodations:
STAR Reading is a computer-adaptive assessment, and the difficulty of items is adjusted automatically to reflect the skill level of a student, including students with special needs.

STAR Reading offers several accommodations for students with disabilities through the accessibility options built into a computer’s operating system. For instance, students with limited motor skills can execute STAR Reading’s mouse-related functions through the keyboard when “mouse keys” is selected under Accessibility Options within the Windows operations system.

For students with limited vision, the introductory screens of STAR Reading respond to the “high contrast” accessibility feature within Windows and the “switch to black and white” accessibility feature in MAC OS 10. The assessment screens within STAR Reading already provide visual contrast through a yellow background and black writing. Furthermore, STAR Reading is compatible with Mac OS 10’s “zoom in” accessibility feature, which allows users to magnify nearly all STAR Reading screens.

Renaissance Learning, Inc.
PO Box 8036 Wisconsin Rapids, WI 54495
http://www.renaissance.com/
Phone: (800) 338-4204
         
Field tested training manuals are included and should provide all implementation information.

Ongoing technical support is available from the Renaissance Learning technical support staff.

STAR Reading is a computer-adaptive assessment of general reading achievement and comprehension that can be administered to individuals or groups of students in grades 1 through 12 in approximately 10 minutes.

The tool provides information on student performance in reading. The difficulty of items is adjusted automatically to reflect the skill level of all students, including students with special needs.

STAR Reading takes approximately 10 minutes to administer the test. Scoring is automated and does not require any additional time.

The STAR Reading software calculates a maximum likelihood Rasch ability estimate based on the calibrated difficulty of the items that were administered to the student, and the pattern of the student’s right and wrong responses to those items. The Rasch ability estimate is transformed to the equivalent STAR Reading scaled score by means of a nonlinear transformation derived from equipercentile equating of STAR Reading 2.0 scores to the original STAR Reading 1.0 score scale. No cluster or composite scores are reported.

Grade equivalent scores, percentile scores, IRT-based scores, normal curve equivalent scores, IRL (instructional reading levels), and scale scores (scores on a vertically equated development scale) are available. Reports generated automatically by STAR Reading can include all of these scores.

The number of alternate forms is virtually unlimited because STAR Reading is a computer-adaptive assessment.

 

Classification Accuracy

Classification Accuracy in Predicting Proficiency on State Achievement Tests in 6 States (Arkansas, Delaware, Illinois, Kansas, Michigan, and Mississippi)
n=63,291
False Positive Rate 0.21
False Negative Rate 0.24
Sensitivity 0.76
Specificity 0.76
Positive Predictive Power 0.44
Negative Predictive Power 0.93
Overall Classification Rate 0.76
AUC (ROC) Grade   AUC                  n          
2           0.82                 249
3           0.84                 13,835
4           0.85                 12,791
5           0.84                 11,783
6           0.83                 9,382
7           0.83                 7,731
8           0.84                 5,902
9           0.85                 165
10         0.86                 779
11         0.84                 674
Base Rate 0.20
Cut Point: Grade            Cut Score 
2                      228
3                      308
4                      399
5                      488
6                      540
7                      598
8                      628
9                      708
10                    777
11                    1,055

 

Classification Accuracy in Predicting Proficiency the South Dakota State Test of Education
n=42,771
False Positive Rate 0.18
False Negative Rate 0.22
Sensitivity 0.78
Specificity 0.82
Positive Predictive Power 0.57
Negative Predictive Power 0.92
Overall Classification Rate 0.81
AUC (ROC) Grade  AUC                   n        
3           0.87                 10,693
4           0.88                 9,026
5           0.88                 7,275
6           0.88                 6,647
7           0.90                 4,579
8           0.88                 4,551
Base Rate 0.20
Cut Point: Grade             Cut Score
3                      288
4                      397
5                      473
6                      552
7                      622
8                      727

 

Generalizability

Description of Study 1 Sample:

  • Number of States: 6 (Arkansas, Delaware, Illinois, Michigan, Mississippi, Kansas)
  • Size: 63,291
  • Region:
    • Central
    • Southwest
    • Northeast
    • Midwest
    • Southeast
  • Gender:
    • 27.7% Male
    • 28.0% Female
    • 44.2% Unknown
  • Race/Ethnicity:
    • 27.7% White, Non-Hispanic
    • 14.2% Black, Non-Hispanic
    • 2.2% Hispanic
    • 0.0% American Indian/Alaska Native
    • 0.4% Asian/Pacific Islander
    • 55.3% Unknown

Description of Study 2 Sample:

  • Number of States: 1 (South Dakota)
  • Size: 42,771
  • Gender:
    • 49.3% Male
    • 50.7% Female
  • Race/Ethnicity:
    • 71.0% White, Non-Hispanic
    • 0.7% Black, Non-Hispanic
    • 1.4% Hispanic
    • 26.1% American Indian/Alaska Native
    • 0.7% Asian/Pacific Islander

Cross Validation Study Description of study sample:

  • Number of States: 6 (Arkansas, Delaware, Illinois, Michigan, Mississippi, Kansas)
  • Size: 15,754
  • Region:
    • Central
    • Southwest
    • Northeast
    • Midwest
    • Southeast
  • Gender:
    • 28.2%  Male
    • 27.5%  Female
    • 44.3% Unknown
  • Race/Ethnicity:
    • 28.2% White, Non-Hispanic
    • 14.1% Black, Non-Hispanic
    • 2.1% Hispanic
    • 0.2% American Indian/Alaska Native
    • 0.4% Asian/Pacific Islander
    • 55.1% Unknown

Reliability

Type of Reliability Age or Grade n (range) Coefficient SEM
Range Median
Generic 1 – 5 7,523 – 10,476 0.89-0.91 0.90 36-62
Median: 48
Split Half 1 – 5 7,523 – 10,476 0.88-0.89 0.89  
Retest 1 – 5 296-300 0.82-0.89 0.83  
Generic 2-12 1,153-6,462 0.90-0.93 0.92 71-83
Median: 81
Split Half 6-12 1,153-6,462 0.89-0.91 0.90  
Retest 6-12 209-294 0.80-0.90 0.81  

 

Validity

Type of Validity Age or Grade Test or Criterion n (range) Coefficient
Range Median
Concurrent 1-12 Various 12,000+ 0.71-0.73 0.72
Predictive 3-6 SAT9 and CST 1,000+ 0.81-0.83
0.78-0.81
0.82
0.80
Predictive 2-6 SAT9 44-389 0.66-0.73 0.68
Concurrent 1-8 Suffolk Reading Scale 2,694 0.78-0.86 0.82
Construct 3, 5, 7, 10 DRP 273-424 0.76-0.86 0.82
Concurrent 1-4 DIBELS Oral Reading Fluency 12,220 0.71-0.87 0.81
Predictive 1-6 Various 74,877-200,929 0.68-0.82 0.79
Predictive 7-12 Various 3,107-64,978 0.81-0.86 0.82
Concurrent 3-8 Various 1,200-2,329 0.71-0.74 0.73
Predictive 3-8 Various 2,974-4,493 0.66-0.70 0.68

 

Disaggregated Reliability, Validity, and Classification Data for Diverse Populations

Classification Accuracy in Predicting Proficiency on State Achievement Tests in 6 States (Arkansas, Delaware, Illinois, Kansas, Michigan, and Mississippi): by Race/Ethnicity
  White, non-Hispanic
n = 17,567
Black, non-Hispanic
n = 8,962
Hispanic
n = 1,382
Asian/Pacific Islander
n = 231
American Indian/ Alaska Native
n = 111
False Positive Rate 0.1324 0.4427 0.3582 0.1710 0.1216
False Negative Rate 0.3762 0.1215 0.1224 0.2368 0.4054
Sensitivity 0.6238 0.8785 0.8776 0.7632 0.5946
Specificity 0.8676 0.5573 0.6418 0.8290 0.8784
Positive Predictive Power 0.5711 0.5031 0.6103 0.4677 0.7097
Negative Predictive Power 0.8909 0.8999 0.8913 0.9467 0.8125
Overall Classification Rate 0.8139 0.6658 0.7337 0.8182 0.7838
AUC (ROC)  Grade             AUC
2          n/a
3          0.863
4          0.862
5          0.853
6          0.849
7          0.816
8          0.850
9          1.000
10        0.875
11        0.750
Grade AUC
2          0.500
3          0.828
4          0.823
5          0.832
6          0.806
7          0.784
8          0.827
9          0.848
10        0.831
11        1.000
Grade AUC
2          n/a
3          0.868
4          0.837
5          0.839
6          0.825
7          0.866
8          0.812
9          n/a
10        0.833
11        n/a
Grade AUC
2          n/a
3          0.913
4          0.869
5          0.855
6          0.859
7          0.904
8          0.961
9          n/a
10        n/a
11        n/a
Grade AUC
2          n/a
3          0.697
4          0.888
5          0.919
6          0.846
7          0.900
8          1.000
9          n/a
10        n/a
11        n/a
Base Rate 0.2203 0.3379 0.3900 0.1645 0.333
Cut Scores Grade Cut Score
2          228
3          308
4          399
5          488
6          540
7          598
8          628
9          708
10        777
11        1,055
Grade Cut Score
2          228
3          308
4          399
5          488
6          540
7          598
8          628
9          708
10        777
11        1,055
Grade Cut Score
2          228
3          308
4          399
5          488
6          540
7          598
8          628
9          708
10        777
11        1,055
Grade Cut Score
2          228
3          308
4          399
5          488
6          540
7          598
8          628
9          708
10        777
11        1,055
Grade Cut Score
2          228
3          308
4          399
5          488
6          540
7          598
8          628
9          708
10        777
11        1,055

Disaggregated Reliability

Type of Reliability Age or Grade n (range) Coefficient SEM
Range Median
Generic (White) 1-5 114,297 0.87-0.91 0.87 50
Generic (Black) 1-5 48,718 0.89-0.89 0.89 42
Generic (Hispanic) 1-5 67,456 0.89-0.90 0.89 41
Generic (White) 6-12 36,915 0.88-0.94 0.90 90
Generic (Black) 6-12 15,632 0.90-0.94 0.91 65
Generic (Hispanic) 6-12 24,628 0.91-0.94 0.92 61

Disaggregated Validity

Type of Validity Age or Grade Test or Criterion n (range) Coefficient
Range Median
Predictive (White) 2-6 SAT9 35-287 0.69-0.75 0.72
Predictive (Hispanic) 2-6 SAT9 7-76 0.55-0.74 0.675