Mathematically Correct
August 2, 1997
The Department of Defense Dependents Schools (DoDDS) runs schools for the children of DoD overseas employees. Total enrollment in 95-96 was 81,379.
In the 95-96 school year, DoDDS introduced MathLand in grades K-5 and Glencoe Interactive in Grades 6-8.
Data on performance of DoDDS students on the Comprehensive Test of Basic Skills (CTBS) is available on line [see notes below], making it possible to detect the impact of these programs on math test scores.
| Ethnic Group |
Percentile Change |
| White | - 3 |
| Black | - 4 |
| Hispanic | - 5 |
| Asian | - 2 |
| Ethnic Group |
Percentile Change |
| White | - 3 |
| Black | - 1 |
| Hispanic | - 11 |
| Asian | + 7 |
Thus, with the possible exception of grade 7 Asians, every reported ethnic group declines with MathLand and Glencoe Interactive.
From these values there is no support for the idea that MathLand increases student performance in basic skills, nor is there support for the idea that MathLand will decrease the achievement gap in racial/ethnic minority groups, which was a major goal as indicated in the DoDDS report.
Similarly, there is no evidence, (except perhaps for Asians) that Glencoe Interactive increases student performance in basic skills, nor for the idea that Glencoe Interactive will will decrease the achievement gap.
In fact, it appears that both of these new programs have resulted in a decline in achievement in mathematics.
While these changes in percentile ranks may appear to be small, it is actually quite remarkable that these consistent declines are noted in such a large sample. Were declines of this magnitude to continue year after year in a cumulative manner, children taught with MathLand and Glencoe Interactive would wind up with a seriously deficient mathematics education, even by American standards.
Notes:
The DoDDS summary information can be found on line. Users can download the .PDF file.
It is possible from these data to determine if there has been a change in student performance in grades 3 and 7 from 94/95 (the last year before MathLand and Glencoe Interactive) and 95/96 (the first year of these programs). This is somewhat complicated by the way the data are presented. First, all of the two years' scores represent different student populations separated by a year of age, not pre-test data on the relative ability of the students as they entered the grades in question. Second, the data are all presented in terms of specific, identifiable ethnic groups (white, black, hispanic, asian) leaving out bi/multiracial, unknown and Native American. These groups represent about 3/16 of the total population. Third, actual percentile numbers for comparison are only presented in terms of differences from the DoDDS median at the end of the 93/94 school year. Thus one must subtract the 94/95 difference score from the 95/96 difference score to obtain the change in performance from 94/95 to 95/96 for each ethnic group.
The increase noted in the Asian subgroup of 7th graders does not match the accompanying graph which shows a drop for Asians as well as for all other ethnic groups, and thus this increase may be in error.