The Best and Worst Performing School Districts in Massachusetts

The Massachusetts Education Assessment Model was developed by economists at the Beacon Hill Institute for the purpose of permitting policy makers to determine how well schools perform on MCAS tests, given such important factors as socioeconomic characteristics, past test performance and changes in spending per student and in class size [1]  

The model makes it possible to determine how well schools are doing, given that, while factors such as these are important determinants of performance, they are nevertheless beyond the control of schools themselves.  Educators can use results to identify schools that outperform the model and to observe teaching and administrative methods employed by those schools.  Because the model does a good job at predicting school performance, schools that perform substantially better (or worse) than predicted are worth studying for the good (or bad) example they provide.  We created two ratings of school districts based on our findings.  The first, “District Rankings for Achieving Good Performance,” lists school districts according to their ability to exceed the model’s predictions of the fraction of students that score in the “good” (G) category (Advanced or Proficient on MCAS).  Schools with lower numbers, i.e. a rating close to “1,” outperform schools with higher ones.  The closer the district comes to getting a “1” rating, the more the actual fraction of students from that district falling in the “good’ (G) category exceeds that predicted by the model.

Table 1

The 15 Best-Performing Massachusetts School Districts

We see that the Hadley district stands out as the best of the best schools by falling among the top ten for five of the six ratings, the exception being the 4^th grade P rating.  Clinton, Methuen, Stoneham and Tyngsborough were next in performance, falling in the top ten for three out of the six ratings. Table 2 identifies the 12 schools that fell in the bottom ten for at least two of the six ratings and that, by the same measure, registered poor performance.  We see that, by this measure, Narragansett was the worst of the worst, falling in the bottom ten for its results under the G and P ratings for both 4^th and 10^th graders.  Next in order were Gateway and Somerset. 

Table 2

The 12 Worst-Performing Massachusetts School Districts

Department of Education Ratings

Due to the changes mandated by the Education Reform Act of 1993, Massachusetts public high school sophomores will be required, beginning in 2003, to pass the MCAS test as a condition for graduation.  In view of the poor performance shown on past MCAS tests, there is a growing fear that many of these students will not pass and will therefore be denied graduation.  Various groups are calling for the elimination or at least the weakening of the MCAS requirement – a concession that would represent a serious compromise of the principles on which the state has invested some $6 billion in education reform. It thus becomes imperative that Massachusetts school administrators determine as quickly as possible what they can do to improve performance on the MCAS tests. 

To this end, they need to determine which schools are doing a good job and which a poor job of preparing students for the MCAS tests.  They need to learn what the good schools are doing right and what the bad schools are doing wrong. On January 9, 2001, the Massachusetts Department of Education took what it intended to be a step in this direction by issuing its “cornerstone” School Performance Rating Process (SPRP) report.  The report rated Massachusetts public schools for their improvement on MCAS tests over the period 1998 to 2000 according to whether they had (1) exceeded, (2) met, (3) approached or (4) failed to meet DOE expectations for improvement. Under the DOE rating system, schools were subjected to a varying standard, depending on how they performed on the 1998 tests.  The poorer they did on the 1998 tests, the higher the standard of improvement required.    

Schools whose 1998 performance was “very high” had to improve their average MCAS score by 1-3 points, while schools whose 1998 performance was “critically low” had to improve by 5-7 points to meet expectations. Schools identified as failing to meet DOE expectations can receive warnings or “referrals for review.”  School districts found to be “chronically under-performing” can be put in state receivership.  Conversely, schools identified as exceeding DOE expectations become eligible for recognition as “exemplary” schools or role models for others to emulate.  Unfortunately, the DOE rating system is a badly flawed and misleading interpretation of MCAS test results.  The problem lies in the fact that, despite claims of statistical rigor, the DOE ratings amount to nothing more than the application of subjective and arbitrary standards to the data.  Merely saying that a given school “failed” to meet or “exceeded” some predetermined standard for improvement does not in and of itself tell us anything about how good a job that school did teaching its students. The problem lies in the failure by DOE to consider socioeconomic factors and other factors that are  known to enter importantly into the determination of school performance.  Applying similar standards to schools with widely varying socioeconomic characteristics is to load the dice against schools that are disadvantaged by virtue of these characteristics. 

BHI rating is a better indicator

Looking at Table 1 of Best-Performing Schools, we see that BHI’s top rated school district is Hadley. However, the DOE rates Hadley as “failing” at the 4th and 10th grade levels.  Similarly, the DOE rated Chelsea’s 4^th and 10^th grade levels and Oxford and Tyngsborough’s 4^th grade levels as failing, where the BHI model reveals that these schools are in fact exceeding their potential.  This highlights the pitfalls of the DOE method of assessing improvement solely according to MCAS scores and a preconceived standard of performance. Comparing Table 2 of Worst-Performing Schools to the DOE rating again shows some significant discrepancies.  Millis 4^th grade, Hudson 8^th grade and Watertown 8^th and 10^th grades were all labelled as meeting the improvement expectations of the DOE.  But, as shown in Table 2, the BHI model reveals that these schools are not meeting their performance potential at these grade levels. It is important to recognize that BHI’s rating system is intended to show how well or poorly a school performed, given the socioeconomic character of the community it serves and other factors beyond the control of the school’s administrators and teachers. The BHI rating system therefore reflects the quality of teaching and utilization of school resources, not the level of results produced by the school.  Performing well on the BHI model is indicative of exceeding or achieving what can be expected of a district, given socioeconomic factors and the like. 

Schools given a high rating by the BHI model might do poorly on MCAS when their raw scores, unadjusted for these factors, are compared with other schools.  Schools given a low BHI rating might conversely turn out to do well when their raw MCAS scores are compared to other schools. Table 3 lists schools according to their combined English, Mathematics and Science rankings for each grade level in the good (G) category (Advance or Proficient), with schools with lower numbers, i.e. a rank close to 1, outperforming schools with higher ones.  If a school district is ranked close to 1, then that particular district’s actual proportion of students in the good (G) category is substantially higher than that predicted by the model.  We see, for example, that for 4^th graders, the Sutton school district did the best job (with a 1 ranking) of outperforming the model and that the Chesterfield Goshen Regional district did the worst job (with a 215 ranking) of measuring up to what the model predicted. Table 4 provides a second ranking, reflecting a district’s success in reducing the fraction of students doing poorly, i.e. falling in the Poor (P) or Failing category.  The closer to 1 that a district is ranked, the more successful it was in keeping the fraction of students who perform poorly below what the model predicted for that district.  Thus, of all districts, the Everett district did the best job of reducing poor performance for 4^th graders. Finally in Table 5, we list districts alphabetically, providing the G and P rankings for each district. Again, for both categories, the closer the rank is to 1 the better the district performed.

Table 3

District Rankings for Achieving Good Performance

	Grade 4		Grade 8		Grade 10
Rank based on the model*	School District	Rank based on actual scores	School District	Rank based on actual scores	School District	Rank based on actual scores
1	Sutton	53	Nantucket	52	Stoneham	28
2	Clinton	82	Medway	9	Norton	26
3	Eastham	47	Clinton	78	Hadley	43
4	Hadley	27	Wellesley	2	Shrewsbury	21
5	Everett	130	Hamilton Wenham	5	Bourne	90
6	Oxford	83	Dighton Rehoboth	49	Provincetown	149
7	Monson	41	Hadley	60	Grafton	34
8	Lynnfield	8	Hanover	39	Harwich	37
9	Tyngsborough	74	Sandwich	33	Norwell	8
10	Methuen	112	Stoneham	46	Tyngsborough	115
11	Lenox	15	Central Berkshire	42	Gill Montague	130
12	North Brookfield	78	Methuen	127	Westborough	15
13	Southbridge	143	Lee	72	Dennis Yarmouth	84
14	Shrewsbury	25	Tyngsborough	57	North Adams	106
15	Medfield	6	East Longmeadow	55	Amherst-Pelham	10
16	Spencer East Brookfield	108	Milford	106	Hanover	38
17	Holbrook	115	Middleborough	108	Mendon Upton	56
18	Tewksbury	85	North Reading	14	Chelsea	214
19	West Bridgewater	63	Medford	136	Southbridge	143
20	North Attleborough	65	Hingham	19	North Brookfield	65
21	Franklin	28	Norwell	25	Webster	165
22	Southwick Tolland	98	Carver	141	Mansfield	81
23	Mansfield	80	Swampscott	31	Ayer	120
24	Walpole	32	Beverly	54	Hingham	25
25	Southborough	24	Hull	145	Bridgewater Raynham	80
26	Lee	113	Gloucester	140	Northboro-Southboro	5
27	Foxborough	45	Barnstable	79	Malden	158
28	Hatfield	89	Northampton	67	Pittsfield	150
29	Grafton	61	Leominster	146	Needham	14
30	Wachusett Reg.	26	Quincy	110	Sharon	13
31	Lexington	4	Arlington	37	Braintree	68
32	Mendon Upton	17	Greenfield	152	Reading	30
33	Westford	9	Chelsea	189	Nauset	45
34	Cambridge	163	Concord	4	Gloucester	153
35	Springfield	205	New Bedford	188	Belchertown	62
36	Littleton	22	North Attleborough	83	Greenfield	147
37	East Longmeadow	14	Attleboro	153	Westwood	2
38	Holyoke	214	Silver Lake	89	Cohasset	7
39	Norwood	36	Pittsfield	149	South Hadley	112
40	Easton	52	Amesbury	93	Ware	203
41	North Reading	11	Groton Dunstable	22	Sandwich	55
42	Dartmouth	134	Worcester	179	Milford	107
43	Chelsea	212	Amherst-Pelham	32	Lenox	4
44	Wellesley	7	Ralph C Mahar	139	Worcester	194

	Grade 4		Grade 8		Grade 10
Rank based on the model*	School District	Rank based on actual scores	School District	Rank based on actual scores	School District	Rank based on actual scores
45	Worcester	167	Everett	168	Medfield	1
46	Lowell	202	Marshfield	90	East Longmeadow	74
47	Gloucester	123	Norton	80	Wellesley	16
48	Rockland	132	Rockport	43	Ashland	39
49	Newton	5	Newton	8	Lee	78
50	Northbridge	129	Tewksbury	120	Nantucket	101
51	Leominster	154	Belchertown	82	Mohawk Trail	70
52	Woburn	60	Cambridge	133	Silver Lake	94
53	Norfolk	42	Lynnfield	38	Natick	42
54	Carlisle	2	Shrewsbury	51	Dartmouth	148
55	Attleboro	153	Harvard	6	Belmont	9
56	Plymouth	66	Mansfield	87	Hamilton Wenham	33
57	Framingham	69	Nauset	86	Dudley Charlton Regional	97
58	Pittsfield	131	Maynard	81	Dracut	139
59	West Springfield	187	Easton	62	Auburn	59
60	Winthrop	106	Braintree	71	Millbury	71
61	Scituate	37	East Bridgewater	88	Northbridge	111
62	Dighton Rehoboth	92	Fitchburg	184	Everett	201
63	Ayer	120	Longmeadow	20	Amesbury	95
64	Canton	49	Westford	26	Milton	52
65	Braintree	95	Holyoke	194	Masconomet	32
66	Brockton	209	Bedford	18	Adams Cheshire	123
67	Pentucket Regional	62	Grafton	58	Stoughton	126
68	Hopedale	75	Berkley	128	Wayland	3
69	Norwell	29	Springfield	191	Franklin	83
70	Marshfield	43	Uxbridge	122	Medway	44
71	Harwich	99	Ludlow	118	Nashoba	23
72	Westfield	155	Needham	30	Northampton	103
73	Berkshire Hills	100	Carlisle	1	Acton-Boxborough	11
74	Winchester	3	Saugus	112	Duxbury	27
75	Milford	128	Lawrence	193	Palmer	154
76	Provincetown	171	Franklin	76	Groton Dunstable	31
77	Weymouth	107	King Philip	66	Central Berkshire	73
78	Abington	91	Lynn	183	Billerica	87
79	Falmouth	105	Weston	3	Gardner	160
80	Quincy	172	Abington	144	Winchester	20
81	Wilmington	84	Quabbin	97	New Bedford	212
82	Ludlow	156	Adams Cheshire	135	Danvers	131
83	Webster	194	Plymouth	109	Old Rochester	76
84	Arlington	64	Whitman Hanson	104	Waltham	151
85	Carver	169	Foxborough	63	West Springfield	190
86	Greenfield	189	Fairhaven	160	Attleboro	183
87	Barnstable	137	Brockton	187	Lynn	213
88	Harvard	1	Dennis Yarmouth	111	Athol Royalston	163

	Grade 4			Grade 8				Grade 10
Rank based on the model*	School District	Rank based on actual scores			School District	Rank based on actual scores			School District		Rank based on actual scores
89	Dedham	109			Westborough	27			Wilmington		156
90	Blackstone Millville	59			Spencer East Brookfield	96			Pioneer Valley Reg.		118
91	Fall River	207			Boston	186			Marlborough		79
92	Natick	38			Falmouth	116			Boston		211
93	Sharon	19			West Boylston	44			Scituate		41
94	Westwood	31			Ayer	170			Fall River		216
95	Sandwich	72			Gill Montague	130			Southern Berkshire		114
96	Fitchburg	203			Winchester	16			Holbrook		176
97	North Middlesex	94			Westwood	23			Lowell		206
98	Berkley	124			Lexington	7			King Philip		96
99	Acushnet	170			Malden	171			Quincy		164
100	Belmont	18			Avon	156			Newton		18
101	Beverly	93			Reading	28			North Reading		48
102	Central Berkshire	102			Mendon Upton	35			Woburn		105
103	Needham	12			Danvers	92			Chicopee		208
104	Gateway	147			Mohawk Trail	121			Fitchburg		205
105	Swampscott	67			North Adams	181			Marthas Vineyard		92
106	Brookline	23			Chicopee	182			Dedham		116
107	Northampton	116			Bourne	138			Walpole		75
108	Athol Royalston	184			Brookline	13			Norwood		109
109	Waltham	148			Woburn	64			Hampden Wilbraham		77
110	Burlington	76			Ware	174			Bedford		35
111	Boston	216			Blackstone Millville	158			Barnstable		155
112	Billerica	111			Swansea	95			Holyoke		218
113	Andover	33			Harwich	119			Hopkinton		50
114	Lawrence	215			Berlin-Boylston	41			Dighton Rehoboth		89
115	Winchendon	186			Burlington	77			Middleborough		161
116	Fairhaven	178			Rockland	161			Ludlow		179
117	Acton	10			Dover-Sherborn	10			Beverly		136
118	Auburn	68			Athol Royalston	167			Lexington		6
119	Bourne	138			Tantasqua	94			Brookline		24
120	Saugus	126			North Andover	61			Frontier		98
121	Milton	55			Andover	12			North Andover		58
122	Gill Montague	188			Triton	142			Rockport		69
123	Duxbury	30			Acton-Boxborough	24			Revere		209
124	Orange	159			Duxbury	50			Swansea		124
125	Chicopee	204			Sudbury	11			Weymouth		159
126	Somerville	198			Waltham	157			Clinton		167
127	Pioneer Valley Reg.	168			Easthampton	150			Andover		29
128	Millbury	165			Southbridge	173			Triton		146
129	Revere	197			Holliston	40			Framingham		93
130	Hamilton Wenham	21			Southborough	21			Lawrence		219
131	Marlborough	117		Norwood		56	Wachusett Reg.			49
132	Wakefield	88	Pentucket Regional			70	Springfield			220

 

	Grade 4		Grade 8		Grade 10
Rank based on the model*	School District	Rank based on actual scores	School District	Rank based on actual scores	School District	Rank based on actual scores
133	Middleborough	176	Natick	59	Canton	91
134	Boxborough	35	Taunton	178	Agawam	127
135	Belchertown	135	Southwick Tolland	143	Oxford	166
136	Lynn	213	Haverhill	164	Avon	184
137	Danvers	110	Winthrop	100	Hatfield	40
138	Taunton	173	Somerville	169	Tewksbury	137
139	Quabbin	97	Medfield	17	Plymouth	138
140	Dennis Yarmouth	160	Agawam	123	Brockton	215
141	Northborough	20	Somerset	147	Wakefield	72
142	Medford	192	Chelmsford	53	Maynard	102
143	Stoughton	73	Lincoln	34	West Boylston	66
144	Triton	146	Old Rochester	84	Abington	175
145	Hanover	77	Wayland	15	Holliston	61
146	Georgetown	90	Lunenburg	75	Hull	185
147	Peabody	140	Marlborough	117	Georgetown	99
148	Haverhill	199	Berkshire Hills	102	Burlington	85
149	Palmer	180	Stoughton	155	Methuen	198
150	Gardner	195	Shirley	98	Salem	162
151	Westborough	51	Fall River	192	Leominster	181
152	Hudson	104	Northbridge	159	Monson	100
153	West Boylston	44	Weymouth	131	Medford	204
154	Reading	54	Westfield	165	Falmouth	157
155	Medway	86	North Middlesex	85	West Bridgewater	173
156	Dudley Charlton Regional	142	Acushnet	154	Marshfield	119
157	Uxbridge	103	Belmont	29	Dover-Sherborn	12
158	North Adams	201	Hopkinton	36	Freetown-Lakeville	117
159	Concord	16	Wilmington	124	Pentucket Regional	53
160	Leicester	114	Peabody	125	Ralph C Mahar	178
161	Avon	164	West Springfield	166	Chatham	125
162	Ashland	136	Sharon	45	Spencer East Brookfield	129
163	Hopkinton	58	South Hadley	129	Arlington	82
164	Amesbury	151	Walpole	65	Whitman Hanson	134
165	Maynard	158	Westport Community	137	East Bridgewater	145
166	Wareham	179	Lowell	190	Concord-Carlisle	19
167	Malden	191	Southern Berkshire	113	Blackstone Millville	189
168	Groton Dunstable	46	Wachusett Reg.	47	Tantasqua	122
169	Topsfield	48	Dedham	91	Lynnfield	51
170	Chelmsford	70	Ashland	74	Rockland	177
171	Stoneham	119	Scituate	48	Westfield	182
172	Bellingham	122	Dartmouth	148	Easton	110
173	Cohasset	40	Oxford	180	Chelmsford	64
174	New Bedford	206	Dracut	162	Somerville	202
175	Westport Community	133	Palmer	172	Hampshire	57
176	Agawam	127	Billerica	114	Fairhaven	217

 

	Grade 4		Grade 8		Grade 10
Rank based on the model*	School District	Rank based on actual scores	School District	Rank based on actual scores	School District	Rank based on actual scores
177	Hull	125	Salem	176	Haverhill	195
178	Melrose	81	Gardner	175	Easthampton	180
179	Southern Berkshire	144	Freetown-Lakeville	134	Hudson	144
180	Somerset	139	Revere	185	Westport Community	169
181	Dracut	145	Framingham	126	Ashburnham Westminster	121
182	Norton	150	Millis	69	Berlin-Boylston	54
183	Nantucket	183	Wareham	177	Millis	108
184	Hingham	56	Auburn	73	Manchester	47
185	Quaboag Regional	161	Hudson	132	Cambridge	140
186	Rockport	87	Watertown	103	Foxborough	86
187	North Andover	101	Milton	68	Weston	22
188	Sudbury	13	Wakefield	115	Quabbin	128
189	Holliston	96	Ashburnham Westminster	105	North Attleborough	171
190	Whitman Hanson	162	Melrose	99	Berkshire Hills	133
191	Ware	211	Gateway	163	Uxbridge	170
192	Douglas	121	Canton	101	Quaboag Regional	168
193	Wayland	39	Mount Greylock	107	Harvard	17
194	Salem	175	Leicester	151	Peabody	193
195	Hawlemont	166			Longmeadow	46
196	Watertown	181			Southwick Tolland	199
197	Randolph	193			North Middlesex	88
198	Lincoln	50			Sutton	152
199	Bedford	57			Hopedale	135
200	Ashburnham Westminster	141			Mount Greylock	60
201	Lunenburg	157			Douglas	172
202	Longmeadow	79			Saugus	197
203	Weston	34			Taunton	210
204	Swansea	182			Winchendon	192
205	Essex	174			Wareham	186
206	Chatham	149			Melrose	113
207	Mashpee	185