|
The
LSAT Scoring Scale Explained
Just what you've
been waiting for: a detailed explanation of the LSAT scoring scale.
Well, what you don't know can hurt you, so we'll try to make this
as painless as possible. Each administered LSAT contains approximately
101 questions, and each LSAT score is based on the total number
of questions a test taker correctly answers, a total commonly known
as the raw score. After arriving at the raw score, a unique Score
Conversion Chart is used for each LSAT to convert the raw score
into a scaled LSAT score. Since June 1991, the LSAT has utilized
a 120 to 180 scoring scale, with 120 being the lowest possible score
and 180 being the highest possible score.
Although the
number of questions per test has remained relatively constant over
the last eight years, the logical difficulty of each test has varied.
This is not surprising since the test is made by humans and there
is no precise way to completely predetermine logical difficulty.
To account for these variances in test "toughness," the
test makers adjust the Scoring Conversion Chart for each LSAT in
order to make similar LSAT scores from different tests mean the
same thing. For example, the LSAT given in June may be logically
more difficult than the LSAT given in December, but by making the
June LSAT scale "looser" than the December scale, a 160
on each test would represent the same level of performance. This
scale adjustment, known as equating, is extremely important to law
school admissions offices around the country. Imagine the difficulties
that would be posed by unequated tests: admissions officers would
have to not only examine individual LSAT scores, but also take into
account which LSAT each score came from. This would present an information
nightmare.
The equating
process can produce some startling differences between the Scoring
Conversion Charts for different LSATs. Compare selected scores from
the charts for the following two tests:
| June
2002 LSAT |
 |
October
1997 LSAT |
| Scaled
Score |
Lowest
Raw Score |
Scaled
Score |
Lowest
Raw Score |
180
175
170
165
160
155
150
145
140
135
130
125 |
100 (-1)
96 (-5)
91 (-10)
84 (-17)
76 (-25)
67 (-34)
57 (-44)
48 (-53)
40 (-61)
32 (-69)
25 (-76)
-* |
180
175
170
165
160
155
150
145
140
135
130
125 |
96 (-4)
90 (-10)
84 (-16)
78 (-22)
71 (-29)
63 (-37)
55 (-45)
48 (-52)
40 (-60)
33 (-67)
26 (-74)
21 (-79) |
*There is no
raw score that will produce this scaled score for this test form.
The June 2002
LSAT contained 101 questions whereas the October 1997 LSAT contained
100 questions (the test originally included 101 questions, but one
question that did not conform to LSAT quality standards was removed).
The "Lowest Raw Score" column indicates the minimum number
of correct questions necessary to produce the corresponding scaled
score. The number in parentheses is the corresponding number of
missed answers which produces the score in question.
The difference
between the conversion charts presented here is most telling at
the higher scaled scores. For example, in order to achieve a 170
on the June 2002 LSAT, the test taker was required to correctly
answer 91 of the 101 questions. On the other hand, a test taker
attempting to achieve the same 170 on the October 1997 LSAT needed
to correctly answer only 84 of 100 questions. This difference in
tests is supposedly the result of differences in the overall logical
difficulty of each exam. Of further interest is the fact that as
each scale approaches 150 and below, they become roughly the same.
Implicit in this middle- and lower-score similarity is that these
tests only differed at the upper levels of logical difficulty-that
is, the level of difficulty of the hardest questions. The easy and
mid-level difficulty questions on each test were apparently about
the same, whereas the October 1997 LSAT apparently had more truly
difficult questions or the questions themselves were inherently
harder. Of course, it must be noted that differences in test difficulty
and the order of questions produces a physical and psychological
effect on test takers that cannot be measured without complete test
statistics (Law Services does not release the exact statistical
breakdown of student performance on each individual question).
BACK
TO THE TOP
While examining
the LSAT scale it is important not to lose sight of what the scores
actually represent. The 120 to 180 test scale contains 61 different
possible scores. Each score places a student in a certain relative
position compared to other test takers. These relative positions
are represented through a percentile that correlates to each score.
The percentile indicates where the test taker falls in the overall
pool of test takers. For example, a score of 160 represents the
83rd percentile, meaning a student with a score of 160 scored better
than 83 percent of the people who have taken the test in the last
three years. The percentile is critical since it is a true indicator
of your positioning relative to other test takers, and thus law
school applicants. Consider the following table:
| 2001-2002
LSAT Percentile Table
(June 1998 - February 2001) |
| 180
179
178
177
176
175
174
173
172
171
170
169
168
167
166
165
164
163
162
161
160
159
158
157
156
155
154
153
152
151
150
149
148
147
146
145
144
143
142
141
140
139
138
137
136
135
134
133
132
131
130
129
128
127
126
125
124
123
122
121
120
|
 |
99.98
%
99.96 %
99.91 %
99.86 %
99.78 %
99.67 %
99.53 %
99.32 %
99.07 %
98.69 %
98.21 %
97.55 %
97.03 %
95.92 %
94.84 %
93.49 %
91.91 %
90.00 %
88.18 %
85.74 %
83.07 %
80.60 %
77.43 %
74.18 %
70.74 %
67.14 %
63.25 %
59.29 %
55.22 %
51.49 %
47.26 %
43.20 %
39.33 %
35.60 %
32.17 %
28.40 %
25.46 %
22.19 %
19.59 %
16.92 %
14.56 %
12.44 %
10.63 %
9.01 %
7.54 %
6.29 %
5.39 %
4.25 %
3.49 %
2.93 %
2.38 %
1.82 %
1.48 %
1.19 %
0.93 %
0.77 %
0.60 %
0.47 %
0.37 %
0.34 %
0.00 %
|
The percentile
for each score is calculated by using test data from the last three
years, not from any individual LSAT (note that the percentile table
above is for 2001-2002, yet it only includes LSAT information up
to the February 2001 LSAT). Using the three-year pool of information
provides Law Services with a stable and accurate percentile for
each score. Otherwise percentiles could vary significantly from
test to test as different groups of test takers performed better
or worse. Historical analysis shows that percentiles do change from
year to year, but only by minute amounts. Since percentiles are
not calculated on a per test basis, each test taker does not compete
against the other students taking the same LSAT. Instead, each test
taker competes against the students from the three previous years.
In fact, because of question pre-testing through the use of experimental
sections, the conversion chart for each LSAT is supposedly set before
the test is administered. Only minor adjustments are then made to
normalize the test.
BACK
TO THE TOP
The normalization
yields a rough bell curve. The number of test takers in the 120s
and 170s is very low, and most test takers are bunched in the middle,
comprising the "top" of the bell. In fact, approximately
40% of all test takers score between 145 and 155 inclusive, and
about 70% of all test takers score between 140 and 160 inclusive.
These facts provide some explanation for the Score Conversion Charts
examined earlier. For example, on most tests, to move from 170 to
171 requires getting just one additional question correct, whereas
to move from 150 to 151 requires getting at least two and possibly
three more questions correct. But this is justified since moving
from 170 to 171 only moves the test taker up 0.48 percentile points
(less than one-half of one percent), whereas moving from 150 to
151 moves the test taker up 4.23 percentile points. This extreme
difference in percentile movement makes sense since there are obviously
more test takers in the 150-151 range than there are in the 170-171
range. The percentile for 170 is also interesting because it indicates
the true difficulty of the LSAT in general. Consider the October
1997 LSAT again. To achieve a score of 170 requires a test taker
to correctly answer only 84 out of 100 questions. At most colleges
84 out of 100 would probably yield a B- grade. Yet a 170 on the
LSAT represents 98th percentile, putting you into the top 2% of
all examinees, which would generally conform to a high A or even
an A+ on most college grading scales.
Finally, beginning
with the June 1997 LSAT, each Law Services report now includes a
"score band" of roughly plus-three and minus-three points
with each LSAT score. For example, a test taker with the score of
160 would receive a score band of 157 to 163. The intent of score
banding is to shift attention away from the exact numbers and instead
focus on the general range a test taker falls into. Since the standard
error of measurement for the LSAT is approximately 2.7 points, the
use of score bands is an attempt to more fairly represent the performance
of LSAT examinees.
Ultimately,
this discussion of the LSAT scale does not change the inherent and
obvious truth of the test: to score well you must answer questions
correctly. However, understanding how LSAT conversion charts differ
is important for assessing your score in the week after the test-that
crucial period when you have the option to cancel. And understanding
the LSAT percentile table allows you to more accurately assess your
true position in the LSAT pool, and thus to some degree your position
in the law school applicant pool. To learn more about the LSAT scoring
scale, visit one of the LSAC-member law schools where summaries
of LSAT validity and other research can be found in the library,
or contact us for more information.
BACK
TO THE TOP
|