Legislature(1999 - 2000)
02/03/2000 03:40 PM House FIN
| Audio | Topic |
|---|
* first hearing in first committee of referral
+ teleconferenced
= bill was previously heard/scheduled
+ teleconferenced
= bill was previously heard/scheduled
GENERAL SUBJECT(S): High School Graduation Qualifying Exit
Exam
The following overview was taken in log note format. Tapes
and handouts will be on file with the House Finance
Committee through the 21st Legislative Session, contact 465-
2156. After the 21st Legislative Session they will be
available through the Legislative Library at 465-3808.
Time Meeting Convened: 3:40 p.m.
Tape(s): HFC Tape 00-24, Side 1
HFC Tape 00-24, Side 2
PRESENT: HOUSE FINANCE
COMMITTEE MEMBERS
X
Representative G. Davis
X
Co-Chair Therriault
Absent
Representative Foster
X
Co-Chair Mulder
Absent
Representative Grussendorf
X
Vice Chair Bunde
Absent
Representative Moses
Absent
Representative Austerman
Absent
Representative Phillips
X
Representative J. Davies
X
Representative Williams
PRESENT: HESS COMMITTEE
MEMBERS
X
Representative Dyson
X
Representative Whitaker
X
Representative Green
Absent
Representative Morgan
X
Representative Brice
X
Representative Kemplen
X
Representative Coghill
ALSO PRESENT: Dr. Nicholas Stayrook, Director, Program Planning and
Evaluation, Fairbanks North Star Borough School District; Richard
Cross, Commissioner, Department of Education and Early Development
LOG
SPEAKER
DISCUSSION
TAPE HFC 00 - 24
SIDE 1
29
Co-Chair Mulder
Convened the meeting at 3:40 p.m. and
noted that questions regarding the exit
exam were raised during the 1/19/00
meeting of the House Finance Committee.
42
RICHARD CROSS,
COMMISSIONER,
DEPARTMENT OF
EDUCATION AND EARLY
DEVELOPMENT
Introduced Dr. Stayrook.
65
DR. NICHOLAS
STAYROOK, DIRECTOR,
PROGRAM PLANNING AND
EVALUATION,
FAIRBANKS NORTH STAR
BOROUGH SCHOOL
DISTRICT
Provided members with a copy of AS
14.03.075 and a handout, Setting the
Passing Score on the High School
Graduation Qualifying Exam. He noted that
legislation relating to the exam was
enacted in 1987.
115
Dr. Stayrook
Observed that students must pass a
competency test in reading, writing, and
math. Students that fail the exam may be
reexamined up to 3 years after they are
no longer in attendance.
121
Dr. Stayrook
Observed that there are three major
issues: What should be on the test; How
will the students be assessed; and how
will the passing point be set.
Emphasized that setting the passing score
is critical
159
Dr. Stayrook
He observed that Alaskans passed the law,
developed the standards and selected the
tests. Alaskans will also set the passing
score.
167
Representative
Williams
How do the questions reflect Alaska's
cultural differences?
190
Dr. Stayrook
Test questions were reviewed by Alaskans
to determine if standards are being met
by the questions. The questions are not
unique to Alaska. The questions were also
reviewed by various cultural groups,
which looked to see that they were
appropriate to Alaska. Questions that
could cause misunderstandings in the
state of Alaska were excluded.
234
Representative Brice
Noted that a national firm has reviewed
the test. He observed that "English" was
not used in the statute.
248
Dr. Stayrook
Explained that the "reading" and
"writing" were used to narrow the scope.
Maintained that "English" carried a
broader interpretation.
269
Dr. Stayrook
Discussed page 3 of the handout.
Performance standards were written in
1998 and form the basis for the tests.
277
Dr. Stayrook
CTB/McGraw-Hill was selected as the
contractor. He noted that CTB/McGraw-Hill
has previous experience with exit exams.
280
Dr. Stayrook
Tests were reviewed by Alaskans to assure
that the content was matched to
standards, the questions were culturally
appropriate to Alaska and that the
technical quality was adequate.
285
Dr. Stayrook
Noted that a statewide field test was
done in March 1999. Discussed the field
test. The field test was reviewed to
identify questions with the highest
quality and the least bias and to assure
adequate coverage of standards.
302
Dr. Stayrook
Noted that field tests were not scored.
The field test helped to discern test
time. The average time needed for the
test was 2 hours. The field test found
that the tests were too long at the third
grade level.
320
Dr. Stayrook
CTB/McGraw-Hill looked at other states.
It was determined that it would be a
paper and pencil test with a collection
of questions. There are two formats;
multiple-choice questions (about 2/3rds)
and open-ended questions (about 1/3 rd).
He noted that human beings are needed to
score open-ended questions. These are
used in the writing tests. The tests are
untimed.
350
Co-Chair Mulder
Noted that computations will be shown. He
questioned if a value will be given to
the demonstration of computations
357
Dr. Stayrook
Observed that if an answer is wrong that
partial credit can still be given for
correctly setting up the question.
368
Co-Chair Therriault
Asked what is looked for in the writing
evaluation.
370
Dr. Stayrook
Explained that all aspects of their
writing will be reviewed. Topic sentence,
well-formed paragraphs, and the whole
ability to write will be reviewed.
Students will have to fix spelling
mistakes
380
Dr. Stayrook
Tests are going to be given under
standardized conditions, on the same day.
388
Representative Dyson
The tests will be altered after each time
they are administered.
390
Dr. Stayrook
Each time a test is given the majority of
the questions used will be new; a few
questions will be retained for
comparisons. The state contracted with
CTB/McGraw-Hill for three forms. In 2001
new tests will have to be developed.
400
Dr. Stayrook
Tests are untimed. Scoring will be
simple. Students will be given 1 point
for every multiple-choice question that
is answered correctly. Open-ended
questions will be graded and students can
earn from 0-6 points on each open-ended
question. The total score is the sum of
all scores. Wrong answers do not result
in a loss of points.
412
Dr. Stayrook
Observed that a range of scores from high
to low will be used to determine the
passing point.
416
Dr. Stayrook
Discussed the use of "bookmaking" to set
the cut point. He emphasized that the
passing score could be set today. He
maintained that the test must look toward
the future; what is the desired level of
competency? Pointed out that an
independent standard is being created.
Discussed different methods of assessing
the cut point.
435
Dr. Stayrook
Noted that percentage scoring does not
take into consideration the difficulty of
the test. He stressed that the level of
difficulty needs to be addressed. Noted
that the passage rate could be
manipulated with percentage scoring.
448
Dr. Stayrook
Discussed the Angoff method developed in
1971.
453
Dr. Stayrook
The bookmark method was developed in
1995. He pointed out that other states
have had good results with bookmarking.
464
Dr. Stayrook
Discussed the procedure that will be used
to set the bookmark. Twenty-one
participants will be needed for each
content area. They will have no knowledge
of how well students scored. They will be
divided into 3 groups. The passing score
will be completely independent of the
today's students' level of competency.
476
Representative
Williams
Asked if the 21 participants used to
bookmark the test will change each year
480
Dr. Stayrook
No. Explained that it is not necessary to
redo the passing score unless the test is
changed. The passing score will apply to
every version.
490
Representative Green
Would it be possible for students to know
the questions?
500
Dr. Stayrook
The test is not available to teachers
prior to the test. Teachers must sign
affidavits for security purposes. Action
will be taken for cheating.
510
Vice Chair Bunde
Maintained that in teaching to the
subject of the test the standards would
be covered.
515
Dr. Stayrook
Noted that school districts are required
to adopt regulations to incorporate
standards. Emphasized the importance of
teaching to the test in order to align
the curriculum.
530
Vice Chair Bunde
What happens to students that are caught
cheating?
531
Dr. Stayrook
Answered that students caught cheating
would be dismissed from that day's test.
They would have to take the test at the
next administration. Testing intervals
are about 6 months.
537
Representative Brice
Who are the 21 participants that will do
the bookmarking?
549
Dr. Stayrook
Discussed the criteria for persons
participating in bookmarking. Observed
that 2/3 thirds are expected to be
teachers that are experts in their area.
551
Representative Green
Noted that other states have found that
tests were too tough and have lowered
their standards.
560
Dr. Stayrook
Noted that participants will make a
judgement as they work through the
questions. The judgement is should a high
school graduate be expected to have this
knowledge. The questions will have
already been reviewed before this point.
570
Representative Brice
Questioned if all the questions reflect
standards, should they not be correctly
answered.
584
Dr. Stayrook
Noted that questions will vary in their
difficulty. The bookmark method's
innovation is determining the difficulty
of the question through the ordered item
booklet.
*TAPE CHANGE, HFC
00-24, SIDE 2
(*Note tape numbers run backwards.)
595
Dr. Stayrook
Discussed the ordered item booklet shown
on page 8 of the handout. This shows the
level of difficulty per question.
585
Vice Chair Bunde
Expressed concern that the time between
the test and results can be stressful for
students. How can the student's comfort
be assured?
577
Dr. Stayrook
Noted that he would like to start testing
in the summer. Pointed out that the
passing score is critical. The process is
delayed until after the first
administration. The scoring will take 2
months for the ordered booklet. The total
process will take longer (Sept). In the
future results will take 2 months.
Students would have 4 months for
counseling before the next test is
administered.
555
Representative J.
Davies
Clarified that there will be three
separate sections.
549
Dr. Stayrook
Noted that a different group will score
each area.
544
Dr. Stayrook
Discussed ordering of the tests. The
place that the bookmark is put on the
ordered item booklet determines the cut
score.
531
Dr. Stayrook
Discussed the 3-day workshop that the
bookmarking participants will attend.
Groups will be divided into three groups.
Participants will study each item,
scoring guides, and the standards. They
will set bookmarks three different times.
The groups will come back together. Each
round comes closer to a single cut point.
This way a consensus is built.
507
Representative J.
Davies
Questioned what would happen if all of
the questions were difficult.
502
Dr. Stayrook
Noted that the level of difficulty was
known at the time the questions were
chosen. Easy and hard questions were
selected for each standard.
490
Dr. Stayrook
Pointed out that participants don't have
to guess the difficulty of the questions.
Maintained that bookmarking assures the
elimination of inconsistencies.
473
Dr. Stayrook
Noted that bookmarking is considered the
best method for establishing a passing
score because it has withstood legal
challenges. States that have used
traditional methods are requesting
bookmarking.
465
Vice Chair Bunde
Noted that students that do not pass are
eligible for a certificate of attendance.
Asked if it would be more appropriate to
be a certificate of achievement.
450
Commissioner Cross
Noted that there is a discussion
regarding recognition of achievement. Did
not know how much flexibility the
department would have under the law.
Acknowledged the need to recognize
achievements even if students do not meet
standards.
438
Dr. Stayrook
Observed that there is interest in
providing some type of award for merit to
students that have persevered through the
four years, but were unable to pass the
exam. He will be working with department
on this issue.
421
Commissioner Cross
In response to a question by Vice Chair
Bunde, Commissioner Cross noted that a
high school diploma could not be given if
a student does not pass the exam, but
allowed that recognition could be given,
as long as the certificate does not say
it is a diploma.
390
Representative
Kemplen
Referred to the Ordered Item Booklet. He
asked what percentage of students is
expected to pass the test.
388
Dr. Stayrook
Explained that the results are
independent of a percentage. The level of
competency is being set not the
percentage of students that pass. Cut
scores will apply for future versions
until the nature of the test is changed.
351
Representative
Kemplen
He asked why it was necessary to have
more difficult questions on the exam.
346
Dr. Stayrook
Answered that while it was possible to
excel in one area such as reading, other
areas could be weak. By having high
standards in one area, a student could
show higher skills and score higher
overall.
328
Commissioner Cross
Noted that some students may find
questions below the line harder than
those that are above the line may.
Emphasized that student differences must
be acknowledged.
300
Representative
Kemplen
Questioned if a student that passed 2
portions of the exam and failed one could
pass if they achieved high scores on the
two sections that were passed.
297
Dr. Stayrook
No, students must pass all three sections
of the test.
294
Representative Green
Questioned if the bookmark would be
lowered if only 1 out of 7 students pass.
284
Dr. Stayrook
He spoke against changing the bookmark.
He noted that the competency level is
being set. He felt that they must find
ways of assuring education focuses on the
standards. Pointed out that remedial
courses have not been designed yet. This
is a high school graduation exam. He
noted that 10th graders are not expected
to pass. This allows students to have
numerous opportunities to focus on their
areas of need. He concluded that the
standard should not be lowered.
256
Commissioner Cross
Stressed that the test would be
reevaluated if they felt the bookmark
was wrongly placed.
248
Green
Questioned if a low percentage of passing
students would indicate that there is a
lot of work to do or that there is
something wrong with the test.
234
Commissioner Cross
It could be either. Experts would have to
be consulted to determine if the test was
at fault.
225
Representative Brice
What accommodations will be made for
students that cannot pass the test?
218
Dr. Stayrook
Noted that the department has produced
guidelines and provided example
questions. He noted that an Individual
Education Plan for special education
students would be used.
192
Representative G.
Davis
How will tests fit with General
Educational Development Diplomas (GED)?
171
Dr. Stayrook
Pointed out that the GED is an
independent national program. The
opportunity to obtain a GED will remain.
158
Vice Chair Bunde
Noted that officials indicated that the
GED is a harder test.
142
Dr. Stayrook
In response to a question by
Representative J. Davies, Dr. Stayrook
explained that the contractor has
national experience.
128
Representative Dyson
ADJOURNMENT
The meeting was adjourned at 5:10 p.m.
JOINT HOUSE FINANCE AND HESS COMMITTEES
LOG NOTES
February 3,2000
House Finance Committee 8 02/03/00
| Document Name | Date/Time | Subjects |
|---|