Keystone Exams Winter Administration Training 2016-17

Hello everyone and welcome to the Keystone
Exams Assessment Coordinator Training for the winter administration 2016-17. My name is Charlie Wayne and I’ll be doing
the presentation today. If you have any accountability questions,
please email the RA account listed on the screen: [email protected] they can answer any
accountability questions you might have. Our agenda for today is, we’ll do an overview,
we’ll talk very briefly about policy, lots about the Keystone exams, planning, participating
and administering the Keystones. We’ll talk about monitoring, we’ll talk about
security and we’ll talk a little bit about contact information as well. All policy decisions come from PDE. DRC doesn’t make policy but DRC is our primary
testing vendor so they do a lot of work for us. They’ll deliver the paper materials, they’re
in charge of E-direct, the insight, the online testing engine and their customer service
number. Customer service phone number is 1-800-451-7849
and their email address for us is the longest email address in the world: [email protected]
There are different reasons in terms of policy and requirements for students to take the
Keystone exams. What is the federal requirement? The federal requirements say that students
must take a high school exam, for us that’s the Keystone exam. Students have to take that at least once prior
to or during the spring administration of their junior year, so in grade 11. They have to have completed it by the time
grade 11 ends for that student. If a student takes the Keystone exam and doesn’t
score at the proficient level or above they may retake that exam. For students who are graduating prior to 2019,
if that student is not proficient on the Keystone exam they must be offered supplemental instruction. That student doesn’t have to accept that supplemental
instruction but it must be offered and they make retake the Keystone exam without accepting
that supplemental instruction. However, students graduating in 2019 and beyond
supplemental instruction is required. They must be offered the supplemental instruction
and they must participate in supplemental instruction before they can retake the Keystone
exam. The 2018-19 school year is when the regulations
say Keystone exams will be a graduation requirement prior to that its not a graduation requirement. Several things we’re going to talk about here,
lots of print materials handbook for assessment coordinators it’s a very valuable document. You’re going to use that a lot or at least
the school assessment coordinators will use that a lot. We redid the handbook for assessment coordinators
or the HAC and we redid the directions for administration this year. I’m sure there’s still going to be issues
with some parts of them but I think that they are much better documents than they were before. We have read-aloud and scribing guidelines
for the assessment, directions for administration, also called the DFA. Keystone exam test definitions, we have scoring
guidelines, accommodations guidelines are very good, we’ll talk more about them later. We have a document for online testing, we
have a calculator policy and we’ll talk about calendars. So in the handbook for assessment coordinators,
some of the things that we can use in there that are going to help us prepare for the
exams, there’s things in there about scheduling, we have a document in an appendix
to help you notify parents or guardians of the assessment, you can just use that document,
adapt it to your own personal needs, your own district needs. We’ll help you prepare the students for the
assessment. We’ll talk about preparing the classroom for
the assessment. We’ll talk about if students needs extra time
during the assessment, what should we do. Scheduling make up exams there’s a confidentiality
agreement in there. Information for the parents, its kind of like
an FAQ, there’s a code of conduct for test takers in there, that’s in the appendix and
the calculator policy is in the appendix. Also in the handbook for assessment coordinators
or the HAC, there’s a little bit about accommodations but primarily refer to the accommodations
guidelines. A little bit about ELL’s, then we’ll talk
about non-assessed students, what do you do if a student does not take the test, who has
to take the test. Some other stuff in there about withdrawals,
home education, things like that. So participation with accommodations, here
are some of the accommodations that are available. You can see the list, I won’t read the list
to you, there is a 2017 accommodations guideline that’s posted on the PDE website and it’s
on E-direct. Again, that’s a very good and useful document. At the time of this recording, the accommodations
webinar hasn’t been done yet. That’s scheduled for next week, it will probably
be posted about a week after this presentation is posted. You will get to hear a live presentation if
you choose, if you choose not to do it live, then it will be posted on our website the
PowerPoint and the recorded webinar will be there. Please note that scribing for the keystone
literature exam does not require submission of the scribing unique accommodations form
as it does for the PSSA/ELA test. This is because the Keystone literature constructed
response item does not measure writing skills. The PSSA/ELA writing prompt and the TDA response
do measure writing skills. If a student is in the country for their first
year, officially enrolled in the US school in their first year they do not have to participate
in the Keystone literature exam. They may but they don’t have to and if they
do participate their scores wont count for accountability purposes. Either way, if they don’t participate, if
they do participate DRC receives a book with their responses, if they don’t participate
an unused booklet with the students label must still be returned to DRC. Word to word translation dictionaries, no
definitions just word to word translation dictionaries, for algebra and biology only. We cant use them for literature. And we can have interpreters or sight translators
for algebra and biology again not for literature. For algebra and biology there is also a Spanish
version for the test available. And note that for ELL’s or the current term
is EEL, English learners, they must participate in the algebra and the biology. I want to point out that all these accommodations
are voluntary, we can’t force accommodations on a student. Still under preparation, here are some of
the things we are going to talk about next: training, roles and responsibilities, that’s
a lot of slides, and test security is a lot of slides. Under training we have the district assessment
coordinators or the DAC, school assessment coordinator or SAC, test administrator or
TA and proctor. All test administrators and all proctors must
take and complete the Pennsylvania State test administration training or PSTAT. Everyone administrating or proctoring must complete that. SACs and DACs do not have to take it but its
recommended so you know what content is there and you know what you’re test administrators
are seeing Also we’re working on what is essentially a PSTAT for SACs and DACs. If you have any issues with the PSTAT training,
contact DRC their phone number is 844-734-1422, their email for the PSTAT is: [email protected]
So for the district assessment coordinators for the DAC, here’s some of your responsibilities. You must attend the required PDE training,
viewing this webinar/ listening to this webinar is attending the training. Anything that needs to be updated in E-direct
its your responsibility to do it for the district. Review the DFAs, be familiar with them, you
may not be administering the test but you should know what the test administrators have
to do. be very familiar with the handbook for assessment
coordinators. And if you’re testing online, be familiar
with the online user guides. Know what the district policies are for home-schooled
students. If a home-school student comes to you and
asks to take the PSSA or the Keystone at your school, what do you do? Also same issue with cyber-school students. If a cyber-school student in your district
requests to take the Keystone at your school or at your district what do you do? You also have to train the school assessment
coordinators. Often times, the SAC will accompany the DAC
on this webinar or on this training, that’s great, but you still need to train the SAC
because there are district specific things that happen. One example is the testing schedule. Not every district has the same testing schedule. We at PDE don’t set a testing schedule, we
give you a testing window. So you have to coordinate with the school
assessment coordinator and train the school assessment coordinator on specific things. If we become the monitor one of the things
we are going to ask for is the sign-in sheet and the agenda for that training. Even if you do it informally, even of you
have, lets say two SACs and you sit down in you office for a half hour or an hour and discuss what your going to do
I understand that that happens and that’s a nice way to do things However we still need a sign in sheet and agenda, we need to know what you covered and who was there for that training If your district is a ship to district, not ship to school Then you have to receive and inventory all of the tests You also then have to distribute those tests to the test coordinators When testing is done you have to collect, inventory, package and return All of those tests to DRC If your district is a ship to school district the SAC has responsibilities or inventory the test packaging and returning the tests but you still have to over see all of that When testing is done you have to sign the Keystone Exam Security Certification Make sure testing is done when you sign that and report any suspected testing violations to PDE as soon as they occur we are going to talk a little bit more about that a little bit later For the SAC the SAC has to be trained by the DAC Review all the DFA’s, be familiar with them, the SACis the expert in the school so the SAC really needs to know pretty much everything That includes the DFA’s and the HAC be very familiar with what’s in the handbook for assessment coordinators For this brief period of time that’s probably going to be their bible And be familiar with the online user guide if your testing online and update e-direct for test administrators The SAC also has to trainthe test administrators and proctors Anybody who is a test administrator or a proctor,
anybody who’s involved at that level with testing needs to be trained. Remember that
substitute teachers may be present in the testing room but they cant be TAs or proctors.
They may also be in the hallway watching the hallway but they just can’t be TAs and proctors.
If they’re in the testing room we suggest that they are not in the same room as their
cooperating teacher put them in a different testing room. And all test administrators
and proctors must be employed by the district. No volunteers are allowed to be TAs or proctors.
Also the SAC creates a testing schedule. Sometimes the SAC isn’t the principle and the principle
and the SAC can work together to create a testing schedule but ultimately a testing
schedule needs to be created should be created by the SAC. Make sure to schedule small group
settings and extended time. Make sure staff is assigned to supervise breaks and movement
to other settings, now the breaks could be for students or the breaks could be for other
TAs. TAs have to go to the bathroom as well, so make sure there are people available trained
and assigned to supervise breaks and movement. Remember any time students move from one location
to another during testing they need to be escorted they can’t move alone and they can’t
carry their own testing materials. be prepared if parents want to view the test. This has
to be done with the paper and pencil test, so if you’re testing online, contact DRC,
they’ll get a paper booklet to you pretty quickly. Also for being prepared for parental
requests, there has to be a school/district procedure in place to honor parental requests
to view the test. Now there’s stuff in our handbooks about that but you can’t just take
what’s in the handbook and use that, it has to be specific to your school and district.
And if we’re testing online the SAC has to grade the test sessions in Edirect. The SAC
is also responsible for making sure there’s nothing prohibited on the classroom or hallway
walls. Also note that that’s not limited to classrooms and hallways. Any hall where testing
students will be in the area has to be cleared or covered. That includes bathrooms, typically
there aren’t things handing on bathroom walls, but just to make sure anywhere students go
during testing there could be no prohibited materials uncovered on the walls. If it’s
a ship to district, then the SAC has to receive the tests from the DAC, if its a ship to school
the receive the test directly from DRC. Ship to district they receive them from the DAC,
ship to school from DRC. As soon as they get the tests they have to inventory them, if
they’re missing anything or if they just need additional materials contact DRC and order
those additional materials. The SAC is responsible for the labeling of test booklets. That could
be in conjunction with other people but its the SACs responsibility , that doesn’t mean
they have to physically do all of them themselves all the time. Also note that they shouldn’t
be opening the test booklets while they’re doing this. All they need is the front cover.
When it comes time to test the SAC gets the test booklets, the testing materials to the
test administrator sometimes they deliver them to the test administrator, sometimes
the TA comes and picks them up but somehow the SAC gets them to the TA. Get them to the
TA as close to the start of testing as possible we don’t want the secure test material in
the hands of test administrators for long periods of time prior to testing. What some
schools have done is when the test administrators come in in the morning, they pickup their
test materials, take them to their room and then sometimes an hour later testing starts.
That’s too much time, ideally if would be five or ten minutes before testing starts
when they pick them up. If we could do it in less time that would be even better but
they shouldn’t have the testing materials in their possession for an extended time prior
to testing. During testing, the SAC should be monitoring what’s going on. They should
be walking around the halls, peeking in the rooms, seeing if there is anything the TAs
or the students might need. As soon as testing is done, they should be collecting the test
booklet materials from the TAs again sometimes the TAs deliver them, sometimes the SAC picks
them up but we don’t want the test materials in the testing room with the TAs for an extended
period of time. Once the tests are collected, make sure they’re all kept in a locked area
with controlled and limited access. The only people that should have keys are the people
who need to have keys. Ideally I think that would probably be two people. The SAC should
have a key and one other person, incase something happens to the SAC. Hopefully that’s never
going to happen and I get that there are times when maybe we need 3 keys but ideally, two
keys are probably best. At the end of testing, if it’s a ship to district, then the SAC gets
all the tests and secure the testing materials to the DAC to return to DRC. And the SAC should
report any suspected testing violations to the district assessment coordinator. One caviat
with all this, if the SAC suspects the testing violation involves the DAC then contact PDE.
Don’t talk to the DAC when you believe that they’re the ones involved. At the end of testing,
sign the Keystone exam security certification, this has to be done once per testing wave,
lets say. So if you’re testing in December for biology and let’s say literature in January
and you’re going to be a test administrator for both of those content areas sign the Keystone
exam security certification once in December when you’re done with testing and then sign
it again in January when you’re done with testing. If you’re not doing that, as soon
as you’re done with testing, as soon as the TA is completely done with all of their responsibilities
for that testing cycle then they can sign the security certification. You only have
to sign it once per testing window though, you don’t have to sign it once for every test
session. The TA has to be trained by the school assessment coordinator, make sure the TA attends
those trainings, again if we monitor we’re going to ask for a sign-in sheet and an agenda
for that training. The TA must complete the PSTAT training. The TA should be intimately
familiar with the PFAs again if you’re testing online the online user guides as well for
the DFAs if you’re doing paper and pencil there should be no surprises in that document,
in that booklet when you’re reading it to the students. You should know that very well
before you ever start with the students. Be familiar with and follow all the testing protocols
in all our testing security documents that we have. There’s a bubble on the front of
the test and there’s a bubble if you’re doing it online that says, I understand the code
of conduct for test takers that my test administrator has reviewed with me. Students need to bubble
that in to verify that they do understand the code of conduct. Another caviat with that
though is in most places the test administrator does review that with the students, they should
review it prior to testing not immediately before testing, at least a day prior to testing
that should be reviewed with the students. Sometimes though its not the test administrator
that does the reviewing. Sometimes its the homeroom teacher, sometimes its the content
teacher, in at least one building that I’ve visited the principle had an assembly and
went over the code of conduct for testing and test takers all at once. That’s fine,
as long as the students are made aware of it and they understand the code of conduct
for test takers it doesn’t matter who reviewed it with them. They just have to be aware of
it, understand it, and then fill in that bubble. Have students be familiar with the testing
procedures prior to the start of testing. We don’t want this to be a surprise. If students
have questions about the directions, answer any questions about the directions. Don’t
answer any questions about the content, but you can answer questions about the directions.
During testing, TAs should be actively monitoring. Actively monitoring means different things
to different people. Whatever it means to that test administrator or whatever direction
you give them is what they should be doing. They shouldn’t be ignoring the students, turning
their back on the students , being on a cell phone, being on a computer, leaving the room,
that’s not actively monitoring. And keep the environment calm, quite during testing make
it conducive to testing. The last bullet is bold because it’s new this year. Create a
seating chart for each testing session, whether it’s online or paper and pencil. This way,
when we come back and say well Johnny and Mary had exactly the same answers for their
test where they sitting next to each other? You’ll be able to tell us if they were, you
can tell us where they were sitting. So create a seating chart for each testing session.
I would suggest that you keep that for three years, we didn’t make that a mandate but that’s
a strong suggestion because we’re doing everything else for three years. As soon as the student
indicates he or she is finished the TA should collect the test materials. I believe the
handbook says or the DFAs says when a student finishes put your answer sheet inside your
test booklet and close it and put it on your desk. However, sometimes a student just needs
a break, they want to rest a couple minutes before they go on. So it’s ok for the test
administrator to ask the student are you finished before they collect their test booklet but
don’t keep the test booklet on the students desk after their finished. Once the testing
session is done, somehow the TA gets all the test materials back to the SAC again it could
be picked up, it could be delivered but it needs to get back to the SAC as soon as possible.
And then sign the Keystone exam security certification when they’re done testing for that testing
window or wave. Report any suspected violations to the SAC, you could also report it to the
DAC and if you think either of those people re involved in a security violation you can
report it to PDE. Lots of slides on test security, first thing is the PASecureID distribution
list. Schools are required to have a list of all of the students taking the test by
PASecureID not by name. PDE isn’t allowed to have student names but we can see PASecureIDs
so if we come to monitor and you have a list of all the students taking the test but names
are on there, you’re going to get dinged for that because we can’t see names. We just want
the PASecureID, we want the year, the school, the subject, the grade and that’s a little
bit fuzzy if we’re doing the Keystones because it could be mixed grade levels in there but
record the grade. If it’s all the same grade we can put all the stuff in a heading, year,
grade, school, subject and we want the test administrators name. So the way that I would
do it is I would have a heading for ABC school, 2016 Winter Keystone Administration, algebra
1 and then I would have the PASecureID next to the PASecureID would be the test administrators
name for all of those students. Again don’t include student names on this list, we don’t
want student names. Keep this list for at least 3 years, lots of people do it in an
excel sheet, some people have student management software they can do it through the student
management software, that’s fine. As long as you have this. PDE sometimes requests that
information so you need to have it for at least 3 years. I don’t like to read slides,
this is one I want to read because I don’t want to mess it up, this is very important.
The assessments rely on the measurement of individual achievement. Any deviation from
assessment procedures is strictly prohibited and will be considered a violation of a test
security. School personnel who are involved in the assessment program must maintain the
security of all assessment materials at all times. Test administrators should not have
secure assessment materials in their possession at any time other than during the actual assessment
administration. Note that they can have things like the directions for administration and
they should have that in their possession prior to the administration of the assessment.
Everybody involved in the assessment has to sign the Keystone exam security certification.
The district assessment coordinator, the school assessment coordinator, the test administrators,
proctors, the principle, and anybody else handling the secure materials that could be
a custodian, a secretary anybody else involved needs to sign that test security certification.
There’s a general one for folks who don’t fit into any of those categories, these must
be kept on handle for at least 3 years. Don’t send them back to the DRC, they don’t want
them. PDE doesn’t want them. Keep them at your place for at least 3 years. If someone
is involved in the assessment and they choose not to sign it, we need to know why and we
need to know what’s being done about it. So let PDE know, the superintendent, the chief
executive officer, chief academic officer and let us know what are the consequences
to this person not signing it. We have had one or two instances where someone didn’t
sign it for valid reason so what we did was we had them make a note on their security
certification statement what the issue was and then they signed it and that was acceptable.
This is also new, if there’s a violation of test security, here’s the contact information,
you can call PDE at: 844-415-1651 or you can email us at: [email protected] remember
for email addresses capitalization doesn’t matter so it doesn’t matter if its PSSA in
lower case or upper case, its [email protected] or 844-415-1651 to report any security violations.
Test must be secured and accounted for at all times. Now we’re talking about the chain
of custody, we need to know at all times where every single test is. DACs have to inventory
the test, keep them locked up with limited access. SACs have to keep them locked up with
limited access. TAs should get any secure test materials too long before or keep them
after the test is being administered and you need to use a sign-in and sign-out sheet.
So when the TAs get the tests whether they pick them up or whether they’re delivered
there needs to be a sign-in/sign-out sheet where they sign their name that they received
all the material. We also strongly recommend that the tests are counted together the TA
and the SAC count them together so what I would say is whoever is receiving the tests
does the counting. If I’m an SAC and I’m giving you a box or a bin of tests you count the
tests and the answer booklets. You signed your name or initialed your name and then
the number of tests booklets and answer booklets that you received. When you return them to
me, I count them to make sure I got back as many as you say you took and then I initial
and put that number as well. As soon as the testing session is done, the tests should
be collected by the SAC again stored in a locked room with limited access. Only people
who require access should have a key. Don’t give sample test booklets to TAs as part of
the training. They could have one during the test administration because there are some
times when it might be useful to show test takers where certain things are, That’s fine,
they can have a demonstration booklet then. They shouldn’t be looking through the test
booklet, that’s a violation of test security but they can have a demonstration booklet.
Here are some examples of actual test violations and we’ve seen all of these here at PDE. It’s
not an exhausted list but it is a good list, lots of examples. Misuse of accommodations,
giving kids accommodations that they don’t need and that aren’t even allowed, like reading
the math test to the entire class when that’s not one of their accommodations. Or reading
the reading test allowed, that’s not an accommodation. Under-proctoring, is our terms for inadequately
monitoring, in one session that I saw test administrator handed out all the test booklets
when kids got started testing the test administrator went to the front of the room, turned his
back on the kids and got out his computer. That’s under-proctoring. Over-proctoring is
essentially cheating. You’re telling kids too much, you’re too involved in the test
with them, changing answers, encouraging students to change answers is a violation, giving test
materials back to students to complete or add more. We’ve has instances where a test
administrator would give the test back to the student and say, this open ended question
you didn’t write enough, you have to write more. That’s enhancing the answers. What happens
also though is the student will hand in his test, say that students done with the test,
five minutes later the student says oh I forgot to answer the open ended questions. The test
administrator can’t give the test booklet back to that student. Can’t use secure test
materials, for example in that demonstration booklet, don’t discuss specific test questions
with students. I think most people get this during the exam, most people get it prior
to the exam, sometimes they don’t get it until after the exam. Teachers are teachers, that’s
who they are what they do is want to help kids so sometimes what happens is the test
is done a student will say I didn’t understand how to do this question and then the teacher
will probe and ask about the question and talk about how to do it. I get that they want
to help but that’s still a violation of test security because the questions are still secure.
Don’t read aloud the math question or answer choices when doing so will cue the correct
answer. We have read aloud guidelines that will help with this. Make sure all the materials
are removed or covered from the walls. Not doing so is a violation. And they have to
be covered with something opaque, we can’t cover them with cellophane if we have that.
Students can’t have cell phones during testing. TAs shouldn’t have cell phones during testing.
There are some schools that say their TAs use the cell phone to contact central office
or the administration SAC when testing is done, if that’s the case make sure that the
cell phone is put away and not in use, not accessed during testing. Don’t give reminders
to students. Don’t tell them, we covered this remember, we talked about this last week.
Students should not have access to anything that takes pictures. This is getting harder
and harder to enforce. Students shouldn’t have smart watches. There are a whole lot
of devices out there that could be very easily hidden that could take pictures. Get rid of
anything from the students that could take pictures, let them know that as well. Don’t
copy or report any part of the secure test materials for example the there’s a formula
sheet for math, you can copy that, that’s not a secure test material, but nothing that’s
secure should be copied or recorded. So what happens if any of these violations or any
other violations occur? For educators, some consequences generally, most consequences
are determined by the school or the district. It could be anything from a verbal reprimand
to termination. We’ve had all of those happen. If the violation is severe enough, PDE could
persue revoking the certification of the person suspected of the violation and there have
been times in the state where there have been criminal charges where people were violating
test schools. So all of these are possible, For students, if a student is involved in
the violation, and the most common violation is a cell phone violation the students involved
get a do not score label on that students answer booklet and the student in order to
get a score has to retake the exam and with using a different test form number during
the same testing window or wave. Possible consequences to a student, if that student
compromises the security of the test for example by taking a picture of a test question and
posting it online, we can charge them with a cost of developing that test question and
there can be fines to pay. Test questions can be very expensive those costs could be
$8,000 That’s a lot of money to pay for just joking around and taking a picture of a test
question. If there are other consequences that’s up to the LEA, you decide what you
want to do with a student. Some schools suspend them, but that’s up to you. Students as well
as test administrators and proctors and teachers and substitutes should be aware of the consequences
prior to testing, especially the students. All test security violations must be reported
to PDE immediately unless, this is also new, unless the violation involves a cell phone
where the security of the test has not been jeopardized. It’s still a violation but this
particular violation can be handled by the LEA and does not have to be reported to PDE.
Here’s an example, a student is taking a test, their backpack is on the floor, it’s sealed,
halfway through the test, their cell phone goes off, they weren’t accessing their cell
phone during testing but it’s still a violation so that student should receive a do not score
label, have to retake the test but we don’t need that information, you don’t have to report
that to us because there was no jeopardizing the security of the test involved. Here are
some reminders, a couple pages, a couple slides of reminders. So actively proctor but don’t
over proctor. Encourage the class, but not individual students to do things, for example,
check your answers. Report all prohibited actions all suspected violations. Cover everything
that relates to testing content, everything. Do ensure that students sitting next to each
other have different test form numbers, when we monitor we ask about that, if that’s not
done you’ll get dinged for that. Do no review student test or answer booklets, except as
in the accommodations part. We used to say, look through the student answer booklet for
stray marks and erase any stray marks, don’t do that. We don’t want you to do that anymore,
that’s an old guideline. Don’t provide answers to students, that’s pretty obvious. Do not
assist, direct or counsel students during the administration of the test in any way
that would influence student answers. Certainly if a student is having a meltdown, counsel
that student, but that’s not going to influence their answers, do it in a way that won’t influence
their answers. Do not influence or interfere with the test response, fill in unanswered
item or instruct a student to do so, you can’t say, you didn’t answer question number 19,
make sure you answer that. Don’t discuss of provide feedback regarding test items, we
talked about that especially after the test. Don’t have the students use their answer sheets
as scratch paper. What some test taking strategies say is you cross off all of the wrong answers
and then you fill in the right one and erase all the other marks or you bubble in all the
answers you think might be correct and then go back and erase the ones that are incorrect.
Don’t do that. You can do that in a test booklet just don’t do it on the answer sheet. Once
a student is finished testing, they can sit quietly or read for pleasure, they can’t do
work in the tested subject. When it comes to monitoring, there are essentially two types
of monitoring we do. One of them are data forensics we get reports from DRC about blocks
of data, there are numerous things that we get from DRC about the data forensics but
our big one is our on-site visits. All of our on-site visits are unannounced we’re just
going to show up in the morning and we’re going to say I’m Charlie Wayne from PDE I’m
here for a monitoring visit for the Keystones. We also want to look at a lot of documentation
when we do our monitoring visits. We’re going to see what some of that documentation is
in a minute. First for the data forensics some of the things that we get, we see how
often students erased or what they erased. If they’re testing online, we know how long
it took them to answer a question, we know how often they changed their answer, we know
if the answers are changed even with paper and pencil, from wrong to right, right to
wrong, or wrong to wrong and students really don’t erase very much so when we get information
from DRC that says a whole lot of students in Mrs. Smiths class erased a lot of their
answers from wrong to right we become suspicious so we get all of this information. We get
statistical analysis of student performance, so maybe in one year a certain group of kids
did really poorly on literature and really well on math. Well now the next year their
all doing really well in literature and really poorly in math. That could be a red flag,
it might not be, it might just mean that the district changed their instruction, they beefed
up their literature program, it could mean a lot of things not all of them are bad. But
it could be a red flag so we get all kinds of information. When we come to monitor some
of the things that we’re going to look for are the training agendas and sign-in sheets,
we want to see the master test schedule, we can to see small group rosters, we want to
see the make-up test schedule. Sometimes when we come the make-up test schedule hasn’t been
created because we don’t know what kids aren’t there and when we’ll be able to test them,
I get that, but have at least an outline. Tell us what you’re going to do, how it’s
going to be created, when its going to be created. One of the most important pieces
of information documents that we want to see is the PASecureID distribution list. That’s
very important. We want to see the sign-in and sign-out sheet for TAs getting and returning
the tests. We want to see the Keystone exam security certifications from the previous
year. We know you don’t have them signed for this year because testing isn’t done yet,
but we want to see that they are signed from the previous year and they’re saved. We want
to see the specific school or district procedures for parental requests to view the test, not
the ones from our handbook, we want to see what yours are. And if any parents did opt
their child out we want to see the letters that they sent. Again to report an suspected
test violations, call us 844-418-1651 or email us at [email protected] Other contact
information you could call Jay Gift or email Jay or you can call me or email me. Jay’s
number is 717-783-1144, his email is [email protected] My number is 717-783-0358 and my email is
[email protected] Any other information check out our website, if you have any questions
you can call or email Jay or I and we’ll do our best to get answers for you. Thanks for
participating today. I hope that it was valuable, again any questions let us know. Thank you!

Leave a Reply

Your email address will not be published. Required fields are marked *