CutScoreInstructions

Here are the instructions for helping with a Cut-Score Study.

Introduction

The purpose of this study is to use specialized ratings from expert Linux system administrators and users to determine what the passing score should be for our exams.

The work we do in this study is critical to ensuring that the cut-scores for the exams are fair. For the study to be successful, it is critical that the Subject Matter Expert (SME) understand the process and what they are asked to do. The purpose of this document is to accomplish this requirement. If you have any questions at all, please let us know.

Conventions

Throughout, this document will refer to LPI Director of Exam Development. G. Matthew Rice is LPI's Director of Exam Development and he can be contacted at mrice at lpi dot org.

The Linux Professional Institute will be referred to as LPI and the various exams will be referred to by their number code.

Materials

In order to participate in a study, an SME will have the following materials.

1. These instructions.
2. Access to an on-line application for rating the items.
   The URL will be e-mailed to the SME upon commencement of a study.
3. Access to the (potential) exam questions.
   These are the actual questions on the current or future forms of the exams. Due to the nature of this access, an NDA will be required to participate in this study with LPI.

Protecting Confidentiality

In order to participate in this study, an SME must have access to a large subset or the entire set of questions for an exam. The disclosure of the exam questions is covered by the non-disclosure agreement (NDA) that is signed with LPI before access can be provided. It is absolutely essential that an SME protect the confidentiality of this material. LPI exams cost tens of thousands of US dollars/Euros to develop and, if confidentiality is broken, the entire effort needs to be repeated at great expense.

In particular, please strictly adhere to these guidelines:

1. Do not, in any manner, share the test questions with anyone. Do not disclose item content to co-workers, supervisors, family members, students, the media, other LPI judges or reviewers, or anyone else. Avoid all forms of unauthorized disclosure including in writing, by voice, and by any electronic means. If you need to discuss the contents of any of the questions, you should only do so with the LPI Director of Exam Development. In the past, LPI has provided a mailing list for the discussion of items during cut-score studies. In these unsecured communications, please avoid disclosing any actual item content and, if content is disclosed, please limit it to the minimum necessary.
2. Do not make copies of the questions as they are presented in the web application. Practice safe web browsing and clear your cache regularly.
3. When communicating outside of the online application, please refrain from discussing specific content on the exam items. If such discussion is required, please use GPG encryption for any e-mails.
4. If you ever suspect that the confidentiality of the material might be broken, please report it to the LPI Director of Exam Development immediately.