Edit: Some links no longer work.
Originally posted December 22, 2015 on AIXchange
I’ve once again been working with teams that are updating various certification tests. I enjoy the interaction with tech pros from around the world as we devise test questions and answers.
As I wrote in my previous post on this topic:
The first thing I noticed was the strict confidentiality required for all team members. We were not to discuss questions or answers with anyone outside of the team for any reason. The last thing we want to do is allow a test taker to get access to the questions and answers. If people are able to cheat their way through an exam, it lessens the value of the certification for those who pass the exam legitimately.
Detecting cheating, or “non-independent test taking” (NITT), has become an even bigger deal since the time I wrote those words:
NITT is any circumstance when an exam is not taken independent of all external influence or assistance.
Non-Independent Test Taking (NITT) is a breach of IBM Test Security and is a serious violation of IBM Professional Certification Testing Practices
If you have taken an IBM certification exam, and it is determined you did NOT test independently: Your certification (if awarded) will be revoked; resulting in the loss of your certified status. You will be banned from testing, and will not be allowed to take any IBM test.
BEFORE TESTING
DON’T:
1. Use any unauthorized study guides, or other materials, that include the actual certification test questions.
2. Have someone else take the exam for you.
DURING TESTING
DON’T:
1. Talk to others who are testing, or look at their screen
2. Use written notes, published materials, testing aids, or unauthorized material.
AFTER TESTING
DON’T:
1. Disclose any test content.
2. Reproduce the test.
3. Take any action that would result in providing assistance or an unfair advantage to others.
Detecting Non-Independent Test Taking
IBM (and many IT certification programs) has devised methods to detect the use of resources containing IBM certification test questions. Through complex data forensics, we can identify a NITT violation. The forensic analysis is based on a variety of factors and different elements of the testing results. (IBM does not rely on any single piece of data.)
It is important that in addition to a standard review of the overall test results, there are multiple aspects of response patterns that are analyzed. The psychometrics of the test performance is evaluated. And IBM also includes independent statistical analysis in making the determination. Based on this rigorous evaluation, IBM can make the NITT decision with certainty and with an unchallengeable degree of confidence.
IBM takes notification of NITT very seriously. A notice is sent only when the conclusion is unmistakable.
By sending a violation notice, IBM has determined, undoubtedly, the testing candidate had access to the test questions (and used the questions) to prepare for the exam. The status of Pass or Fail does not matter. Also, it is not relevant whether the use of questions, from the certification exam, was intentional (or unintentional). In all cases, the fact is the test-taker had reviewed the questions from the certification exam, prior to taking the test.
This video highlights some of the reasons you might want to become certified.
When others learn that I’m involved in writing certification test questions, the typical response is to jokingly ask for copies of the questions. While I get where the humor is coming from, it really isn’t funny to me, because I understand the value of an honestly earned certification. There are ramifications for asking for or distributing questions and answers, and they exist for good reason.