I received quite a few excellent comments on my recent “Open-Ended Question Grading: All or Nothing” post. Many were as confused, disappointed, and angered as I was about finding out that these questions were graded on an “all or nothing” basis…via a forum posting rather than from Cisco themselves.
So they’ve marginalized the lab in the interest of as few as three open-ended questions? What’s the motivation there? Seems like Cisco is just trying to make the exam more difficult to pass without really improving its quality.
Comment by stretch
Regarding the “all or nothing” grading, I guess that I needed to read my email a bit closer. The original email I received from Cisco contained this line:
Candidates will need to achieve a passing score on both the open-ended questions and the lab portion in order to pass the lab and become certified.
I initially read that to mean that the open-ended questions and the remainder of the lab were combined, and that you needed 80 point from that combined lab. I should have read that as a Boolean AND and not an OR. : -)
The “minimum number of correct responses” on the question portion translates to a “passing score” on that section. The lesson to candidates is that you had better make damned sure that you get clarification on those questions before you submit an answer. If you miss more that one of them then your next 7.5 hours will just amount to a $1,400 rack rental.
I’m still a little confused about the reason for the addition of these questions. My take (and this is why this post has the word ‘speculation’ in it) is that this is a stop-gap to curtail cheating. Cisco has stated that stopping cheating is simply a secondary effect of these questions[to be fair that quote was about the original verbal interview pilot in China]. The stated goal is to “increase the security and integrity of the CCIE R&S Lab exam” so stopping cheating definitely falls under that statement. These new questions basically filter the candidates who are “worthy” of taking the CCIE lab. As many candidates have stated that there is already such a filter in place: the CCIE written exam.
Better still why don’t they just make the written un-dumpable. Surely they can create a question bank comprising of the thousands of questions they must have given over the past X years and randomly generate a somewhat unique written exam for each candidate. I don’t know; have to say I’m getting seriously disillusioned with Cisco Certification.
Comment by Dean
I’ve also seen suggestions to add the open-ended questions to the written exam or to make them into their own exam (so there would be three discrete steps to your digits: written, open-ended questions, and then the lab). Another suggestion is to enforce an experience policy on candidates:
If Cisco wants to make the certification even more valuable, then for god sake, make a requirement like 1 year CCNA + CCNP for 3 years before taking the ccie lab or something like that or years experience. Its not 4 questions before the lab that will make the cert special. For me this is a pure joke!!
If the addition of the open-ended questions is meant to filter “worthy” candidates, then exactly how long does Cisco think that it will take for the “dumpers” to collect the open-ended questions? If they can dump the 100 question written exam, then what’s going to stop them from dumping a 4-5 question exam?
Additionally by taking this course of action Cisco has essentially admitted that the CCIE is completely compromised and has been so for some time. As such one has to question the value of this certification as undoubtedly if the exam is this compromised there is nothing stopping cheaters from getting these questions in advance and preparing they’re answers before the lab. All these factors combined leads me to a one word conclusion – Juniper.
Comment by Dean
I’m not quite ready to go to the darkside (Juniper). :-)
Let me restate: I am not opposed to the addition of the questions to the lab and I support additions that will protect the value of the certification. BUT I really think that Cisco failed to adequately announce the details of this change. PLUS I think that the fact that you now need to pass the questions before you have a shot at passing the lab exam, this should have constituted a lab “change” and the standard 6(ish) months of lead time should have been provided. The folks who took their labs in early February really got the worst of this deal.
I noted in my last post that it appeared that the questions were worth 21 points of your grade. A few folks noted that the bright side to this change was that if you could cruise through questions, then you only needed to get another 59 points to pass the exam. You could really put yourself ahead of the game because you’d have 21 points in the first 30 minutes of the lab.
Personally I think that you’re misinterpeting the scores.
Open ended Questions are propably only worth about 10 points. They look like they are like 21 points but I think this is just because if you fail those, Cisco has put them into the system like they were 21 points. Otherwise the score is not consistent with the CCIE Score report. I mean that if the points for Open Ended are like 10 point’s and you have 100% for each section, that would mark as passed if they did not weight the scores. Now if you fail the the open ended part but configure 100% on all other section the score sheet will show it as fail by 21 points due rescaling.
Comment by GoingtoBrussels
I agree with GoingtoBrussels (again this is simply my speculation) and you’re not going to get 21 points for passing the questions. We can’t share score reports as that’s an NDA violation, but other candidates have stated that there are 100 points of tasks on the lab exam:
Also….100 points on lab…not 79
The proctor did not told us how many points has each question.
The points from this questions is not added to the points of the lab exam.
There were 100 points from lab tasks.
Of course this now means that your time to complete the lab exam can drop from a full 8 hours to 7.5 hours (depending on how much of the allotted 30 minutes you require to answer the open-ended questions).
From the same thread:
There was not any interview with the proctor , just open-ended questions on the computer and you should answer to them in order to pass.
The questions are graded after the lab by a script probably. [NOTE: this contradicts Cisco who states that they will be manually graded – but he did say ‘probably’]
You should be very carefull to check the answer because is possible to fill the answer and after you go to next question you can be surprised to not have the answer filled in .
You should go back and recheck every answer one more time before going to the lab section.
If you put ” or : or ‘ in the answer section you will receive an error so you should be carefull :)
This is the last that I’ll probably write/gripe about the newly added questions. I’ll just need to make sure that I’m up to snuff on theory going into the lab exam. This shouldn’t be too hard as most of the training I’ve used for my CCIE preparation has repeatedly referenced the theory and not just “here’s how to configure a task like x”. I’m pretty swamped at work this month so I’m not able to lab much. I’ll just use my bits and pieces of downtime to reread Routing TCP/IP so that I’m sharp on my theory.
Just a random thought: I wonder if it’s now a better strategy to study for your written and lab exam concurrently. Once you feel you’re prepared for the both the written and the lab exam, take and pass your written, then book your lab exam soon after so that you don’t forget your theory for the lab.
I’ll leave you with a bit of gallows humor from mgeorge on IEOC.com:
Practice Lab & Materials: $5,000-$10,000
Lab Price: $1400
Alcohol at the local bar: Don’t remember
Failing the CCIE R&S lab because 2 of the 5 questions you’d typically use Google for… Priceless
For every other certification in life; there’s Mastercard, which does not work due to the credit crisis.