RE: Testing Software for CLP Admin, what supplier?
Posted by Randy D Smith on 28.Oct.05 at 00:11 using a Web browser
Category: GeneralRelease: 6.5.4Platform: All Platforms
Self Test Software is by far the best product for Lotus Notes Domino practice tests. I've used practice tests from each of the vendors you mentioned in your initial post (Self Test Software, AdvancedCLP, CertFX and Thomas Tester), and Self Test Software beats them all. From my experience, here are the strengths of each of these practice test vendors:
Self Test Software:
Price - Slightly higher than some of the other vendors, depending on discounts and special offers. Well worth the price (IMHO), considering the quality of the product, extra features, etc. For comparison, their practice test for exam 620 is $79.
Technical Accuracy - This is their strength. They conduct a very thorough technical review in order to deliver a quality product. As a result, they are often slower to market, due to their insistence on delivering a high quality product.
Features - The best of this group. The questions/answers are very thought provoking (e.g. no silly answers), and they cover the exam competencies extremely well. Each question has a very helpful tutorial section including explanations for the question/answers, screenshots, etc. The user has the ability to customize each instance of a practice test with random selections from one or more competency areas, the ability to select only questions that you have missed x or more times from previous instances of the practice exam, FlashCards, a 24X7 on-line mentor, test score breakdowns by competency areas, historical compilations of test scores from previous instances of the practic exams, etc., etc., etc.
Quantity - They typically deliver somewhere between 100 to 150 questions/tutorials and an additional 150 to 200 Flashcard questions.
Opportunities for improvement - None that come to mind. They seem to set the standard for quality, features, etc. that other vendors have tried to emulate over the years.
My overall rating - #1 for this group of vendors
AdvancedCLP:
Price - Slightly higher than some of the other vendors, depending on discounts and special offers, as well as the US dollar to Australian dollar exchange rate. A very good value, especially considering the number of questions they offer. For comparison, their practice test for exam 620 is approximately $80 (US Dollars).
Technical Accuracy - I believe they conduct a technical review of their products. They also encourage their customers to report any problems that they find. I've found only one, which was immediately corrected. They seem to be genuinely concerned about they quality of their product. Like Self Test Software (STS), they are a bit slower to market as a result of their technical review process.
Features - It's been awhile since I've purchased one of their practice test, but as I recall, the questions/answers are very thought provoking (e.g. no silly answers), and they cover the exam competencies extremely well. Each question has a very helpful tutorial section including explanations for the question/answers, screenshots, etc. They've added a few features to their test engine since the last time I purchased one of their practice tests. I believe they now have the scoring breakdown by competency area, an historical compilation of previous test results, and an "Exam Cram" selection of questions (I'm assuming that this is similar to STS's FlashCard questions).
Quantity - They typically deliver over 200 questions for each of their practice tests.
Opportunities for improvement - Their test engine requires a Lotus Notes client with a Notes UserID. This might prevent some users from being able to use the product, or limit their use to when they are at the office (if they don't have the Notes client software installed at home, on their laptop, etc.).
My overall rating - #2 for this group of vendors
CertFX:
Price - Usually priced slightly less than the other vendors, depending on discounts and special offers. For comparison, their practice test for exam 620 is $70.
Technical Accuracy - I've had a bad experience with each of the CertFX practice tests that I've purchased and no longer purchase them from CertFX for this reason. However, some forum participants seem to think they are fine. Perhaps the quality and accuracy varies by practice test. I doubt that they have much of a technical review process, because the practice tests that I have purchased have been riddled with misspellings, technical inaccuracies, incomplete questions, answers, and explanations, etc. As a result, they tend to be first to market. If you're in a hurry to get certified on a new release, CertFX will no doubt have their practice tests out before any of the other vendors.
Features - The test engine for CertFX has a "cool looking" user interface, but the navigation is not very intuitive. However, it's easy enough to navigate once you get used to it. Also, it lacks many features that other practice test vendors have. I don't believe they have any "FlachCard" or "Exam Cram" style questions. The scoring did not lend itself to tracking the progress you've made from previous instances of the practice test. And, they did not allow a user to choose questions from a specific competency area, see a scoring breakdown by competency area. They may have introduced some of these features since the last time I purchased one of their practice tests. They do have an explanation section for each question, but no screenshots. I never found these explanations to be very useful, because quite often the explanation amounted to simply reiterating the text of the question plus the text of the correct answer.
Quantity - They typically deliver about 100 questions for each of their practice tests.
Opportunities for improvement - They need to begin conducting a thorough technical review process to correct mistakes before shipping their practice tests. Also, they should consider adding a few useful features that are currently available in the other practice test vendors' products.
My overall rating - #3 for this group of vendors
Thomas Tester:
Price - Although this vendor does not appear to offer practice tests for ND6, their R5 practice tests were priced at about $30 each.
Technical Accuracy - I don't recall if there were any problems with the test questions/answers for the practice test I purchased. I purchased only one of their practice tests several years ago, based entirely on price. The old adage "You get what you pay for" is very appropriate for these practice tests. Their web site indicates that R6 exams are coming soon, so it doesn't appear that they intend to compromise the quality of their products by rushing them to market.
Features - For each question, they offer nothing more than the question with one or more correct answers. There are no related competency areas, explanations, references, etc. provided. One of their greatest features mentioned on their web site is that the questions are presented in random order, "so each time you run the examination, it is like taking a new test". I think I laughed out load when I read that.
Quantity - They deliver about 60 to 80 questions for each of their practice tests.
Opportunities for improvement - Since these exams offer none of the useful features included in the practice tests from other vendors, there is much room for improvement.
My overall rating - #4 for this group of vendors
So, I guess my recommendation would be to spend about $10 more and go with the best practice test available - Self Test Software.
Good Luck on your exam!
Randy