Saturday, February 03, 2007

How to Prepare for the USMLE: Which QBank is the Best?

For most of us, it’s also the first time we’ve ever taken a test like this on a computer. Like most, I have my habits of underlining key words in a question stem, putting *’s by things that I have to skip now but may get later, putting an “X” next to a question that I could never answer correctly, etc. That I’ll be staring at a mouse, keyboard and glowing screen on test day is an unnerving thought.

To get over all of this, we look for practice questions. The good news is that there are thousands of practice questions on Al Gore’s internet and the companies worth their salt have some great supporting software. There are free questions and expensive questions and you get what you pay for. Let’s look at some free/semi-free sources first.

Free/Semi-free sites

  • Official USMLE tutorial and practice questions (2007)
    • Gives you four blocks of 50 questions for practice with the testing interface FRED. No explanations for answers and reviewing your questions is awkward.
  • Tulane’s Medical Pharmacology Exams
    • I wish I had known about this site when I took Pharmacology. The questions are broken down by subject with explanations of all answer choices. Straightforward multiple choice and great for review.
  • Web Path
    • I used this site religiously when I took Path and it was an enourmous help. I recommend it to anyone and everyone. Great questions, great pictures, great format.
  • Anatomy at University of Michigan
    • I used this site throughout anatomy and I still thanks to this site, I understood enough to really enjoy the subject. Surface anatomy, gross anatomy, radiology, and Anatomy Jeopardy. After the Boards, I owe these guys a bottle of wine and a nice card.
  • Lipincott Williams and Wilkins
    • 350-question comprehensive USMLE test, available to anyone that has registered with the site. If you have bought one of their books (Physio BRS), there is an access code in the jacket.
  • Student Consult
    • I have access to this because of the two Rapid Review books that I bought (Gross and Developmental Anatomy, Microbiology and Immunology). This site also has 350-question tests for you to use (with the scratch-off code, of course).
  • Facts in a Flash
    • Not USMLE format, but if you like working on flashcard questions without the rubberbands and mess, this might be for you.

So after looking at those sites you decide that, while very good for your normal review, you need some professional help for the Boards. You need this enough that you’ll part with some loan money. Whichever company you choose, you should look for the following:

  1. Their question bank (QBank) should have enough questions for you to give yourself a fair evaluation, there should not be so many questions that you could not comfortably do them all, and the quality of the questions should be more important than the quantity.
  2. The questions are given in the FRED computer format that you are going to see on the USMLE, complete with question marking, annotation, highlighting and strikethrough.
  3. Detailed explanations for right and wrong responses.
  4. Questions broken down by both subject and system, i.e. Cardiovascular Pharmacology.
  5. The software shows your strengths, weaknesses, progress, and performance against all other students using the same questions.
  6. THE HOLY GRAIL: The questions are of equal or greater difficulty compared to those on the USMLE.

Question Bank Subscriptions

  • KAPLAN ($279, 3 months, 2100 Qs, FRED)
    • This was likely the first company that sprang to mind. Kaplan runs review courses where you live in a hotel for 6 weeks cramming, they have online course content, video lectures, on and on. This company has worked the USMLE inside and out, and it seems a right of passage that students slog through the 2100+ questions before sitting for the exam. I was a little wary of this company, though, as people told me that by the end of the course, they were scoring in the 90s on each block and that the actual USMLE was much harder.
  • USMLE WORLD ($110, 3 months, 1730 Qs, FRED)
    • I had never heard of this program, but three people that I consider intelligent (each scored 95+) told me that UW’s questions were more difficult than the actual USMLE. Each of them also subscribed to Kaplan, used its program, and found the programs to offer the same features. After hearing this, visiting their site, and considering the prices, I had to take them seriously. It seemed like a great deal (less than half of Kaplan with a higher rating). The reviews at Prep4Usmle were positive as well. I also like that UW let’s you try their product for a month and if you like it, you can buy more months at a discount.
  • USMLE Rx ($199, 3 months, 2000 Qs, FRED)
    • Written by the same authors of the First Aid for the USMLE. On glance, they seem to be doing everything correctly. They let you test their product and they offer integration between their online product and the First Aid book. The reviews that I have found put it on par with Kaplan. I’m intrigued.
  • SCORE 95 ($99, 3 months, 4300 Qs, FRED?)
    • That this site is slick and has a string of testimonials (which read like a third grader’s homework assignment) is not impressing me. I am also having a lot of trouble actually learning about their program (does it run off your computer, what features does it have, etc.). What I am impressed with is their accompanying note set, that they show you the breakdown of their questions, and that they offer a daily podcast to anyone that wants to listen to a new subject each day. The reviews I was able to find online say that the program is poor and the questions are disappointing. Quantity > Quality. In fact, the number of questions scared me off well before my research. 4,300 questions comes to 360 questions a week for 12 weeks. I currently average 150, and that pace is keeping me busy. I cannot fathom the amount of work it would take to complete these questions, so why have them?
  • EXAM MASTER ($179, CD, 8,700 Qs)
    • Absolutely not. On first glance: no. After reading reviews: no. If this program helps your score, it’s probably a placebo effect.

So where does that leave us? If you’re going to start doing questions 3 months before the exam, anything more than 2500 questions isn’t practical. You have to realize that you’ll be spending all day learning the material, and that it might take 3 days to cover a topic. At a reasonable pace, you can expect to do 150-200 a week (which will take you 3 hours and 15 minutes, remember). Anything more than this might burn you. So let’s just throw Exam Master and Score95 right out.

If you believe the worst reviews of the anonymous, Kaplan, UW and Usmle Rx are the same difficulty. If that’s true, then you should go with the cheapest program: UW. If you believe the best of the reviews, UW is harder than Kaplan and Rx, and you should go with UW. Though it has fewer questions, I got the strong feeling that the Quality >>> Quantity, and since I only have so much time to devote to questions, I want them to challenege me and teach me something new. I dropped the $110 and am incredibly happy with it. The questions are stout, and with all my over-preparing for each section, I have yet to crack an 85% in any discipline. This was a good choice for me.

However, if you don’t have much time, are planning on putting all your eggs in the First Aid basket, and would benefit more from reasonably challenging questions (whereas harder Qs might hurt your confidence more than help your score), then I can see a strong case for buying the Rx. It’s twice as expensive as UW, but the formats are indistinguishable and the integration with the First Aid book is appealing. If this wasn’t priced at $199, I might have bought this after finishing UW.

I’m sorry to beat up on Kaplan here, but after going through their QBook and the questions in their Lecture Notes, I’m just not impressed. I have consistently felt that the questions were either written to make me feel good about owning the notes, or that the notes were written to prepare me for those exact questions. Either way, I never had the feeling that Kaplan’s questions were independently difficult (if that makes sense) and from what I’ve read and heard from others, my concerns have merit. And for $279! Get over yourself, Kaplan.

So those are my thoughts on picking a QBank. I assure you that all the research was anecdotal and supplemented with gossip. I suggest heading over to the forums to read for yourself, and if you have any comments on these products, I’d love to hear them.