I remember a site that used to test vocabulary (e.g. word, 4 meanings, you pick which is correct) and the clever thing it did was to continually update the difficulty settings according to how well people actually did. You could do something similar here — e.g. have a "I already know this word" option which bumps up your difficulty a bit.