It's not so much what you did wrong, more along the line of what you didn't do quite enough. Think of it this way, you start with a dust cover, it's got scratches. The only way to get those out (believe it or not) is to put in bigger scratches. Fortunately, we control those, so we put in many, many, in an even consistent manner. From there, it is a process (yes, a long one) of putting in smaller and smaller scratches to the surface below the current scratch depth. For example, say you start with 500 and get a nice even haze. You move on to sanding with 800 and remove all evidence of any 500 grit scratches. That's the critical component for that and every subsequent step. (Use 1000 to remove all the 800 grit scratches, and so on.)
I also recommend a drill, it will help save your arm. As a point of reference, I spent six hours on my PL-630 cover, hitting all 10 surfaces, inside and out.
Good luck, it's worth it!
- Jeff