I know this may be basic, but can you confirm if you're using automotive sand paper or a hardware sandpaper?
Automotive sand paper is different and provides a proper finish.