It's entirely possible that I messed it up during refoam but I'm pretty sure I didn't. It was when I went to center the voice coils that I discovered the issue. I forget what the technique was called but the refoam kit I had said to center the voice coil I should lightly push on the cone and find where it had the least resistance and most "bounce". But as soon as I touched one of the bad driver's cones I felt that it wasn't moving and would scrape if I forced it to move. One thing that may have been wrong is that I had already glued the new surrounds to the cone but not the outer ring of the basket. I was very careful of the cone while doing everything up until that point though, they were barely moved during the cleaning and gluing. So let me know if that could be the cause of my problem.
The old surrounds were practically non-existent when I saw them the first time, so from the comments I'm guessing they were just blasted for many years and burned out. I'll chalk it up to a lesson for me and try to sell the good drivers to get some money back. Thanks everyone for the responses so far.