Those spots are commonly found on Japanese pressings - on the covers, obi strips and labels. I usually refer to them (and see them referred as) toning spots. I doubt that comes off, but I've never attempted to clean them.
I've never tried specifically to clean record labels, but the term for this coloration is "foxing". I used to collect antiquarian books years ago so that's how I was familiar with the term. I did some digging on foxing in general and this site seems to describe it well with some possible solutions. Hope it helps.
You can try a little Oxalic Acid mixed in water. Then lightly press it on the label in the area needed. I would not wipe and rub the label with anything because the label shown looks like raw paper.
Look at this thread and how Oxalic Acid removes Iron Oxide. In this thread I'm mixing it with alcohol, I would use water in your case around ink.