Vacuum tube amps are always going to have higher distortion than transistor amps for two reasons.
First, tube amps are firing a stream of electrons across at least half an inch (more like an inch in many cases) against a grid that blocks the flow except to amplify the small voltages applied to it (so that the small signal is amplified). This electron "beam" is sensitive to electric fields, back-scatter, and internal reflections in that relatively large space. Transistor interfaces are on the micron level (although this does other things that affect distortion, notably clipping effects which are rather different than clipping effects in tube amps). Grids and plates can vibrate, too, and have resonance frequencies.
The other "source" of distortion in tube amps is the lack of feedback circuits to diminish it. It's not impossible, but I suspect the number of tubes and power required to accomplish this, along with the very limited selection of tubes and severe lack of research and production of specialized tubes means it's not gonna happen. A tube amp with the sort of circuitry in a high end transistor amp would be huge and generate an amazing amount of heat. Tube based computers required rather astonishing amounts of cooling to prevent the solder from melting after all.
This is not a comment on the quality of tube amps. Quite a few people prefer the sound of them, so the distortion inherent in the physics of tube amplifiers isn't "bad", but it is far higher than a comparable transistor amp. Tube amps usually run 1% THD and up, these days transistor amps run 0.05% THD and LESS, a huge difference.
Purely a matter of taste and the type of sound you prefer. I like my amps to turn my CDs and vinyl and radio broadcast signals into sound with no change from the original beside higher amplitude ("a wire with gain" so to speak) so the original isn't altered. Other people prefer a "warm" sound, etc. Nothing wrong with that at all!