I own a Burson Buffer although not in a passive pre/buffer setup. I am using the Burson buffer to lower the output impedance of my Marantz CD63 and it worked great! No problems with colouration etc. and the improvement was significant.
I think the buffer should be good for your passive as it...