RCA is a type of plug, coax is a type of wire. Usually they're used together (e.g. an RCA plug on coax wire) so your question is confusing. Also, Toslink is optical. Both coax and Toslink can carry an S/PDIF signal. You can use either coax or optical, depending on your source components.
The OP may be using 'coax' to mean something like a BNC connector. In which case, not a great deal of difference between RCA and BNC, barring slightly better controlled impedance for the BNC; SPDIF should be using 75 ohm impedance.
What I'm asking is, on the DAC there the Toslink connection then next to it is a coax connection it look like a RCA connection but there just a single connection, what is this coax and do you need to use the Toslink and the coax together?. Thanks
They are both SPDIF serial digital data inputs. One is electrical, the other is optical. You can choose to connect one or the other. You don't need (and may not be able to connect both) at the same time. There may be a switch to select the input source.