yes a ceramic disc cap is fine. instability is usually caused by too much phase delay in the response. hard to say how stabile the design is without measuring the performance. changing comps can cause this instability. have to experiment/simulate the design in order to see whats going on. I doubt that it is the power supplies if they are stable and noise free.