The aim of this paper is to study the rings of differential operators on classical rings of invariants. Though the varieties will often be singular, we will prove that the corresponding rings of differential operators will alway be simple Noetherian domains, generated by the "obvious" differential operators of order less-than-or-equal to 2.