Does TAFE NSW offer Degrees or just Diplomas and Certificates?

Yes, TAFE NSW does indeed offer Degrees.

TAFE NSW has ten, nationally accredited higher education programs which you can undertake to attain a recognised Degree.