The 55 Rajya Sabha members have accused Justice Shekhar Kumar Yadav of hate speech and incitement to communal disharmony.