When criticised for his style of government or questioned about his party's political past, the wide smile could turn sour.