The controversial former prime minister announced he'd go his own way just a week after agreeing to support his party in a new coalition with the Five Star Movement.