Drinking from a shoe has historically been performed as both a bringer of good fortune, a hazing punishment, or a party piece. Drinking champagne from a lady's slipper became a symbol of decadence in the early 20th century. From Wikipedia
The two-term Labor MP marked his unconventional farewell with a nod to Australian tradition, emphasizing the accessibility of politics.