Creating an enviable home on the top floor of a “pretty hideous” old Melbourne tower was a tour de force for an innovative architect and his imaginative clients