Commuters from Milton to Downtown Toronto....advice please!!!?

I live and work in West Toronto at the moment, but my boyfriend and I are looking to by a house in Milton. Our family is in the Kitchener-Waterloo area and we want to be closer to them, but still close enough to work in Toronto. Anyone commuting from Milton to Downtown area (Liberty village) of Toronto, can you please advise your experiences, recommendations, etc?