Assuming radiation was no issue, there is another problem:
For psychological reasons, you want to send older people (still in good shape, but not prone to extra risk). So, say that the mission launches when the average crewman in 50. When the mission returns, he is 52.5. You need time to rehab...