Time travel is hard to do