Is there any point to doing it?

Yes it is, it will help your body maintain its ability to take the weight training, of you dont do anything on relaxation days, you may do serious damage from doing nothing to dong a lot