I would not do that, the driveshaft is balanced from the factory and even a minor change like that could be bad. I can't tell you what may happen, but I personally wouldn't advise you leave it be.

__________________
2016 Monsoon Gray Audi Allroad - 21k
2008 Black Mercedes E350 4Matic Sport - 131k
2014 Jeep Wranger Unlimited Sahara - 62k
2003 Gray Mercedes ML350 - 122k