There is no point to adding it unless you need to get rid of it. It won't hurt anything, it's just a waste of expensive oil.

ULSD won't cause any harm on it's own so don't worry about it.