I am not too familar with the diesel engine, but if it would be a gasoline engine, I would not loose too much sleep over this.
If the part felt in the oil pan, it should stay there for the rest of the life of the car without causing any problem. There's a screen at the oil pump would prevent the piece to go to a critical part of the engine.
jackd