Put your fear to rest on this one.
A little dirt falling into the crankcase will hurt nothing. It will not get by the screen on the oil pickup for the oil pump. And if it went by there, it would next go into the oil filter before it goes to any critical parts that need to be lubricated. Relax.