A short drive without the air filter and not wet out would not hurt anything in my opinion. Just to establish it was the saturated air filter.

If it was cold enough in your location to freeze the water present on and in the air filter that would really do it. This is especially if you cannot pick up a replacement air filter very easily locally.