Many brands of cars have a factory recommendation to change the filter every other oil change, check your book. Given your filter is new I would not worry about it at all. At worst you would be X miles into oil life by leaving some old oil in.

How many quarts does you car hold?