You've found it! These cars have two fuel pumps and a filter all hung there under the right rear. I don't recall from memory and it's raining right now so I'm not going out to crawl under my car to determine which is the filter.
If you have the service CD for the car, the R&R procedure is well detailed there. I did it a few months ago in about an hour. My one piece of advice is to soak all the screws and bolts with Liquid Wrench or the like a day or two before you plan on doing the work. Given the under body location, things get a bit corroded and the last thing you want is to twist a metal fuel line and spring a leak.