The problem you'll run into is with the fact that the factory crossbars are curved, whereas the bottom of your cargo box is not. I suppose you could shim it, but then the box would only contact your crossbars at those shim points, not the entire bar's length as was likely intended by the box's designers.
I use my Thule crossbars exclusively when I install my cargo box...that's my 2% of a buck