Think this is a really cool idea and a cool design. Very clever. That said I would worry about liability if something goes wrong. The factory hitch support with out hitch is nothing (and I do mean nothing) like the factory tow receiver that replaces the entire assembly and with stronger bolts to mount). I have removed and installed both, and speak from what I have seen and felt. I realize these bolt sockets are rated for vehicle recovery, but not for the other stresses that come from towing. No idea, but even the repetitive motions from a small trailer may warp the metal cross support over time, heck I wouldn't be surprised if a hard recovery warped the basic metal number support (model with out factory hitch).
The weak point here is likely the factory bumper support, which was never intended to be used in this way.