Basically, wholesale lenders use mortgage brokers as their loan officers. They offer a lower rate to the broker, the broker adds on his compensation, and the rate is usually about the same as you would get using a mortgage banker. Sometimes the rate is lower, sometimes higher, depending on how much compensation the broker adds on.
Mortgage brokers also learn the "hot points" of various wholesale lenders and can handpick the lender for a borrower which may be unique in some way. He will be able to submit your loan to either a portfolio lender or a mortgage banker. Another advantage is that, if a loan gets declined for some reason, they can simply repackage the loan and submit it to another wholesale lender.