Woocommerce wasn't build for multi-vendor. So, if you are using default Woocommerce shipping method then only one postage cost will be added on cart. It doesn't matter how many products you are buying from different sellers. To handle this situation we released an add-on “per product shipping”. Which should be able to handle your situation and your sellers need to add their own shipping cost.