Here is what I did.
1.Open \wp-content\plugins\woocommerce\includes\wc-cart-functions.php
2.Search for wc_cart_totals_shipping_method_label function
3.Replace if ( $method->cost > 0 ) with if ( $method->cost >= 0 ) and it should show the shipping cost even if it is set to 0.