Vue: icons are not displayed when css.extract: false

Question

When building a Vue library (component), according to Vue docs, you can set css.extract: false in vue.config.js to avoid the users having to import