I wonder if this is possible to tell via .htaccess or any other manners to set a base URL.
Example
My CSS in the index.php is set like this
You should use an absolute path in your pages:
Base tags can cause numerous headaches as all non-absolute URIs will be used with it.