It is fine not to use Entity Framework, using ADO.NET can be acceptable. Yes it's possible.
If careful you can make your data access code more efficient than the code EF will generate. Maintenance might well be less efficient though, because EF does a lot of work for you. Bear in mind that the cost of maintenance is very expensive.
However, I don't understand why you want to avoid models and yet use MVC. I would not recommend that approach.