Yes, some mini-splits also have heaters, but I've found some window units that have heaters as well. Being in Texas, heat isn't that big of an issue for me.
This was my original idea, and the cleanest solution. Unfortunately, the smallest mini-splits made are 9,000btu, and that's way too big...