I'd want it flatter as well. If you don't want to use self leveling compound, consider a product called Feather Finish for the low spots. You can get the Henry brand at Home Depot. I used it on my kitchen/dining room floor when I installed some floating vinyl planks. Easy to work with.
DC