Usually there's a pair of trim plates that mount to upper half of the door extending onto the jamb, and lower half of the jamb (from pivot down) that the door closes against. I've added foam tape to those before to improve the draft seal for those of us in northern climates.
Personally I hate brush seal - it's pretty much my last resort in all cases.