I'm also in ma, I call those paper wasps... I just took down a small nest last week and it was empty.
I would poke it with a long stick just to make sure it's empty BEFORE you scrape it off!
If there is any activity after poking, douse the whole nest with the jet type hornet spray, when the...