Yes. but it will take longer and kill your bits in no time.
The idea behind drilling masonry is not so much cutting like woods or metal but rather knocking the tiny aggregate a part.
Essentially, you need a bit, shown in replies above, that has multiple edges thats rough and hard (not sharp). This is the idea behind the infamous tri-cone drill bits developed by Howard Hughes (Baker Hughes) bc drilling impervious rocks at fast rate is to impact it and not "cut" it. Therefore, you would use hammer drills w/ those masonry bits.