That countertop is pretty thick. Most flush trim bits that tall are going to deflect some.

Taking off 1/4" isn't very much. If it was me I'd just use my handheld belt sander, an assortment of coarse, medium, and fine belts, and some patience.

The belt sander will be very forgiving and allow you to move to finer girts as you get close to flush.