I personally wouldn't drill another hole. As Feets mentioned, the bolt should handle the slightly higher torque. If you didn't want to do that, other option to me would be to use a hardened washer until the nut to help line up the slot under the correct tension.