I keep it simple.

One drawer for up to 3/4"

One drawer for those larger that 3/4"

One drawer that very rarely gets opened for metric.