Why, certainly there is a downside. The car will get better mileage and you may find yourself in some discomfort waiting for the fuel level to drop far enough that you can stop and take a trip to the restroom. Also you may drive right past the one (in)convenience store with a smokin' hot lady behind the counter.

Other than that I can't see any downside.

R.