For me, the closest track is 2.5 hours away. For what it costs in time and dollars to take a car to the track for 3 or 4 runs, its just not worth it. If there was a track within an hour or so, I would be more inclined to go racing.
Instead, I have been building a street car that won't be as fast, but at least I will be able to enjoy it regularly.