Have a tag made for the gawkers and keep the original.
This is how tags are lost. Why remove a tag just because the car's painted a non-original color? If anything, at some point you'll hear from the grapevine that your car's pedigree is suspect because of a "funny" tag.