Did you try to jump across the starter relay terminals? Are your batery terminals tight and clean. Everything can work fine but if the terminals are marginal or the grounds bad (you do have a ground from the back of the engine to the fire wall?) the starter may just click.
Can't be the neutral safety switch if the starter clicks.