When driving forward the caster is causing the tire to return to center.

When backing out the caster is working the opposite and is causing the tire to turn.

Hence the reason it seems to be power assisted when backing and not going forward.

Just an FYI