If you no longer want to use a device to authenticate with PingID, you need to unpair it.
You can unpair devices from your account portal My Devices page.
CAUTION:
If you remove all your paired devices, you might be blocked the next time you try to sign on (unless your organization's configuration allows users to register a new device during authentication).