How do I turn on or off an upsell?

If you no longer want an upsell to display on your store you can put it into draft mode by clicking UNPUBLISH.  If you want to turn the Upsell back on you can click on PUBLISH.