I turn it off when I’m done searing, then depending on the thickness of the meat, either finish it off on the regular burners, or for thicker cuts move it to the other side with the burner off and finish it with indirect heat until it comes to temperature. You don’t have to turn it off but if you’re not searing something you’ll be wasting gas and your grill temperature will run very hot.