Like you, I’ve had a hard time with this as well. I’m guilty of just leaving them in my phone.