Simple solution, designate a draw or cupboard and keep all your chargers in it. You will know where to find it then, and after using the charger put it back where you got it from straight away. If you travel from home and need a charger to take with you then buy a second charger and keep it in your camera bag and (you guessed it!) put it back in the bag immediately each time after use. Look after your kit and it will look after you. As an old chap once told me when I was an apprentice, "Always work clean and tidy or you'll end up in the Sh*t!".