You are at the end of the life of the copper pipes. You are on a well which I suspect acid water is eatng the pipes. I would suggest replacing with CPVC or pex and make sure the pipes grade back to a central drain. Shutting off the water is a good idea as it limits the amount of potential damsge but is not fool proof.