A Pastor who engages in rumors shows a lack of spiritual maturity..in my opinion. Hopefully it's just a terrible misunderstanding. Either way, I don't think it's proper to just leave without finding out what's going on behind the scenes and talking face to face. I'm going through at my church right now too but I am praying for God to change me first and then go from there. You're in my prayers!