Use a soft wire brush and some cleaning element like alcohol or whatever you have around that that's a non-acetone and won't eat the plastic.
In the future, avoid leaving batteries in your controller, or any devices, when you aren't going to use it for long periods of time.