Well, your speed problem is because your smartphone charger is only supplying 5v (almost all smartphones charge on 5vdc, so they can charge off of a USB port).
Not sure where the burning plastic came from. If you're drawing 0.35A through the pot, it's going to be dissipating almost half a...