I had a similar problem on my 54 235 starter. The problem was the ground at the brushes had become poor. That caused a very small arc between the brush and the brush holder that held the brush from the commutator. Cleaned all that up and have continued using a 6v starter on 12v for more than 7 years.