Luckily i had bought new bushes to recon the one i had taken off. So i stripped it back down and installed them.
Then swapped them over and the car started on point
Just taken the replacement starter motor apart and the same issue is there. 2 of the 4 bushes have worn away to the point that they no longer touch the internal spline.
Nice easy cheap repair for anyone else that has this issue!
I took all the magnets out and cleaned off all the carbon off them and inside the casing. Then swapped the old part for the new part and bingo its a reconed starter motor.