That must be it the #13 sear pin. In the diagram, the pin the hammer pivots, #18, has one larger end.
The hammer pin is what I thought it was originally before I seen the diagram. It had to be the hardest place.
I think I'll just leave it for now and change it when I put in the new hammer and spring.