Every cell in their body is male, they would of course remain male. Gender doesn't change in reality.So of you were castrated you would cease to be a man? What would you be then?
Can you really not see how your example is different form a lady with a fake penis surgically attached??