What I wanted to attack was the question of whether one could, without killing the A.I., change its personality in the right way, and what it would entail.
To hit on this completely different other point ... it sounds very much here like you're trying to work on the question of the essence of self.
At what point in the modifications has the programmer killed the old program, and replaced it with a new one? How many changes can you make to something before it is no longer essentially the same thing it started out as?
How much can we change our own behaviors and thought patterns, as we grow and mature, before we stop being the people we used to be?
Re: Speculation...
To hit on this completely different other point ... it sounds very much here like you're trying to work on the question of the essence of self.
At what point in the modifications has the programmer killed the old program, and replaced it with a new one? How many changes can you make to something before it is no longer essentially the same thing it started out as?
How much can we change our own behaviors and thought patterns, as we grow and mature, before we stop being the people we used to be?