Are you 100% sure that the comma after yes was in the original quote? If you are, how do you know that the second comma was not?
Of course, do whatever you like. Generally we separate the speaker from the spoken words with a comma. That is why we say, He said, "Yes, I feel similarly." In that case, though, the comma is outside of the quotation marks and, thus, not breaking your self-imposed rule.