In other words: “you both” is like saying “He himself said that”; therefore, “you both said that.” Executive summary: “both of you” is the normal, grammatical expression; whereas, “you both” is used for extra emphasis. Both are grammatically correct.