Not at all. The phrase "Oh yes you are" is very often used in pantomime, followed by "Oh no, we're not" etc etc. Or variations on a theme (but not by Paganini). It's used to get the audience of kids joining in.
Whereas your earlier statement was completely unrelated to what had come before. See? That's what Non sequitur means.