There has to be a dramatic reason why the third character is in the poem.

Perhaps because Yeats felt that Gonne would never say something like

"To be born woman is to know —
Although they do not talk of it at school —
That we must labour to be beautiful."

Also, as someone noted, having three people in the scene makes an academic discussion of poetry more plausible than if it were only the speaker and his former lover.