You're right, but the President's power is what makes the idea unworkable. The Prime Minister must perform well at Question time because if he does not maintain the confidence of the House of Commons, he loses is job. The President, on the other hand, could tell the House of Representatives to go to hell, and be in no such danger. The Speaker (in the US, that is) is a lot closer to the PM than the President is.