The title comes from the title of a George M. Cohan song about New Rochelle, NY.
The movie intentionally mirrors a stage play, especially the main set (inside the country house).
David Proval plays an unsuccessful character-actor, and he mentions never making it big like Robert De Niro. In real life, Proval co-starred alongside De Niro in Mean Streets.