The scene where Fred Astaire and Ginger Rogers dance on roller skates took about 150 takes, according to one of the VHS versions of the film.
At the end of the roller skate dance number in the park, the stars flop onto the "lawn". In the film, both Fred Astaire and Ginger Rogers appear uncomfortable as they get up. This is because both were bruised from more than 15 earlier takes and were actually in pain.
After George Gershwin's move into symphonic pieces, such as Rhapsody in Blue and American in Paris, as well as the blues opera Porgy and Bess with brother Ira Gershwin, many in the industry felt that the Gershwins had lost their touch for comparatively simple pop tunes. They responded by creating not one, not two, but three classics of the American songbook for this picture: They All Laughed, Let's Call the Whole Thing Off, and They Can't Take That Away From Me.
The original song "Shall We Dance" was written by George Gershwin and Ira Gershwin for this film. A different song with the same title was written by Richard Rodgers for the show The King and I.