As shown here, the skirt is where the ribs angulate off to the side. Therefore I assume that the "skirt" is actually (consists of) the abdominal muscles and I spent a whole year dissecting human cadavers.
Here's a good chart on cuts of beef..... I think you are right about where it comes from. Does Letterman still do that skit with the audience; Do you know your cuts of beef?