So-named because the fancy suitcases/satchels they carried (fashionable, at the time) were made of material that looked like "carpet."

So, anyone similarly outfitted (with Northern fashions) was termed a carpet-bagger.