Common paper wasps you see hanging from the window sill are one of several species of polistes wasps. This particular one illustrated is p fuscatus. Like all wasps (vespids) they start a new nest each spring and don’t use the same nest twice.
Paper Wasps (polistes)
Scioto Bee Venom Removal 