When wasp nests are found close to where people are active, the nests should be eliminated to minimize the risk of stings ... rid of yellow jacket and paper wasp nests it is best to treat them ...
However, given that wasps and yellow jackets can sting you more than once, you may have several bites. Treatment is the same as how you would handle a bee sting — wash the area with mild soap ...