Weird wasp like bug building nests

There are weird wasps down here that have long tails and don't bite apparently but they build really strong nests.  There was one up in the corner on the back deck and one on the cushion of one of the chairs.  It was hard not like the cone ones back home.  It was like a rock with a hole in it.

we could just pick it off and throw it away

These are the wasp like characters...they kept coming looking for their home