I agree with the others, call the police. There have been numerous news stories over the years of scam artists who go door to door signing people up for home repairs and improvements. They take a down payment of as much as they can get and then disappear.
"Never doubt that a small group of thoughtful, committed citizens can change the world. Indeed, it's the only thing that ever has."--Margaret Mead