I use the little white rings that would go on curtain rods - when my parents remodeled and were tossing them, I pulled them all off and they work great - just little plastic circles, but they were free.
I'm always looking for inexpensive alternative tools.
For small stitch holders, I use paper clips partially unbent.