Before I got my one-handed clicker-type little red row counter, I used coins!
I usually work at one end of our sofa and I have a little tray next to me. I'd put out some pennies on the tray and then move one over to the other side as I finished the row.
If you've got to count rows AND stitches, you could use nickels for one and pennies for the other.
And save your quarters for buying more yarn!
Hope this helps.