Felted purses can be really, really easy, very fast and fun. I've made a bunch of different kinds. I started with very basic ones. Most recently I made the Booga Bag, which is a free pattern available online. Yes, you have to pick up stitches, but with this pattern it isn't hard at all. The pattern mentioned something about twisted stitches, which I just ignored rather than look it up...and it all turned out fabulously in spite of it. The beautiful thing about felting is that the felting process erases most errors....
With the booga bag I made a twisted cord rather than knit I-cord. I'm too impatient for that I-cord stuff most of the time. Plus, with the Noro Kureyon yarn, I like the look of the twisted cord way better.
There are a couple of good felting books out there with fun ideas in them. As I tend to recommend often...check your local library. Libraries are AWESOME places with FREE information. It's so incredibly cool.