If you belong to Ravelry, search in the "Yarns" section. Someone might have some they're willing to give away/trade/sell.
Or try one of the online shops that specializes in discontinued yarn. Here's one:
http://www.discontinuedbrandnameyarn.com/
Does the beret design lend itself to ripping back a bit and adding a stripe of a different color?