Never go on a backpacking trip alone on your first time. Always go with a group or an experienced backpacker. (Safety in numbers.)
Wal Mart has a lot of supplies in the hunting section. Amazon and Ebay have a lot as well. Dollar stores have a lot of small packages foods and supplies that are great for a back backs too. I get most of my supplies from Dollar Tree and Fred's.