I started with a simple basket that my friend had given me.
All I did was wrap some ribbon that I had purchased at the Dollar Tree around the basket and around the handle. Since mine will only be on display I did not bother gluing the ribbon down (it will make it super easy to remove), but if you're planning on letting a child use it for egg hunting I would recommend using hotglue or tacky glue to adhere the ribbon.
Then you can fill it up with some sweet treats!
Was that easy or what? And it only cost $1!