Beer bottle pins

How do I make pins out of beer bottle caps? I uasally glue on the safety pins with hot glue but they keep falling off. Would tape work, and also what else could I use to attach it that I prolly have laying around my hose?