Making artwork and toys from caps that would normally be thrown away immediately the bottle was empty of liquids is a great idea. As plastic takes a long time to degrade there are plenty of opportunities for children and adults to make creative designs and either play with them as toys, or display them as pictures, wall hangings etc.
Maybe you can hold an annual competition and offer merchandise as gifts to whoever makes the best recycled piece of artwork?