There was an old saying that the baby’s shoes should be firm when learning to walk.  That is not the case, in fact the earlier the stage of walking the thinner, more flexible the shoe should be.

When you are at the store take out the shoe and bend it and see how flexible they are.  If it is hard for you to bend then you probable should leave it at the store.  Also try to stick to natural materials to allow your baby’s feet to breath.

When at all possible it is also a good idea to let your baby walk barefoot.  This helps make strong ankles  and builds the arches in the feet.