A shard is an ultra-cool broken piece of china, glass, ceramic, etc.
A sherd is a boring broken piece of pottery, typically found in an archaeological site.