What is the distinction between a sacrament and an ordinance?

I have observed that Catholics and some other denominations call certain things they do "sacraments", and Protestants call certain things they do "ordinances". I am not a Christian, but as an outsider, it seems that these things (like the symbolic drinking of wine in church) appear very similar. What is the difference between "sacraments" and "ordinances"?