How do I tell if fish is fresh?

There is a fish market near my house that sells a lot of fish, but I am not sure how good it is. What do I look for when buying whole fish? Fillets? (Specifically catfish, salmon, red snapper.) What about , scallops and oysters? What do I avoid? I don't want to poison anyone!