Most fire extinguishers will have a pictograph label telling you which types of fire the extinguisher is designed to fight.

For example, a simple water extinguisher might have a label like this: