Depends on what style you have. Mine, you back out the little bolt with the allen key head on it, drive out the plate that bolt runs through, and the caliper falls off.
Remove the bolt near the bottom. Be carefull not to break it. Then beat out the little wedge near the bolt. Now it's loose, but sometimes it sticks, so have to pry it off.