Select and Mask is a Photoshop workspace for refining a rough selection into a clean cutout, especially around hair, fur, and soft edges. Make a first selection, open the workspace, refine the edge with the brush tools, and send the result out to a layer mask so your work stays editable.

How to Use Select and Mask in Photoshop for Complex Cutouts

Prepare the Selection

Begin with the Object Selection tool, Quick Selection tool, or Select Subject to get a rough outline. Perfection is not needed here. Then choose Select and Mask from the Select menu or the options bar. Photoshop opens a workspace with tools on the left and Properties on the right.

Step-by-Step Workflow

  1. Pick a View mode from the dropdown. On Black and White or Overlay views, you can see weak spots. A view that matches your future background is best.
  2. Choose the Refine Edge Brush tool and brush over hair and fuzzy borders. The tool detects fine detail and adds it to the selection.
  3. Use the Brush tool to add missed areas, and hold Alt (Option on a Mac) to subtract areas that were picked by mistake.
  4. In Global Refinements, use Smooth for jagged edges, Feather for a softer transition, and Shift Edge to pull the border inward or outward by a few percent to remove halos.
  5. Try the Edge Detection Radius at a small value, roughly 2 to 10 pixels, and enable Smart Radius if hair is mixed with a busy backdrop.
  6. In Output Settings, turn on Decontaminate Colors to remove color fringes from the old background.
  7. Set Output To New Layer with Layer Mask, and click OK.

Handling Tricky Edges

  • Hair against a light sky: the cutout often keeps a bright fringe. Use Decontaminate Colors and a small negative Shift Edge.
  • Fur and feathers: work with Refine Edge Brush in short strokes, and avoid heavy smoothing, which erases detail.
  • Glass or transparent items: a selection may not be enough. Consider adjusting the mask opacity by hand.
  • Sharp products: skip the radius tools and keep Smooth low, so straight edges stay straight.

Check the Result

Place the cutout over several backgrounds, one light and one dark, and zoom to 100 percent. Halos and leftover fringes show up quickly. Because the output is a layer mask, you can brush black to hide or white to reveal further edges at any time.

FAQ

Should I output to a selection or a layer mask?

A layer mask is usually better, because it is non-destructive. A plain selection cannot be changed once you move on.

Why does the cutout look pasted on?

Often the lighting or color of the cutout does not match the new background. Match tone and color with adjustment layers clipped to the cutout, and add a soft shadow for a believable placement.

The Short Version

Create a rough selection, refine hair and edges with the Refine Edge Brush, decontaminate colors, and output to a layer mask. Test against light and dark backdrops, and match the lighting before you call it finished.