You burned your screens, set up registration on your automatic carousel, and pulled your first test print—only to watch a delicate photographic gradient turn into a muddy, choked-out wall of dark ink. The skin tones look sunburned, shadow details have vanished, and the subtle 10% highlight dots washed out during screen reclaiming.
This is the classic hallmark of unmanaged dot gain combined with a mismatched Lines Per Inch (LPI) to Mesh Count ratio. In this guide, our prepress engineering team breaks down the exact mathematical formulas, screen angles, and Photoshop compensation curves required to hold clean halftones from film to garment.
1. The Physics of Dot Gain: Why 50% Film Equals 70% on Cotton
Unlike offset lithography on coated paper, screen printing is a heavy liquid deposition process. When a squeegee shears plastisol or water-based ink through polyester mesh under 30 to 40 PSI of down-pressure, three physical events occur simultaneously:
- Mechanical Squeegee Squish: The rubber durometer (e.g., 70/90/70 triple durometer) physically flattens and squashes the ink dot sideways as it shears across the stencil.
- Capillary Fabric Wicking: Ring-spun cotton and poly blends contain open fiber capillaries that suck wet ink outward along the yarn threads before it hits the flash cure unit.
- Optical Dot Gain: Light penetrates the translucent garment fibers and casts microscopic shadows beneath the ink deposit, visually making the dot appear 5% to 8% larger than its physical perimeter.
On an automatic carousel (M&R, Roq), standard plastisol dot gain ranges between 15% and 25% in the midtones. On a manual press with variable arm pressure, dot gain can easily spike past 30%. If your prepress department outputs a 50% halftone dot on film without compensation curves, it prints on the t-shirt as a 68% to 75% dark tone.
2. The Golden Mesh-to-LPI Formula (The 4.5x – 5x Rule)
To hold an individual halftone dot cleanly on a screen, that dot must be supported by at least two to three overlapping knuckles of polyester mesh thread. If the dot is smaller than the mesh aperture (the hole between threads), the dot falls through the hole or washes out during exposure.
The industry gold standard for selecting your halftone frequency is the 4.5x to 5.0x Rule:
Never exceed a 4:1 ratio unless using specialized thin-thread mesh (e.g., Sefar Smart / Murakami S-Mesh). Here is the reference chart used in professional production shops:
| Mesh Count (US) | Metric Mesh (T) | Recommended LPI | Max Resolving Range | Common Application |
|---|---|---|---|---|
| 110 – 125 | 43T – 49T | 22 – 25 LPI | 15% – 85% | Coarse vintage halftones, heavy athletic whites |
| 156 – 160 | 61T – 64T | 32 – 35 LPI | 10% – 90% | Underbase white halftones, tonal vector shading |
| 180 – 200 | 71T – 77T | 38 – 42 LPI | 8% – 92% | Detailed spot color halftones, metallic inks |
| 230 – 255 | 90T – 100T | 48 – 55 LPI | 5% – 95% | Standard simulated process color channels |
| 280 – 305 | 110T – 120T | 55 – 65 LPI | 3% – 97% | High-end photorealistic CMYK / highlight whites |
3. Dot Shape & Screen Angles: Defeating the Dreaded Moiré
Moiré is an optical interference wave that occurs when two geometric patterns clash—specifically, when the grid pattern of your RIP halftone dots overlaps with the grid pattern of your mesh threads.
Round vs. Elliptical Dots
Always specify Elliptical (Euclidean) dots in your RIP settings (Wasatch, AccuRIP, FilmMaker) instead of Round dots. Why? Round dots touch all four neighbors simultaneously at exactly the 50% tint level, creating an abrupt, harsh visual jump called “dot bridging.” Elliptical dots touch on two axes at 40% and the other two at 60%, smoothing tone transitions across human skin tones and sky gradients.
Screen Angle Locking for Simulated Process
In commercial wet-on-wet simulated process apparel printing, traditional CMYK offset angles (Cyan 15°, Magenta 75°, Yellow 0°, Black 45°) frequently cause severe moiré against 90° square mesh weave.
Senior prepress technicians prevent this by using one of two proven screen angle strategies:
- Universal Single-Angle Printing: Lock every simulated process channel (including underbase, red, yellow, blue, highlight white) to 22.5° or 61°. Because simulated process inks blend wet-on-wet on the garment rather than forming rosette clusters, locking to a single angle completely eliminates inter-screen moiré.
- The 7.5° / 22.5° Offset Set: If individual angles are preferred to reduce dot stacking: Underbase White at 22.5°, Yellow at 0° or 82.5°, Red at 22.5°, Blue at 52.5°, Black/Highlight White at 82.5°.
4. Applying Dot Gain Compensation Curves in Photoshop
If your pressroom averages a 20% dot gain at the 50% mark, you must pull that 50% value down to approximately 32%–35% on your film output. That way, when the ink squashes on the t-shirt, it expands back to the intended 50% shade.
- Open Photoshop Curves: With your spot color channel selected, press
Cmd/Ctrl + M. - Set to Pigment / Ink %: Toggle curve display from Light (0-255) to Pigment / Ink % (0-100%).
- Plot Midtone Compensation: Click at the exact 50% input point. Change the Output value to 35% (for a 15% dot gain correction) or 32% (for a 20% gain correction).
- Pin Highlights & Shadows: Set a control anchor at 5% (output ~3%) to protect highlights from disappearing, and anchor 90% (output ~82%) so dark shadows do not plug into a 100% solid field.
- Save Curve Preset: Save this curve as
M&R_Automatic_Plastisol_Compensation.acvto apply across all production runs.
Never Blow Another Screen On Test Runs
Calibrating RIP curves, calculating mesh ratios, and manually pulling channel halftones burns precious press time and film inventory.
At Orbit Design Lab, every color separation package is built by prepress technicians with hands-on automatic carousel experience. When you send us your raster art:
- Films are pre-compensated for press dot gain (no muddy faces, no plugged shadows).
- Halftone angles are dialed in to 22.5° elliptical dots for zero moiré on 230–305 mesh.
- Detailed Production Spec Sheets provide exact mesh counts, Pantone PMS ink codes, print order sequence, and squeegee durometer recommendations.
- Delivered to your inbox before 8:00 AM EST every morning.
Need Production-Ready Color Separations Tonight?
Upload your photorealistic raster or vector art before 5:00 PM EST. We will calibrate dot gain, choke your underbase, and deliver press-ready films by 8:00 AM tomorrow.