Here's a story.
my brother is an engineer with Caterpillar. Caterpillar once made most of the HD on-road truck diesel engines on the planet. (They left the market when emissions regulations became too stringent - a decision my brother still sees as a huge mistake.)
Anyway, Caterpillar did a big study with oil and oil changes, and found that in most cases, changing the oil filter with every change introduced MORE dirt into the engine than changing every other time. The source of most of the additional dirt was due to a lazy mechanic/technician who failed to clean around the filter mount. When they went to slap the filter on, they'd knock dirt into the filter cavity, which found its way into the oil. To reduce wear/increase oil life, they recommended filters every other oil change.
He is a materials engineer, and did some of the analysis.
Personally, I swap them every time, but clean around the filter before removing it to minimize dirt finding its way to new oil.