The Problem with Big Families