Small body size exacerbates the extinction vortex