“That's a problem," noted the late night host.