No your child does not have to be under 21 to qualify you as Head of Household, if you are unmarried at the end of the year and pay for more than 50% of the household cost for the child or relative that lives with you then you qualify for the Head of Household filing status.