Prince Harry has jokingly compared life in the royal family to starring in the TV series Downton Abbey.