School closures during the COVID-19 pandemic have interfered with children's learning. The aim of this study was to investigate the difficulties in managing children's learning at home and attending afterschool learning programs and their related factors among caregivers of children with attention-deficit/hyperactivity disorder (ADHD) during the COVID-19 pandemic. In total, 252 caregivers of children with ADHD completed a questionnaire collecting difficulties in managing children's learning, parenting styles, children's worsened symptoms of ADHD, oppositional defiant disorder (ODD) and emotion, and increased Internet use. Multivariate logistic regression models were used to examine the factors related to caregiver difficulties in managing children's learning and children's worsened ADHD, ODD, and emotional symptoms. In total, 85.3% of the caregivers had difficulty in asking their children to learn at home; 28.2% had difficulty in taking children to afterschool learning programs. Children's worsened anger was significantly associated with higher caregiver difficulty in asking children to learn at home, whereas parental overprotection was significantly associated with lower caregiver difficulty in asking children to learn at home. Worsened hyperactivity and opposition were significantly associated with higher caregiver difficulty in taking children to attend afterschool learning programs. Interventions for enhancing caregivers' skills to manage children's learning and children's behavioral and emotional symptoms should take the related factors found in this study into consideration.