Concordance between parent-reported and documented COVID-19 vaccination status among hospitalized children and adolescents: Implications for vaccine effectiveness estimates, May 2021-October 2023.

BACKGROUND

During the U.S. COVID-19 Public Health Emergency (PHE), healthcare providers were required to report all administered COVID-19 vaccines in Immunization Information Systems (IIS), a key data source for vaccine effectiveness (VE) evaluations. Expiration of the PHE and commercialization of COVID-19 vaccines raised concerns about IIS data completeness. Parental report is an alternative source of vaccination data but might be inaccurate.

METHODS

Using VE surveillance network data during May 2021-October 2023, we compared parent-reported and documented COVID-19 vaccine doses for patients aged 5-18 years admitted to 35 hospitals in 25 states, overall and by case/control status. We calculated percent agreement, kappa, sensitivity, specificity, and positive and negative predictive value (NPV) of parental report. We compared proportions of patients with discordant vaccination history by demographics and incident SARS-CoV-2 infection status. We estimated VE separately using parental report and independently documented sources.

RESULTS

Among 3262 patients, agreement between parent-reported and documented COVID-19 vaccination doses was 88 % (kappa = 0.77). Most discordant pairs (346/390) were because of parental over-reporting of doses. Among patients documented as unvaccinated, most (specificity = 90 %) were reported as such by parents; nearly all reported as unvaccinated by parents had no documented vaccination (NPV = 99 %). Discordance decreased with shorter admission-to-interview intervals and varied regionally from 8 % in the Midwest to 16 % in the West. Proportions of discordant reports were similar between patients with and without SARS-CoV-2 infection (11 % vs 13 %). Median days from last vaccine dose to hospital admission was 167 (IQR: 86-288). VE of two doses (99 % original formula) against COVID-19-related hospitalization was 58 % using documented sources and 60 % using parental report.

CONCLUSIONS

Parental report of COVID-19 vaccination agreed strongly with documented sources, especially among unvaccinated patients. Despite discrepancies from parental overreporting, VE estimates from both sources were similar. As reliance on parental report increases, reducing admission-to-interview time is important for accurate vaccination history.