Accurately capturing time-varying human behavior remains a major challenge for real-time epidemic modeling and response. During the COVID-19 pandemic, synthetic contact matrices derived from mobility and behavioral data emerged as a scalable alternative to empirical contact surveys, yet their comparative performance remained unclear. Here, we systematically evaluate synthetic and empirical age-stratified contact matrices in France from March 2020 to May 2022, comparing contact patterns and their ability to reproduce observed epidemic dynamics. While both sources captured similar temporal trends in contacts, empirical matrices recorded 3.4 times more contacts for individuals under 19 than synthetic matrices during school-open periods. The model parameterized with synthetic matrices provided the best fit to hospital admissions and best captured hospitalization patterns for adolescents, adults, and seniors, whereas deviations remained for children across both models. Neither matrix allowed models to fully reproduce serological trends in children, highlighting the challenges both approaches face in capturing their disease-relevant contacts. The weekly update of synthetic matrices enabled smoother reconstructions of hospitalization trends during transitional phases, while empirical matrices required strong assumptions between survey waves. These findings support synthetic matrices as a reliable, flexible, cost-effective operational tool for real-time epidemic modeling, and highlight the need for routine collection of age-stratified mobility data to improve pandemic response.