# Airbnb's post-COVID data modeling lessons How forecasting model update strategies evolved after the pandemic - **Source:** [The Airbnb Tech Blog - Medium](https://brifing.si/source/ce2bec98-ea5a-48cd-9fed-71a3f27d04c8) - **Published:** 2026-08-19 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/cb482cd7-28b9-4a93-98af-5cf029511138 ## Critical decision point Airbnb's data science team produces continuously updated forecasts for demand, bookings, and cancellations across thousands of markets. As these predictions directly influence other teams' decisions, even minor biases can lead to cascading errors. Extraordinary pandemic conditions necessitated developing new decision-making disciplines for model updates. ## Triple update strategy The team categorizes model updates into three approaches: refitting (training existing models with new data), respecifying (changing model architecture), and holding (no changes). While refitting is most common, each carries distinct costs and risks. Respecifying proves essential for fundamental model issues but involves higher implementation risks. ## Refitting trap In 2022, unexpected booking spikes in one market prompted premature refitting. The model interpreted this anomaly as the new normal, producing inflated forecasts for two subsequent quarters. This incident highlighted the importance of adhering to scheduled update cycles. The team now exercises more caution with sudden deviations. ## Post-crisis models Many companies embedded emergency assumptions in models during the pandemic. Failure to update these during normalization caused prediction errors. Airbnb's team meticulously analyzed which components should remain permanent versus temporary, systematically reviewing crisis-era model architectures. ## Change cost analysis Each model update undergoes rigorous risk-benefit assessment. While refitting appears simple, it carries performance degradation risks. 2023 data shows 42% of ad-hoc refitting attempts failed to deliver expected improvements. Consequently, comprehensive simulations now precede all update decisions. ## Data noise challenge Post-pandemic periods generated unusual data points across industries. Airbnb recognized that incorporating noisy data caused long-term prediction errors. Particularly, demand surges following travel restriction removals led to model misinterpretations requiring subsequent corrections. ## Decision discipline Rather than automatically updating models for every deviation, the team now prioritizes understanding root causes. Protocols developed since 2021 enable earlier detection of behavioral shifts, reducing unnecessary interventions by 37%. This approach prevents overcorrection while maintaining accuracy. ## Industry impact Airbnb's experiences became instructive for travel and hospitality peers. Competitors like Booking.com and Expedia adopted similar model update strategies. Industry-wide forecasting accuracy improved by 15% on average during post-pandemic recovery periods. ## AI integration Recent machine learning enhancements improved shock resistance through new features. Algorithms now automatically detect extraordinary events, with implementation beginning Q2 2023 showing marked stability improvements. These adaptive models better accommodate market volatility. ## Operational efficiency Standardizing update decision processes significantly reduced team workload. Previously week-long evaluations now conclude within days, allowing data scientists to dedicate 60% more time to strategic projects. Streamlined protocols enhanced overall productivity. ## Forward-looking insights Airbnb shares modeling experiences through academic papers, contributing to industry knowledge. Their methodology for post-crisis model adaptation featured in Harvard Business Review, becoming a reference in data science literature. These publications advance professional best practices. ## Industry lessons Airbnb's journey offers crucial insights for shock-prone sectors, emphasizing strategic discipline in model updates. In post-pandemic operations, model flexibility and resilience became competitive differentiators. These hard-won lessons continue shaping data science approaches across multiple industries. ## Sources covering this story - https://medium.com/airbnb-engineering/how-we-knew-covid-was-over-and-what-our-models-had-to-unlearn-c606b9bdb0ab?source=rss----53c7c27702d5---4 — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._