Brifing

Spotify Podcast Publishing Delay Report

Issues in video podcast publishing and the resolution process.

Spotify Engineering1 min

1The Start of the Issue

Podcast creators on Spotify experienced delays in publishing video podcast episodes on June 24. This issue began when the video transcoding infrastructure reached maximum capacity. Episodes that normally publish within minutes were delayed for hours. Creators, noticing their episodes were not appearing, re-uploaded content, adding further strain to the system.

2Causes of the Issue

Four main factors contributed to this situation: The transcoding infrastructure lacked sufficient capacity to handle large content spikes. A scheduled batch processing job consumed additional capacity. Recent quality improvements in video transcoding increased processing time. A software bug underutilized available compute resources. These factors combined to overwhelm the system.

3Resolution of the Issue

Once the issue was identified, the batch job was stopped, and the software bug was fixed. Additional processing capacity was added overnight, and by the next morning, all backlogs were cleared. Spotify aims to be prepared for future traffic spikes by increasing transcoding capacity by approximately 67%.

4Monitoring and Notification Improvements

Spotify is enhancing its monitoring systems to receive earlier alerts when capacity limits are approached. Additionally, it is improving notification processes to ensure creators learn about issues as soon as possible. This will allow creators to be informed before their audience notices any problems.

5Future Measures

Spotify is taking various measures to improve the reliability of podcast publishing processes. These include better capacity planning, prioritization improvements in publishing systems, and rate-limiting mechanisms to manage unexpected loads. These measures aim to prevent similar issues in the future.

6Conclusion and Regaining Trust

Spotify acknowledges losing creators' trust due to the issues experienced this summer. However, it aims to regain that trust through the measures and improvements implemented. Better management of the next incident will demonstrate that this report has achieved its purpose.

Original article: Spotify Engineering — Spotify'da Podcast Yayın Gecikmesi Raporu