The last few days we fixed some bugs in our frontend code. Our logs, however, shows that a surprisingly large amount of users still have these bugs. Why? Why do we keep getting logs about bugs we already fixed and deployed? It's not a caching issue so what have we missed?
How widespread is this? We ran a query to find out, and got this table for the last 24 hours:
|2 days ago||2536|
|8 days ago||79|
|12 days or more||43|
So a substantial amount of users didn't reload their page, but stayed active on the site, for at least two days. A few people run a two week old version!
The lesson learned is that releasing a new version to servers does not guarantee that the users get the new version. This is common knowledge for mobile applications but it applies to web applications as well.