An issue with mail delivery caused some emails to be dropped. Upgrades to our mail server caused authentication to unexpectedly and silently fail, and it took some time to detect. During this period, ticket submission to todo.sr.ht failed, and emails were not forwarded from lists.sr.ht. You can thank Oracle for changing the license terms on Berkely DB, which had wider reaching consequences than we expected. (19:00 UTC — Jan 21)
An issue with our upstream ISP caused an outage. Our ISP decided to ring in the new year by unplugging us for 12 minutes last night. Sorry about that. (09:03 UTC — Jan 8)
The issued was addressed without disruption. While investigating the cause of disk growth, an error with our ZFS snapshot retention policy was found to be the cause. The disk space was trivially reclaimed without incurring an outage. (15:50 UTC — Oct 8)
Advances in the pace of disk usage on git.sr.ht has increased the urgency of a planned migration. On September 18th, we were tracking the growth of git.sr.ht disk space usage up to an expected disk space exhaustion in November. However, in the intervening time, the rate of growth has accellerated and we are now urgently seeking to migrate to a server we have prepped with more storage space. This may cause disruptions as git.sr.ht may become read-only during the migration process. (15:00 UTC — Oct 8)
Maintenance complete. Depending on how soon your DNS server picks up the updates, you should find service restored shortly. (21:00 UTC — Jul 29)
We’re still waiting on the latest data to transfer from the old server to the new. It is taking longer than we expected. The process is about halfway complete. We apologise for the delay. (19:00 UTC — Jul 29)
Maintenance may require more time than expected. (17:50 UTC — Jul 29)
Planned maintenance has begun. (17:00 UTC — Jul 29)
Planned maintenance on July 29th will cause an hg.sr.ht outage: At 17:00 UTC on July 29th, we will conduct planned maintenance on hg.sr.ht to migrate the primary server to newer hardware. It is expected to take no more than an hour, during which time hg.sr.ht will be available in read-only mode. (17:00 UTC — Jul 29)
An unexpected Redis failure caused a partial outage of git.sr.ht
The git.sr.ht web service was partially interrupted today due to unexpected Redis errors. Some pages which rely on Redis for caching returned 500 errors, namely the summary and tree pages.
The issue has been resolved. To prevent its recurrence, we have filed a ticket to make our caching system more tolerant of Redis outages, and added an alarm to detect this kind of issue earlier. (12:07 UTC — Jun 28)
Planned maintenance is complete. (19:07 UTC — Jun 15)
Planned maintenance is underway. (18:00 UTC — Jun 15)
Planned maintenance on June 15th will cause intermittent outages: Planned maintenance will affect all services, causing intermittent outages that are expected to last between 15 and 30 minutes at most. (18:00 UTC — Jun 15)
Planned maintenance is complete. There may be some residual issues. (18:00 UTC — Mar 11)
Planned maintenance is underway (16:00 UTC — Mar 11)
Planned maintenance on March 11th will cause intermittent outages: Planned maintenance will affect all services, causing intermittent outages that are expected to last between 15 and 30 minutes. (19:00 UTC — Mar 5)
Maintenance complete Service has been restored. (16:30 UTC — Jan 8)
Maintenance has begun: This maintenance is now underway. (16:00 UTC — Jan 8)
Planned maintenance on January 8th will cause a total service outage: We have scheduled maintenance for next Wednesday at 16:00 UTC to perform normal database maintenance. We expect a total outage of all services which should last no more than 2 hours. (16:00 UTC — Jan 8)
A planned upgrade hit unexpected errors: We are working on a solution. (19:00 UTC — Dec 22)
Migration complete pending DNS propegation: The migration is completed and all service is restored. However, you may not see service restored until your DNS provider finishes processing the updates. (17:45 UTC — Dec 20)
git.sr.ht is now read-only: We’re in the thick of the migration now. Write access should be restored within an hour. (17:30 UTC — Dec 20)
Planned upgrades to git.sr.ht will impact availability: We are planning on moving git.sr.ht to a new server today. The service may be read-only at times during this process. (14:30 UTC — Dec 20)