Sourcehut

[Resolved] Planned outage for August 1st

The maintenance window has been cancelled. A new maintenance window will be planned in the next few days.

A planned maintenance window is scheduled for August 1st. At 11:00 UTC we will be rolling out upgrades across our fleet. This is expected to cause intermittent partial outages between 15 and 30 minutes affecting all services. Follow this page or #sr.ht on IRC for updates.

[Resolved] Build queues are backed up

Build queues are full and wait times are expected. Due to a minor issue with our build servers, build queues were unprocessed for a couple of hours this morning. The system is catching up with pending builds now, but wait times may be higher than normal for the next hour or so. (08:00 UTC — May 27)

[Resolved] Planned maintenance will require service interruptions

Planned maintenance is complete. We have completed all planned upgrades and restored all services to normal working order. Please let us know if you notice any lingering issues. Thank you for your patience. (15:15 UTC — Mar 20)

The maintenance window is open. Planned maintenance is now underway. (12:00 UTC — Mar 20)

Planned maintenance this Wednesday will require service interruptions. We are planning upgrades across our fleet on Wednesday, March 20th, which will require service interruptions to complete. Some services are expected to be briefly unavailable for up to 20 minutes each across the duration of the maintenance window. (16:00 UTC — Mar 18)

[Resolved] Registrations are temporarily disabled

User registrations are open. We are now accepting new users once again. (12:00 UTC — Feb 18)

User registrations are currently disabled. We are not accepting new user accounts until we are able to deploy more effective mitigations with respect to an ongoing spam attack. (20:00 UTC — Feb 17)

[Resolved] Planned maintenance for pages.sr.ht

Planned maintenance is complete. Full service is restored. (14:03 UTC — Jan 23)

Planned maintenance is underway. (14:00 UTC — Jan 23)

We are planning a brief interruption in service for pages.sr.ht. At 14:00 UTC we intend to place pages.sr.ht into a read-only mode to complete the last steps for its migration following the incident earlier this month. We anticipate no more than 30 minutes of downtime. (14:00 UTC — Jan 23)

[Resolved] Network outage

Update 2024-01-17 10:30 UTC: full service has been restored.

Update 2024-01-16 19:45 UTC: builds.sr.ht is now running at full capacity.

Update 2024-01-16 18:00 UTC: builds.sr.ht is now available for full service. We are running it at half of the planned capacity, with the remainder coming online shortly, so you may experience longer queue times while waiting for builds to be processed.

Update 2024-01-16 10:30 UTC: Our priority for today is to bring builds.sr.ht and chat.sr.ht online, as well as address a number of less user-impacting tasks we have on our todo list.

[Resolved] Ongoing DDoS

The services are online and working. We have been monitoring the mitigations we put in place last night and, though we’re still tying off some loose ends, all services should be available for users. (07:00 UTC — Apr 21)

A distributed denial of service (DDoS) attack on sr.ht is underway. We have identified the source of the networking issues as a denial of service attack and we are deploying a mitigation. (19:10 UTC — Apr 20)

[Resolved] Planned outage

Planned maintenance is complete. Normal service is restored. Thank you for your patience. (16:00 UTC — Mar 22)

Maintenance is underway The maintenance window is now open. (14:00 UTC — Mar 22)

A planned outage is scheduled for March 22th. At 14:00 UTC, we plan to perform system upgrades across our fleet. This will cause intermittent outages which are expected to last 15-20 minutes each, over the course of 3 to 4 hours in total.

[Resolved] Unreachable database host

Service restored. We have migrated the database to a temporary host and brought our services back online. We had to use one of our build servers to host it for the time being, so our build system is operating at half its normal capacity – you may notice longer-than-usual build times while we roll out a permanent solution.

Thank you for your patience. (17:00 UTC — Jan 11)

Investigating. We have a technician on-site and are diagnosing the issue further. (15:47 UTC — Jan 11)

[Resolved] Planned outage for high-risk deployment

Service has been restored. Webhooks are now being processed and the backlog has been completed. (00:00 UTC — Oct 27)

Service has mostly been restored. We are still running some migrations which must complete before we re-enable webhooks, but most services are functional. (13:00 UTC — Oct 26)

Maintenance is underway. The maintenance window is now open. (09:00 UTC — Oct 26)

This maintenance window has been rescheduled. It will now take place on Wednesday, October 26th, at 09:00 UTC.