One of our web servers in the load balancer stopped communicating with Memcached and was querying the database on every request. At 30 Million requests per day, that’s a bit much for a database to handle.
Resolved - We believe all users experiencing issues have been able to connect at this time. (Aug 21, 2018 - 21:20)
Update - Slow and intermittent connections are still being experienced and we continue to investigate. (Aug 21, 2018 - 19:14)
Monitoring - After stopping the Package Validator and Verifier we will continue to monitor the status of the services. (Aug 21, 2018 - 18:57)
Update - We will be temporarily stopping the Package Validator and Package Verifier to reduce load on the website and database. (Aug 21, 2018 - 18:40)
Monitoring - After performing maintenance on the packages database we will continue to monitor the status of the services. (Aug 21, 2018 - 17:02)
Update - The database has been taken down for a short period while we perform maintenance. (Aug 21, 2018 - 16:30)
Investigating - We’re aware of users experiencing slow and intermittent failed connections to the website and to both package repositories. We’re currently investigating. (Aug 21, 2018 - 16:01)