prevention steps for the future: added an additional node to the cluster, upped the replica count for sidekiq and streaming to 2 for better redundancy against single node failure. I have a generic monitoring/alerting solution written out, but haven't yet deployed it on this cluster, oops! Will get that deployed so I get better mobile downtime alerts on triggers like frequent pod restarts, 0 available replicas in a set, or no endpoints for a critical service.

Sign in to participate in the conversation is a paid signup Mastodon instance funded directly by users purchasing accounts for just $5. An inexpensive alternative to free signup platforms, we impose direct economic cost on trolls who want to avoid blocks by creating many accounts. This instance will actively respond to any problematic users.