Local timeline
Sorry guys, we're limiting user registrations again. Servers are still scaling & very happy but need to consider the long-term cost to keep this thing sustainable.
Its been a long day and I'm going to spend some time with the family. Please don't break stuff while I'm gone 🙏
#devops statistics of #tootcommunity for the last 6 hours:
- 4.33 million requests (+61.1% increase)
- 151.9 GB transferred (+64.5% increase)
- 53.8k page views (+81.6% increase)
Servers right now: :partyparrot:
Welcome to all new users of #tootcommunity 👋
There's great documentation available how to use the #fediverse here: https://fedi.tips 📚
We're run on volunteers and don't show ads or sell your data. Please consider contributing:
Ko-Fi: https://ko-fi.com/jorijn
Patreon: https://www.patreon.com/tootcommunity
#devops statistics of #tootcommunity for the last 6 hours:
- 2.45 million requests (+50.6% increase)
- 86.03 GB transferred (+22.9% increase)
- 27.5k page views (+57.1% increase)
Woke up to the database server having a very hard time. We've scaled up again for everyone joining the #fediverse
Handling the influx of new users perfectly right now. Welcome all new people on #tootcommunity 👋
#tootcommunity Status page: https://status.toot.community
What does this mean for costs?
During peak times it costs $0.78/hour to run #tootcommunity, but only $0.26/hour during the night, thanks to being able to dynamically purchase additional servers and return them when they're no longer needed. 2/2
#kubernetes HPAs working in harmony keeping the #tootcommunity people happy.
What are we looking at?
It tries to keep the average number of pending jobs in each queue below 500, if it goes over, it starts additional processes that pitch in with the workload.
Web processes are managed so that no individual process handles more than 5 req/sec. More get added if it goes over.
If the amount of work is decreasing, capacity is returned to the cloud so we don't pay for it. 1/2
#devops #mastoadmin
Here is an update about the #tootcommunity finances
In a couple of days, we've gathered people committed to recurring and making one-time donations. Together they raised enough money to cover the first month, and we're already almost through the second one.
I am super grateful for this, as it's allowing me to focus on delivering an excellent, fast, secure, and reliable platform for everyone who's a member. Thank you, everyone. 🙏
Ko-Fi: https://ko-fi.com/jorijn/
Patreon: https://www.patreon.com/tootcommunity
#tootcommunity is now running Mastodon v4.0.0 🚀
Changelog: https://github.com/mastodon/mastodon/releases/tag/v4.0.0
We're monitoring uptime statistics for #tootcommunity and it's for everyone to see over at:
Can you spot when we replaced our very overwhelmed Redis instance today?
Just added more payment methods for people who prefer not to create an account on Patreon. You can now use PayPal, CreditCard and Apple/Google Pay on Ko-Fi.
If you're on #tootcommunity, please consider making a small monthly contribution on https://ko-fi.com/jorijn
We don't show ads nor sell your data. Social media should be fun and safe. 🙏
My #caturday submission this week. #Kaylan & #angel having a nice snooze together. #catsofmastodon
Noticed occasional spikes in latency for #tootcommunity. We were just setting `requests` on sidekiq runners to help scheduling, but don't have limits. When the default queue started filling, the sidekiq workers took all the available CPU cycles resulting in poor performance for the end-users. Solution: Split up the node pool, add taints/tolerations so only the sidekiq processes run on those machines.
#tootcommunity #devops update:
Past 24-hours:
- 6.62 million requests handled
- 295GB data transferred
- 60k page views
- 39k visits
- 2.46 million API requests
Servers are running like a charm. Keep on toot'ing. 🚀
There was a lot of discussion about the use of Content Warnings in the past few days. We want to provide a safe place on the internet where sensitive content is only shown on an opt-in basis. Because of that, we're adding a new rule to #tootcommunity:
Add a Content Warning (CW) to any toots that may hurt or trigger people like religion, gore, spoilers, or sensitive topics.
1/2
Some #devops statistics for #tootcommunity: There are 70 devices hitting the server, each second. That's 1.5 million requests for the last 6 hours, in which we sent out 67GB of data.
