Update:
All important sites are now migrated, we keep monitory everything for further issues that may arise on the way. If you find something that doesn't work as it's supposed to, please cont hesitate to let us know by opening a support ticket: https://www.99stack.com/company/contact
What happened?
In order to provide a redundant and reliable service, we made the terrible mistake to put too much dependency on big tech. While our current 71 independent data centers hosting all your cloud resources are safe, our own website and API's has been running at one of the big players on the market.
After a failed payment caused by the providers anti-cryptocurrency stance, we've got the warning signal that we may get purged soon. While we've attempted to get in touch with said provider it appears to be a more complicated task than first expected, to this day we still haven't heard from a living human, only robots.
How are you gonna solve this?
Immediately after getting attention to the problem, we've made the radical decision to remove every last piece of dependency. Simply put, we've just abandoned our cluster as it could get nuked at any time.
But where is the site and API hosted now?
At our own servers, we've deployed nodes across many of our independent providers with high capacity across Europe. Each node are now operating more independent, this means:
- Less risk for everything to go down at the same time. Support tickets, knowledge base and this forum are all on independent nodes.
- Slower but safer backups, upgrading from TLS AES-128 to fully end to end AES-256 encrypted channels. This means, in the rare event any node goes down, it'll be back up and running with no data loss.
- No blind trust in internal private networks, that may not be as private as advertised.
Will this affect the supply of servers?
Not very much, we deploy nodes at locations where where have high capacity but low demand, should these conditions change over time we could easily move our own nodes to give more space for you.
Will the site and API get slower?
Maybe a few milliseconds in some places, but faster in Europe. We've enabled load balancing via Cloudflare, but use 100% local configuration to avoid dependency to Cloudflare. Read operations on public endpoints will be cached and distributed, hence much faster.
Will the local endpoints still work?
No, unfortunately. They where part of the dependency. Use api.99stack.com and you will be automatically routed to the closest node. TOR and VPN should be allowed, let us know if you're having trouble to connect.
Email issues
Sending and receiving emails via 99stack.com was yet another dependency. We're working on being able to send again ASAP but some emails are currently dropped. This is expected to be fixed by tomorrow. As for receiving, we recommend direct contact through tickets, you find the links here: https://www.99stack.com/company/contact, and in the bottom right corner at https://dash.99stack.com.
By opening a direct ticket instead of mailing in, your data stays private in contrast to email tickets. Note that for a unforeseeable future we may have trouble receiving emails, so please use direct tickets as much as possible.
We're sorry for the inconvenience and hope that this hasn't caused you too much trouble.
