WeKan Cloud Status

2024-11-25

• At morning, SaaS hosting was moved to different server, because there was notification that there will be 6 hours downtime at network of server where hosting was previously, because they are making some changes to improve network quality. Moving had minimal downtime.
• Later at evening, there was some downtime.
• 8.15pm GMT+2: Fixing done, all services back online.
• Root cause:
• 1) For Snap, reboot of server made them work.
• 2) For RocketChat, lxc containers did not have any network connectivity. Fix was these commands from this webpage: https://discuss.linuxcontainers.org/t/containers-do-not-have-outgoing-internet-access/10844/3

for ipt in iptables iptables-legacy ip6tables ip6tables-legacy; do $ipt --flush; $ipt --flush -t nat; $ipt --delete-chain; $ipt --delete-chain -t nat; $ipt -P FORWARD ACCEPT; $ipt -P INPUT ACCEPT; $ipt -P OUTPUT ACCEPT; done

systemctl reload snap.lxd.daemon

2024-10-16

• 10.04pm GMT+3: Adding new WeKan hosting customer. Some downtime.
• 2.18am 2024-10-17 GMT+3: All hosting services online
• Root cause: To get new custom domain kanban.somecompany.com CNAME wekan.fi TLS cert, had to disable and remove Origin Cert from CloudFlare wekan.fi, so that Caddy can get Let's Encrypt cert. Moved Sandstorm from wekan.fi to wekan.dev because it works with CloudFlare wildcard Origin cert. Had to also reboot router and server, to get all working.

2024-10-05

• 4.00pm GMT+3: SSL/TLS errors at some hosting services.
• 4.30pm GMT+3: Fixing done, all services back online.
• Root cause: Had to restart router, it was stuck.

2024-09-23

• 4.00pm GMT+3: SSL/TLS errors at some hosting services.
• 4.30pm GMT+3: Fixing done, all services back online.
• General info: Any WeKan hosting uses custom domain CNAME record (at customer nameserver).
• Root cause: Getting Let's Encrypt TLS cert did not work with CNAME record (at customer nameserver) to CNAME record (at WeKan hosting nameserver), it required CNAME record (at customer nameserver) to A record (at WeKan hosting nameserver) to IP address.

2024-05-21

• 2024-05-21: SSL/TLS issues at many hosting services.
• Notes: https://github.com/wekan/wekan/issues/5415
• 2024-05-22: Fixing done, all services back online.
• Root cause: CloudFlare changed their SSL/TLS features, had to find correct working settings by trial and error.