Process Engine (AWS) Basic Cloud Services (OTC) Identity Management and Login (OTC) Process Engine (OTC) Administration (AWS) Viewing (OTC) Import (OTC) Search (OTC) AI Services (OTC) Administration (OTC) ERP Integrations (OTC) d.velop sign (OTC) Contracts (OTC) Administration (OTC) Search (OTC) Administration (OTC) Center (OTC) Outlook Integration (OTC) Embedded View (OTC) Search (OTC)
(07. Nov, 18:24) Resolved - OTC identified a faulty network connection and disabled it at 6:24 PM. Since then, we have not seen any connection issues in our system.
(07. Nov, 14:36) Disrupted - Due to targeted resilience improvements, the negative impact on users could be reduced compared to the beginning of the incident. We have deployed these changes to our production environment. While some calls still result in timeouts, d.velop sign now detects and retries these automatically. As a result, users are experiencing fewer functional limitations, although some issues may still occur. Response times may also be slightly degraded. We are continuing to investigate the issue together with OTC. Incident tickets have been opened, but no new findings have been reported yet. The root cause remains unclear. As the impact is currently lower than at the start of the incident and we expect slower progress over the weekend, we will provide updates as soon as new insights become available, but at minimum once per day.
(07. Nov, 07:18) Disrupted - OTC is currently in the process of opening incident tickets with the internet routing service providers where we are observing packet loss related to specific source IPs. We remain in close coordination with OTC, but at this stage, further clarification depends on the support and analysis from the internet routing service providers. Next update is expected by 03:00 pm today at the latest.
(06. Nov, 17:18) Disrupted - We are observing recurring timeouts linked to specific source IPs, while HTTP calls from other source IPs are unaffected. This indicates that not all traffic is impacted. Recent changes to ELB settings on the OTC side have led to improvements, but these do not apply to all affected source IPs. We continue to investigate the issue jointly with OTC and their vendor. Current impact remains at approximately 2% of all calls, limited to specific source IPs. Next update will be provided by at least 09:30 AM tomorrow.
(06. Nov, 13:25) Disrupted - Status unchanged. We are still investigating the issue, but at the moment we do not have any new information. Next update expected by 5:30 pm at the latest.
(06. Nov, 09:12) Disrupted - We are still investigating the issue. Our latest findings show no problems within the d.velop stack or OTC. However, we have identified issues with an independent internet routing service provider and are currently conducting tests. As we do not expect quick results, the frequency of communication updates will be reduced. We will provide updates whenever new information becomes available, but at a minimum every 4 hours. Next update expected by 01:30 pm at the latest.
(05. Nov, 22:59) Disrupted - Still investigating the issue. Together with OTC we are experiencing some global internet routing problems at a routing service provider. More tests will take place and need some time. Next update expected at 2025-11-06 9:30.
(05. Nov, 22:16) Disrupted - OTC activated their vendor specialists, but even they can not find any root cause; at the moment they see no problem in the otc stack; maybe a global internet routing problem. 2% of all calls timing out the moment. Next update expected at 11 pm.
(05. Nov, 20:39) Disrupted - We are still investigating the issue with the help of OTC. Next update expected at 10 PM.
(05. Nov, 17:41) Disrupted - We are in contact with OTC to solve this issue.
(05. Nov, 10:55) Disrupted - We are currently experiencing intermittent network issues that are causing some OTC calls to drop. We are in contact with OTC and are actively working to resolve the issue as quickly as possible. We apologize for any inconvenience and will provide updates as more information becomes available.