Affected Components: Wallet Backend, CCD Scan, Identity Providers, Testnet

May 11, 11:00:00 GMT+0
Completed - We are currently performing a state rollback on Testnet. This is to ensure that the latest node version 10.0.8 which introduced a security fix making certain malformed transactions invalid and not able to be included in blocks is able to successfully recover state from genesis through the the running head..

Duration: 1 hour

Affected Components: Testnet

Feb 11, 14:00:00 GMT+0
Completed - Maintenance has completed successfully.

Feb 11, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Feb 11, 13:00:00 GMT+0
Identified - A protocol update to [protocol version 10 ](https://proposals.concordium.com/updates/P10.html)is planned to take effect on Testnet on February 11, 2026. New node software compliant with the protocol update (version 10.0.4) is released for Linux, Windows and MacOS, available [here](https://docs.concordium.com/en/mainnet/docs/installation/downloads.html#concordium-node-distributions)[ ](https://docs.concordium.com/en/mainnet/docs/installation/downloads.html#concordium-node-distributions)([release notes](https://docs.concordium.com/en/mainnet/docs/release-notes/release-notes-lp.html#testnet)). **Node runners must upgrade their nodes to version 10.0.4 before the new protocol takes effect.** Nodes running earlier versions will stop processing new blocks at that point..

Duration: 1 hour

Affected Components: Testnet

Aug 27, 14:00:00 GMT+0
Completed - Maintenance has completed successfully.

Aug 27, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Aug 27, 13:00:00 GMT+0
Identified - A protocol update to protocol version 9 is planned to take effect. Please [**upgrade your testnet node to version 9.0.7**](https://docs.concordium.com/en/mainnet/docs/installation/downloads.html#concordium-node-distributions) in advance..

Duration: 1 hour

Affected Components: Testnet

Feb 24, 14:00:00 GMT+0
Completed - Maintenance has completed successfully.

Feb 24, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Feb 24, 13:00:00 GMT+0
Identified - A protocol update to protocol version 8 is planned to take effect. Please [upgrade your testnet node to version 8.0.3](https://docs.concordium.com/en/mainnet/docs/installation/downloads.html#concordium-node-distributions) in advance..

Duration: 10 minutes

Affected Components: Testnet

Sep 30, 13:10:00 GMT+0
Completed - Maintenance has completed successfully.

Sep 30, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

Sep 30, 13:00:00 GMT+0
Identified - We have an upcoming protocol update scheduled. Please upgrade your testnet node to the latest version in advance. <https://developer.concordium.software/en/mainnet/net/installation/downloads.html#concordium-node-distributions>.

Duration: 2 hours

Nov 20, 11:00:00 GMT+0
Completed - Maintenance has completed successfully.

Nov 20, 09:00:01 GMT+0
Identified - Maintenance is now in progress.

Nov 20, 09:00:00 GMT+0
Identified - In preparation for the shutdown of the JSON-RPC service on November 27 at 10:00 CET we will temporarily disable the JSON-RPC service on **testnet** on November 20 from 10:00-12:00 CET. No other services will be affected..

Duration: 16 minutes

Affected Components: CCD Scan

Sep 18, 08:46:14 GMT+0
Completed - Maintenance has completed successfully..

Sep 18, 08:30:01 GMT+0
Identified - Maintenance is now in progress.

Sep 18, 08:30:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 1 hour

Affected Components: Identity Providers

Aug 31, 12:00:00 GMT+0
Completed - Maintenance has completed successfully.

Aug 31, 11:00:01 GMT+0
Identified - Maintenance is now in progress.

Aug 31, 11:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 4 hours and 16 minutes

Affected Components: Testnet

Aug 21, 12:16:13 GMT+0
Completed - Protocol 6 is in effect since block `dfef36c6199968bd012265e100950ececa7909652d0d18ed728fb7ccb189406a`..

Aug 21, 08:00:00 GMT+0
Identified - A protocol update to implement the new Concordium BFT consensus protocol and to extends smart contract functionality will take effect on testnet on August 21, 2023. New node software compliant with the protocol update is released for Linux, Windows, and MacOS [here](https://developer.concordium.software/en/mainnet/net/installation/downloads-testnet.html#concordium-node-distributions). New versions of concordium-client, cargo-concordium, smart contract libraries and wallets will be released as well. **Node runners must upgrade their nodes before the new protocol takes effect.** Old nodes will stop processing new blocks at that point. For more details on the protocol update, see [concordium-update-proposals](https://proposals.concordium.software/updates/P6.html). The node release and protocol update on testnet are in preparation of a similar node release and protocol update on mainnet, which are planned for September 11 and 25, respectively..

Duration: 6 days, 23 hours and 15 minutes

Affected Components: Identity Providers

Aug 23, 11:19:11 GMT+0
Resolved - This incident has been resolved..

Aug 16, 12:04:24 GMT+0
Investigating - Identity issuance with the Danish eID solution MitID via our identity provider DTS is currently not working. DTS is informed. Identities can still be issued with traditional ID documents. Note that to create identities with Danish ID documents, you will need to choose Notabene instead of DTS..

Duration: 3 hours and 8 minutes

Affected Components: Identity Providers

Apr 14, 09:06:05 GMT+0
Resolved - This incident has been resolved. Identity issuance with Notabene on testnet is working again..

Apr 14, 05:57:52 GMT+0
Investigating - Identity issuance with Notabene is not possible with any wallets. Please use one of the other available identity providers to get testnet identities..

Duration: 45 minutes

Affected Components: Identity Providers

Mar 31, 08:00:00 GMT+0
Completed - Maintenance has completed successfully..

Mar 31, 07:18:52 GMT+0
Identified - Maintenance is now in progress..

Mar 31, 07:15:00 GMT+0
Identified - Issuing a new identity using Notabene is not possible on iPhones on testnet at the moment, as our iOS wallets crash after entering the Notabene identity flow. Please use our other identity provider DTS to issue identities in our iOS wallets. Our other wallets are not affected. We are investigating what causes the crash on iOS..

Duration: 3 days, 23 hours and 1 minute

Affected Components: Identity Providers

Mar 21, 09:45:19 GMT+0
Resolved - This incident has been resolved..

Mar 17, 10:44:20 GMT+0
Investigating - Issuing a new identity using Notabene is not possible on iPhones at the moment, as our iOS wallets crash after entering the Notabene identity flow. Please use our other identity provider DTS to issue identities in our iOS wallets. Our other wallets are not affected. Notabene is investigating the incident..

Duration: 29 days, 6 hours and 12 minutes

Affected Components: Identity Providers

Jan 24, 10:33:34 GMT+0
Resolved - Identity issuance with Notabene is up again..

Jan 19, 09:39:23 GMT+0
Investigating - Identities cannot be issued with Notabene on testnet at the moment. We have informed Notabene. Please use our other identity providers. Mainnet is not affected..

Duration: 19 hours and 36 minutes

Affected Components: Testnet

Jan 4, 10:51:37 GMT+0
Resolved - There was a bug in the MacOS node version 5.0.6 that caused an issue with NRG calculation. We have released a bugfix release **Concordium Node 5.0.7 for MacOS**. We recommend all MacOS nodes to be updated to version 5.0.7. Nodes running on Windows, Ubuntu or Docker are not affected. **Mainnet** - [Download Concordium Node 5.0.7 for MacOS](https://developer.concordium.software/en/mainnet/net/installation/downloads.html#mac-5-0-7) - [Release note](https://developer.concordium.software/en/mainnet/net/resources/release-notes-mainnet.html#concordium-node-5-0-7-for-macos) **Testnet** - [Download Concordium Node 5.0.7 for MacOS](https://developer.concordium.software/en/mainnet/net/installation/downloads-testnet.html#mac-5-0-7) - [Release note](https://developer.concordium.software/en/mainnet/net/resources/release-notes.html#concordium-node-5-0-7-for-macos).

Jan 4, 09:15:45 GMT+0
Identified - We have identified the issue that caused catch-up problems for a few nodes on testnet. It only affects nodes running on MacOS. We will release a bugfix release for MacOS shortly..

Jan 3, 15:15:16 GMT+0
Investigating - We have noticed that a few nodes are failing to catch up on testnet. We are currently investigating this incident..

Duration: 12 hours and 5 minutes

Affected Components: Testnet

Nov 22, 11:09:35 GMT+0
Completed - Protocol 5 is in effect since block `b15a02f9736133188ceb6cd5216bdb9614c046e0774e8e40fd18fc67dcadfea1`..

Nov 21, 23:05:01 GMT+0
Identified - Maintenance is now in progress.

Nov 21, 23:05:00 GMT+0
Identified - A protocol update to implement smart contract upgradability and performance improvements will take effect on testnet on November 22, 2022. New node software compliant with the protocol update is released for Linux, Windows, and MacOS [here](https://developer.concordium.software/en/mainnet/net/installation/downloads-testnet.html#concordium-node-distributions-v5-0-6). **Node runners must upgrade their nodes before the new protocol takes effect.** Old nodes will stop processing new blocks at that point. For more details on the protocol update, see [concordium-update-proposals](https://proposals.concordium.software/updates/P5.html). The protocol update on testnet is in preparation of a similar protocol update on mainnet in December..

Duration: 4 days, 23 hours and 50 minutes

Affected Components: Identity Providers

Oct 11, 09:38:45 GMT+0
Resolved - The issue has been identified and fixed. Notabene is enabled again, and fully functional.We just resolved the issue!.

Oct 6, 09:48:51 GMT+0
Investigating - Our identity provider Notabene is experiencing technical difficulties. It is not possible to create identities with them in the new Concordium Wallet for Android (Concordium - Blockchain Wallet) at the moment. Please use our other identity provider DTS instead. The issue is under investigation..

Duration: 4 days and 35 minutes

Affected Components: Testnet, Wallet Backend

Aug 2, 09:10:29 GMT+0
Resolved - We have identified and fixed the root cause of the issue. We made a security release for the node **for testnet and mainnet** (Concordium Node version 4.2.3). It fixes a critical security vulnerability present in all previous 4.* node versions. **All node runners must upgrade as soon as possible.** The security advisory detailing the issue and the patch will be released on August 15th. **Mainnet** * [Download](https://developer.concordium.software/en/mainnet/net/installation/downloads.html#concordium-node-distributions-v4-2-3) * [Release notes](https://developer.concordium.software/en/mainnet/net/resources/release-notes-mainnet.html) **Testnet** * [Download](https://developer.concordium.software/en/mainnet/net/installation/downloads-testnet.html#concordium-node-distributions-v4-2-3) * [Release notes](https://developer.concordium.software/en/mainnet/net/resources/release-notes.html).

Jul 29, 09:05:57 GMT+0
Monitoring - We have restarted the bakers and the testnet is back up. We are identifying the root cause of the issue..

Jul 29, 08:35:52 GMT+0
Investigating - Bakers on testnet have stopped baking. No new blocks are being produced. We are investigating the cause. .

Duration: 1 hour and 44 minutes

Affected Components: Identity Providers

Jun 28, 07:55:54 GMT+0
Resolved - Notabene has resolved the issue..

Jun 28, 06:12:04 GMT+0
Investigating - Our identity provider Notabene is currently unreachable on testnet. We have informed Notabene and they are investigating the incident. Concordium's test identity provider as well as DTS are working. Please use those to issue identities..

Duration: 51 minutes

Affected Components: Testnet

Jun 27, 09:36:17 GMT+0
Completed - Maintenance has completed successfully..

Jun 27, 08:45:01 GMT+0
Identified - Maintenance is now in progress.

Jun 27, 08:45:00 GMT+0
Identified - Concordium bakers, bootstrappers, and supporting nodes are being upgraded to the 4.2.1 version of the concordium-node software..

Duration: 5 hours and 44 minutes

Affected Components: CCD Scan, Testnet, Wallet Backend

Jun 13, 13:43:52 GMT+0
Completed - The testnet reset completed succesfully. New node software is released in **version 4.1.1**. Please follow the instructions for migration as provided [here](https://developer.concordium.software/en/mainnet/net/resources/sirius-testnet-reset.html). .

Jun 13, 08:01:52 GMT+0
Identified - Testnet reset is now in progress..

Jun 13, 08:00:00 GMT+0
Identified - **The testnet will be reset on Monday June 13th.** This reset only affects testnet. Mainnet will not be affected. ### Background The current testnet has been running for a little bit over a year. During the testing of the Sirius release we have discovered several issues that can best be fixed by resetting the testnet and starting a new one. ### Effects The testnet reset will cause **all accounts and smart contracts to disappear from the testnet**. For developers with accounts and smart contracts on testnet, this will mean that they will need to re-create accounts and re-deploy smart contracts to continue testing. For wallet holders on testnet, they will need to reset their wallets. ### Process and Migration The testnet will be deployed in protocol version 3. Shortly after, the new protocol version 4 will take effect, which adds support for delegation and updated smart contracts. For more details on the protocol update, see [concordium-update-proposals](http://proposals.concordium.software/updates/P4.html). **New node software in version 4.1** will be released for Linux, Windows, and MacOS. Node runners **must** upgrade their nodes to this version. **Old nodes will stop processing new blocks.** **Detailed instructions for migration will be provided closer to the release of the new testnet [here](https://developer.concordium.software/en/mainnet/net/resources/sirius-testnet-reset.html).**.

Duration: 5 minutes

Affected Components: Testnet

May 25, 09:35:00 GMT+0
Completed - Maintenance has completed successfully.

May 25, 09:30:01 GMT+0
Identified - Maintenance is now in progress.

May 25, 09:30:00 GMT+0
Identified - We will be changing chain parameters related to delegation on testnet for the purposes of testing. - pool owner cooldown (2h) - delegator cooldown (2h) - reward period length (2 epochs) - mint rate Parameters will be reset once testing is completed. This is expected in around two weeks..

Duration: 1 hour and 26 minutes

Affected Components: Testnet

May 23, 11:55:56 GMT+0
Completed - Protocol update has taken effect and protocol 4 is in effect since block `96786a32535daf7da442e7676605877601414450f8bcf468b04ff899bf505db0`.

May 23, 10:30:01 GMT+0
Identified - Maintenance is now in progress.

May 23, 10:30:00 GMT+0
Identified - A protocol update to add support for delegation and updated smart contracts will take effect on **testnet** on May 23, 2022. New node software compliant with the protocol update has already been released for Linux, Windows, and MacOS [here](https://developer.concordium.software/en/mainnet/net/resources/release-notes.html#concordium-node-4-0-11). Node runners **must** upgrade their nodes before the new protocol takes effect. **Old nodes will stop processing new blocks at that point.** For more details on the protocol update, see [concordium-update-proposals](http://proposals.concordium.software/updates/P4.html). The protocol update on **testnet** is in preparation of a similar protocol update on **mainnet** in June 2022..

Duration: 6 hours

Affected Components: Wallet Backend, Testnet, CCD Scan

May 16, 14:30:00 GMT+0
Completed - Maintenance has completed successfully.

May 16, 08:30:01 GMT+0
Identified - Maintenance is now in progress.

May 16, 08:30:00 GMT+0
Identified - All bakers, bootstrappers, and supporting nodes are being upgraded to the newest version of the concordium-node software..

Duration: 1 day, 16 hours and 14 minutes

Affected Components: Identity Providers

Mar 10, 07:27:11 GMT+0
Resolved - Notabene has fixed the issue..

Mar 8, 15:12:49 GMT+0
Investigating - Our identity provider Notabene is currently unreachable on testnet. We have informed Notabene and they are investigating the incident. Concordium's test identity provider as well as DTS are working. Please use those to issue identities..

Duration: 9 days, 23 hours and 59 minutes

Affected Components: Identity Providers

Feb 11, 14:53:00 GMT+0
Resolved - The issue is resolved..

Feb 4, 07:19:22 GMT+0
Monitoring - DTS is looking into the inaccuracies when reading out data from id documents.

Feb 2, 07:25:01 GMT+0
Monitoring - ID issuance is possible again but the info might not be entirely correct..

Feb 1, 14:53:35 GMT+0
Identified - At the moment, it is not possible on iPhones to successfully issue an identify via Digital Trust Solutions. We changed a setting on purpose to test flow improvements, which causes interruptions. You can use Notabene or Concordium Testnet IP as identity providers instead..

Affected Components: Testnet

Dec 6, 11:00:00 GMT+0
Completed - The protocol update is effective..

Dec 6, 11:00:00 GMT+0
Identified - A protocol update to add support for multiple addresses for the same account, also referred to as account aliases, will take effect on testnet on December 06, 2021. New node software compliant with the protocol update has already been released for Linux, Windows, and MacOS [here](https://developer.concordium.software/en/testnet/net/installation/downloads.html#concordium-node-distributions). Node runners **must upgrade** their nodes before the new protocol takes effect. Old nodes will stop processing new blocks at that point. For more details on the protocol update, see [concordium-update-proposals](https://github.com/Concordium/concordium-update-proposals). The protocol update on testnet is in preparation of a similar protocol update on mainnet in January 2022..

Duration: 11 days, 14 hours and 11 minutes

Affected Components: Testnet

Nov 29, 14:00:00 GMT+0
Completed - Upgrade successfully completed..

Nov 29, 09:21:49 GMT+0
Identified - All bakers, bootstrappers, and supporting nodes are being upgraded to the newest version of the concordium-node software..

Duration: 3 days, 22 hours and 46 minutes

Affected Components: Identity Providers

Nov 16, 07:43:00 GMT+0
Resolved - Notabene is up again. Real-life identities can be issued on testnet..

Nov 15, 07:42:14 GMT+0
Investigating - No updates on the incident. Notabene is still working on identifying and resolving the issue..

Nov 12, 08:57:19 GMT+0
Investigating - Our third party identity provider Notabene is down. Hence, new identities cannot be created via Notabene on testnet at the moment. Any attempt will only create pending identities that will never finalize. Our own dummy identity provider is working. Notabene's mainnet service seems not affected. .

Duration: 2 days, 15 hours and 6 minutes

Affected Components: CCD Scan, Wallet Backend

Nov 1, 15:03:05 GMT+0
Completed - Maintenance is now in progress..

Nov 1, 14:00:00 GMT+0
Identified - We are planning for a scheduled wallet backend maintenance during that time. The impact on the services will be negligible..

Duration: 5 hours

Affected Components: CCD Scan, Wallet Backend

Oct 26, 11:48:51 GMT+0
Completed - Maintenance has completed successfully..

Oct 26, 06:52:02 GMT+0
Identified - Maintenance is now in progress..

Oct 26, 06:49:15 GMT+0
Identified - We are planning for a scheduled maintenance during that time. Wallet Backend and Network Dashboard could be impacted during the operation..

Duration: 5 hours and 3 minutes

Affected Components: Wallet Backend, Testnet

Oct 25, 13:25:59 GMT+0
Completed - Maintenance has completed successfully..

Oct 25, 08:24:17 GMT+0
Identified - Maintenance is now in progress..

Oct 25, 08:22:59 GMT+0
Identified - We are planning for a scheduled maintenance during that time. No impact expected.

Duration: 20 minutes

Affected Components: CCD Scan, Wallet Backend, Testnet, Identity Providers

Oct 22, 08:49:56 GMT+0
Completed - Maintenance has completed successfully..

Oct 22, 08:49:02 GMT+0
Identified - Maintenance is now in progress..

Oct 22, 08:30:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 12 hours and 21 minutes

Affected Components: CCD Scan, Wallet Backend, Identity Providers

Oct 20, 12:01:20 GMT+0
Completed - Maintenance has completed successfully..

Oct 20, 11:37:39 GMT+0
Identified - Maintenance is now in progress..

Oct 19, 23:40:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 43 minutes

Affected Components: CCD Scan, Wallet Backend

Oct 14, 09:57:55 GMT+0
Completed - Maintenance has completed successfully..

Oct 14, 09:15:39 GMT+0
Identified - Maintenance is now in progress..

Oct 14, 09:15:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 3 hours and 17 minutes

Affected Components: CCD Scan, Testnet

Oct 11, 11:47:26 GMT+0
Completed - Maintenance has completed successfully..

Oct 11, 09:23:46 GMT+0
Identified - Maintenance is now in progress..

Oct 11, 08:30:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

Duration: 1 hour and 18 minutes

Affected Components: CCD Scan, Testnet

Oct 5, 13:12:30 GMT+0
Resolved - The issue is resolved..

Oct 5, 11:54:40 GMT+0
Investigating - We are currently investigating this incident..

Duration: 1 day, 9 hours and 23 minutes

Affected Components: CCD Scan

Sep 21, 12:54:19 GMT+0
Resolved - Incident has been resolved.

Sep 21, 12:20:57 GMT+0
Investigating - The network dashboard does currently not show correct data, e.g. it shows high finalization times. Note that the network is working correctly, blocks are finalized and transactions can be made. The problem is only on the dashboard. We are currently investigating this incident..

Duration: 30 minutes

Affected Components: Wallet Backend

Sep 16, 12:38:38 GMT+0
Resolved - The issue has been identified and fixed. wallet backend is up and running.

Sep 16, 12:08:40 GMT+0
Investigating - We are currently investigating this incident..

Duration: 2 days, 4 hours and 11 minutes

Affected Components: Wallet Backend

Aug 16, 11:22:10 GMT+0
Resolved - Issue resolved..

Aug 16, 10:30:00 GMT+0
Identified - A new configuration setup is being tested on the Wallet Proxy service. It's taking a bit longer than expected but should be back up within the hour..