Emergency Downtime for AB and The Bazaar

Kiara · 08-20-2009, 02:02 PM

We're having some database issues and have had to take down AB and The Bazaar.

When we have more information, we'll update this thread.

Thank you and we apologize for the inconvenience.

Kiara · 08-20-2009, 03:34 PM

Currently the servers are still down.

The next status update should come through shortly. I'll post the information when we have it.

Kiara · 08-20-2009, 03:47 PM

Update:

We are still experiencing issues with the gnomes in the database. They seem to have rewired things a bit SMILEY

We're going to restart the servers. If this fixes the issue, we should be back up and running within the next hour or so. If not, we're looking at a more extended downtime.

I'll update as soon as I have more information to share.

Thank you for your patience and we apologize again for the inconvenience.

Amnerys · 08-20-2009, 04:45 PM

It sounds like the server reboot fixed the problems and they are hoping to have everything back online soon.

If this changes for any reason we will let you know.

Thanks for your patience!

Kiara · 08-20-2009, 05:09 PM

Update:

Everything should be good to go now. The database tinkering seems to have been fixed and there should be no further problems.

For the affected servers, the Moonlight Enchantments will run an extra day.

Thank you for your patience, everyone and happy gaming!

Rothgar · 08-20-2009, 05:41 PM

We understand there seem to be some data-related issues after the servers were brought back up. We're tying to determine if this is isolated to a few accounts or more wide-spread. This will determine our course of action.

We'll update you as we know more.

Rothgar · 08-20-2009, 06:19 PM

I've re-locked Antonia Bayle due to the data issues and high DB load. I'm sorry for the inconvenience. We'll keep you posted.

Kiara · 08-20-2009, 06:19 PM

Update:

We are locking AB and looking into the issues that are still occuring there.

Currently we have no ETA on the fix and currently this only applies to AB.

We'll continue to post updates as we have them.

We apologize for the inconvenience and the team is working to fix this as quickly as they can.

Thank you.

**grumble** Stupid ninja code devs * glares at Rothgar *

Rothgar · 08-20-2009, 06:55 PM

AB is back open for business. It appears that some players may have been corrupted this morning when the database problems began. If you find youself in this situation, please make a petition to Customer Service and they will restore your character to the last backup.

We'll keep a close eye on AB for the rest of the day to make sure we don't see any additional issues.

The Moonlight event will be extended for another day.

Once again, I'm sorry for any lost time you might have experienced due to these issues.

Kiara · 08-21-2009, 12:50 AM

Hello all.

I'm sorry to have to tell you that AB, The Bazaar and Sebilis are going to have to come down again. We're still having some issues with these servers.

We currently have no ETA on when they'll come back up. We'll post an update as soon as we have more information for you.

Thank you for your patience and we apologize for the continued inconvenience.

Kiara · 08-21-2009, 01:01 AM

Update:

Our current ETA for servers to be back up is 11PM PDT.

I'll post further updates as we have them.

Kiara · 08-21-2009, 01:53 AM

Update:

Servers are being restarted right now.

We will know shortly whether or not a rollback was necessary. As soon as I know, I'll post here and let you all know and let you know when the servers are back up.

Again, our deepest apologies for the inconvenience.

Kiara · 08-21-2009, 02:39 AM

Update:

Servers are back up currently. We're hoping that we've resolved the issues now.

Thank you so much for your patience during this gremlin hunt.

Please remember that the Moonlight Enchantments event will remain on the affected servers for an extra 24 hours (Saturday 8-22).

We apologize again for the inconvenience.

08-20-2009, 03:47 PM	#3
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: We are still experiencing issues with the gnomes in the database. They seem to have rewired things a bit We're going to restart the servers. If this fixes the issue, we should be back up and running within the next hour or so. If not, we're looking at a more extended downtime. I'll update as soon as I have more information to share. Thank you for your patience and we apologize again for the inconvenience.

08-20-2009, 02:02 PM	#1
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	We're having some database issues and have had to take down AB and The Bazaar. When we have more information, we'll update this thread. Thank you and we apologize for the inconvenience.

08-20-2009, 03:34 PM	#2
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Currently the servers are still down. The next status update should come through shortly. I'll post the information when we have it.

08-20-2009, 04:45 PM	#4
Amnerys Community Team Join Date: Jun 2008 Posts: 2,317	It sounds like the server reboot fixed the problems and they are hoping to have everything back online soon. If this changes for any reason we will let you know. Thanks for your patience!

08-20-2009, 05:09 PM	#5
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: Everything should be good to go now. The database tinkering seems to have been fixed and there should be no further problems. For the affected servers, the Moonlight Enchantments will run an extra day. Thank you for your patience, everyone and happy gaming!

08-20-2009, 05:41 PM	#6
Rothgar Developer Join Date: Nov 2006 Location: San Diego Posts: 2,273	We understand there seem to be some data-related issues after the servers were brought back up. We're tying to determine if this is isolated to a few accounts or more wide-spread. This will determine our course of action. We'll update you as we know more.

08-20-2009, 06:19 PM	#7
Rothgar Developer Join Date: Nov 2006 Location: San Diego Posts: 2,273	I've re-locked Antonia Bayle due to the data issues and high DB load. I'm sorry for the inconvenience. We'll keep you posted.

08-20-2009, 06:19 PM	#8
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: We are locking AB and looking into the issues that are still occuring there. Currently we have no ETA on the fix and currently this only applies to AB. We'll continue to post updates as we have them. We apologize for the inconvenience and the team is working to fix this as quickly as they can. Thank you. grumble Stupid ninja code devs * glares at Rothgar *

08-20-2009, 06:55 PM	#9
Rothgar Developer Join Date: Nov 2006 Location: San Diego Posts: 2,273	AB is back open for business. It appears that some players may have been corrupted this morning when the database problems began. If you find youself in this situation, please make a petition to Customer Service and they will restore your character to the last backup. We'll keep a close eye on AB for the rest of the day to make sure we don't see any additional issues. The Moonlight event will be extended for another day. Once again, I'm sorry for any lost time you might have experienced due to these issues.

08-21-2009, 12:50 AM	#10
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Hello all. I'm sorry to have to tell you that AB, The Bazaar and Sebilis are going to have to come down again. We're still having some issues with these servers. We currently have no ETA on when they'll come back up. We'll post an update as soon as we have more information for you. Thank you for your patience and we apologize for the continued inconvenience.

08-21-2009, 01:01 AM	#11
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: Our current ETA for servers to be back up is 11PM PDT. I'll post further updates as we have them.

08-21-2009, 01:53 AM	#12
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: Servers are being restarted right now. We will know shortly whether or not a rollback was necessary. As soon as I know, I'll post here and let you all know and let you know when the servers are back up. Again, our deepest apologies for the inconvenience.

08-21-2009, 02:39 AM	#13
Kiara Community Relations Join Date: Jul 2008 Posts: 4,359	Update: Servers are back up currently. We're hoping that we've resolved the issues now. Thank you so much for your patience during this gremlin hunt. Please remember that the Moonlight Enchantments event will remain on the affected servers for an extra 24 hours (Saturday 8-22). We apologize again for the inconvenience.