Crushbone down?

[Meskin]

Is it just me or is crushbone actually down right now?  I was booted and none of my toons are available now.

[Kenrod]

Yep. It's down.

[interstellarmatter]

It's weird.  My group is in Karnor's Castle and it's up.  But the rest of the guild got logged out.

[Meskin]

Well, it seems to be back now, that was quick!  Wow, I am impatient!

[Ossor]

Perma Receiving zone info for me... :/

[InsertNeko]

huge sections still down. some of the guild is on, but the fen's are half down

[DeadGopher]

<p>Long lag spike....then my whole friends list logged out....then Windows Vista froze.  Rebooted, can't get past the "Receiving zone info" screen.  My guess is Crushbone is hung and needs a reboot. <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" /></p><p>I guess we were lucky last night because so many people couldn't even get the danm game so tonight is the real loadtesting...</p>

[EveNi]

Grrreeeeaaat, and I thought it would be a good idea to camp to character select while I was afk, and now..stuck at receiving info screen.

[noetici]

Crushbone is still down. This does not belong in this forum section btw, server outages do not count as 'technical problems' as that refers to problems on the customer's end.

[Vanyel]

It kicked everyone in the RoK zones... except Karnors... I got back in.... but when I zoned to Kylong, I got kicked out... now when I go to char sel screen it says the server is DOWN.. yet when I get on Vent.. I have guildies playing in Karnors... I also can not log in ANY of my toons... it says the world "can not find my characters" and boots me to desktop

[interstellarmatter]

Please beat the hamsters or something..get the server back up.

[Vanyel]

Now the char sel screen says I have NO characters and is offering for me to make a new one <img src="/eq2/images/smilies/8a80c6485cd926be453217d59a84a888.gif" border="0" alt="SMILEY<img src="/smilies/8a80c6485cd926be453217d59a84a888.gif" border="0" alt="SMILEY" />" width="15" height="15" /> There must be something wrong with the login servers in general or the login server to crushbone

[Morningside]

Server outages do in fact belong on the "Technical Help and Questions" board as they are in fact Technical issues and this is where they would most likely be noticed by those in charge of such issues. Also know that this board is not solely for technical issues revolving around player systems.If anyone has any further concerns with Forum Moderation please feel free to contact a Forum Moderator via PM.Thank you.

[Vanyel]

<cite>Morningside wrote:</cite><blockquote>Server outages do in fact belong on the "Technical Help and Questions" board as they are in fact Technical issues and this is where they would most likely be noticed by those in charge of such issues. Also know that this board is not solely for technical issues revolving around player systems.If anyone has any further concerns with Forum Moderation please feel free to contact a Forum Moderator via PM.Thank you.</blockquote>Well then have them do a 100% reboot on the server vs letting it run in this half baked state

[interstellarmatter]

That's fine but just pointing out that you are the first mod in 3 years to move a server outage post to the tech forums.  You just threw people off guard.

[noetici]

<cite>interstellarmatter wrote:</cite><blockquote>That's fine but just pointing out that you are the first mod in 3 years to move a server outage post to the tech forums.  You just threw people off guard.</blockquote><p>Exactly. People make such threads under Gameplay for a few reasons - a) it DOES get noticed by those who can fix it, it always has and b) it's where players first look to see if something is going on. It's been that way for years. When people don't see a thread there, they start a new thread there.</p><p>Btw, CB has crashed in various forms (zone, login issues, etc) since release, which is understandable due to the high amount of players logging in and out and running around. But just an FYI that this has been happening since yesterday.</p>

[Vanyel]

I think Crushbone ITSELF is fine... it's the logon server FOR crushbone that crapped out. It would explain why people in game are fine until they zone... because when you zone, you actually get "logged in" to that new zone server.

[noetici]

Nope, zones are crashing. Both my boyfriend and I were in Fens (version 6.. lol) when it just went down a second ago (again) and also when it went down the first time and the second time.

[WAPCE]

Kicked again with server down message.

[ottugi]

I don't know why this server is so buggy.Remember when we had test code put into live servers and had a whole day ofoffline bs? CB still had problems after all the other servers were fixed.

[DeadGopher]

<cite>Morningside wrote:</cite><blockquote>Server outages do in fact belong on the "Technical Help and Questions" board as they are in fact Technical issues and this is where they would most likely be noticed by those in charge of such issues. Also know that this board is not solely for technical issues revolving around player systems.If anyone has any further concerns with Forum Moderation please feel free to contact a Forum Moderator via PM.Thank you.</blockquote><p>Morningside,  thanks for posting nothing helpful in this situation that is stressful to so many players coming here to find out what is wrong and what to do.</p>

[Gnobrin]

<p>I am sorry for the issue here, folks.  The trouble with Crushbone has been forwarded to the appropriate folks.  Please note too, bashing your moderators is a good means to be removed from these forums.  If there's question, please PM your local Admin for answers.</p><p>~Gnobrin!</p>

[noetici]

Thanks Gnobrin <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" /> That's the info we were looking for. Most of us /cough weren't trying to bash her, just trying to make it apparent why the thread was posted there in the first place.

[Meskin]

<p>Hey, just wanted to say that i didn't mean to post this in the wrong part of the forums and folks, the server being down for a bit is not the end of the world!  I was booted for like 5 mins earlier and just had it again, but I am sure it will be fixed soon.  Maybe something to do with so many people playing which is a good thing!!  </p><p>No reason to bash a mod for doing his/her job.</p>

[Nogger]

BTW, Where do we post to complain about all the Moved threads cluttering up the general forums? (since I know they are looking at this thread now) not being sarcastic..I'm 100% serious. Finding somethingin the general forums after the Mods make their pass through is downright ridiculous. just move 'em and delete the old one. not complaining about them moving them mind you, they are just doing their job.Crushbone now shows locked for me.

[Gnobrin]

<p><b>Ok, update!</b>Yep, there's a crushbone issue and at the present time the techs are switchin' out some gears and sprockets to correct the issue.</p><p>~Gnobrin!</p>

[Kazgoroth]

Hey Gnobrin,Pass on to them that they need to add a few more boxes to the cluster while you're at it.  CB's had problems ever since they combined servers and that's been, what, almost two years now?

[Mins]

<cite>Gnobrin wrote:</cite><blockquote><p><b>Ok, update!</b>Yep, there's a crushbone issue and at the present time the techs are switchin' out some gears and sprockets to correct the issue.</p><p>~Gnobrin!</p></blockquote>Oh no, not them pesky little gnomes...... <img src="/eq2/images/smilies/908627bbe5e9f6a080977db8c365caff.gif" border="0" alt="SMILEY" width="15" height="15" />

[Robotika]

<cite>Gnobrin wrote:</cite><blockquote><p><b>Ok, update!</b>Yep, there's a crushbone issue and at the present time the techs are switchin' out some gears and sprockets to correct the issue.</p><p>~Gnobrin!</p></blockquote>Oh man I hope they don't let an Ogre at it... Then we'll never be able to get back on.;PAnd I find it highly amusing that I got the expansion today and have had perhaps 20 minutes of in-game time. Oh well, at least I have none game things I can do.

[allnamestaken01]

Cool, thought Vista broke the gane again

[Nekrokas]

Wheeeee............waiting for server to come back up is fun!

[TriffMoH]

Any chance of an eta so i can decide if i should go to bed?

[Random411]

<p>And this is exactly why SoE needs to stop importing their hamsters... Keep them wheels spinning!</p>

[allnamestaken01]

The Chinese Hamsters were recalled due to their lead paint content and they had to be replaced.

[rinhot]

ok, can we please get a time line for when this server is going to be available for use?

[Magar]

Funny stuff man.  I was actually looking through all the recalls when I read that....  Geebus....  What would a expansion release be without a day or two of crashes.....  Sigh...

[quamdar]

i think with all these downtimes/crashes that seem to be specific to crushbone we should get some kind of bonus XP this weekend or whenever to make up for our lost grind time.

[Xirnib]

Ok, the issue has been addressed. The Info has been passed to the correct ppl. Its an issue since god only knows. New expansion, everyone else is having fun while we troll. So can we move on to another topic....Like, Compensation? Can we get special treatment. A GM handing out XP potions? You now, we are here not playing trying to stay in the race to be the first Worldwide for something? Cmon you now you want to.  <img src="/eq2/images/smilies/e8a506dc4ad763aca51bec4ca7dc8560.gif" border="0" alt="SMILEY" width="15" height="15" />

[InsertNeko]

I had 99% aa into 110, and 99.8% xp into 73. I need my raid shard <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />omg /emo

[allnamestaken01]

Oh, the hamsters licked some beads and are now on Excatsy, SOE is trying to get them back since that is a good thing (to keep them running)

[Ridiculous]

I'm dying Sony, it's been a good 10 minutes and the EQ withdrawals are kicking in. server gonna be up SOON ??

[quamdar]

<cite>Ridiculous@Crushbone wrote:</cite><blockquote>I'm dying Sony, it's been a good 10 minutes and the EQ withdrawals are kicking in. server gonna be up SOON ??</blockquote>you have only been out for 10 minutes?  i haven't been able to log in since like 9:30 EST.

[Borga007]

  I've been down for about an hour.. says Server offline(down) still <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" /> and EQ 1 wants me to do a 5 hour patch for new expansion i don't have yet so i can't play any EQ.. hurry up and replace that old tired hamster with a guinea pig. The run faster and have more stamina too!

[Quinntus]

2.5 hours so far and counting . . . How hard is it to reboot the box?

[Satyva]

Has there been any ETA made public yet?  And myself as well have been down for at least 2 hours

[emeraldtail]

Still waiting here... 2 hours+

[Borga007]

<p> Only thing i've read in this whole thread is they know there's a problem and are working on it. I wish they'd hurry up tho.</p><p>   Maybe a GM or Mod readin this thread could give us a fresh ETA.. <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" /></p>

[Gutterfly]

<p>Hopefully we'll get more than a duct-tape and super glue fix, like we've been dealing with since the server merge years ago.</p>

[Ridiculous]

people have been without for more than an hour? I don't like the looks of this.. I don't drink 20+ cups of coffee on my "weekend" to sit here and press the PLAY button in hopes that I actually get to PLAY !!!! why the merge? haven't they learnt in EQ1 merging was a risky idea?

[cassiusx]

I think the reason this prolonged lack of access bothers me is that my money is good 100 percent of the time AND there is nothing from anyone official about what's going on. Do we wait 5 more minutes? Can we shut the computer down and go do something else the rest of the night? Throw me a bone...

[Jinni123]

hi my names swippe and i need eq2.......... please

[DeadGopher]

<p>I wonder how long the rollback will take this time?</p><p>Yeah!  I said it!  ROOOOOOOOOLLBACK!!</p><p>Oh, go ahead and pretend you're surprised...</p><p>...you're not fooling anyone...</p><p><span style="font-size: xx-small;">note: i have no knowledge of an actual rollback in progress</span></p>

[Quinntus]

So, if you actually make to the character selection screen, which shows crushbone as down, when it does come back up, will that screen reflect that?And, one of my toons isn't even showing up. Anybody else have the same issue?

[danmuntz]

Can someone please remind me why I bought this expansion?Oh yeah.... to play.ETA please?

[FroggyBruiser]

This is BS! I will go back to my other game full time, if this kinda stuff continues. All sony cares about is money, yet they lack the basic knowledge of customer satisfaction, get a clue!

[Meskin]

Everyone here should start a new toon on another server to play out some of the sarnark stuff and just enjoy ourselves.  Play something that you would never normally play.  I started Meskin, a SK on Antonia Bayle, look me up.

[Quinntus]

I wouldn't mind if it was all servers . . .some issue with the new content I suppose. But a single server? How does that even happen?

[Borga007]

<p>ya this is gettin old.. it wouldn't bother me if it was All the servers but just Crushbone. Come on oush the darn reset button already.</p><p>   Or at least give us an ETA or somethin. I just srtarted a couple months ago, startin to regret pickin crushbone now from what i'm readin in this post <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" /></p>

[danmuntz]

<cite>FroggyBruiser wrote:</cite><blockquote>This is BS! I will go back to my other game full time, if this kinda stuff continues. All sony cares about is money, yet they lack the basic knowledge of customer satisfaction, get a clue!</blockquote>Can I have your stuff?

[Ridiculous]

ROLLBACK??!!! no no no don't say that ... where the hell are the damned GMs? I'd like to be prepared for any drastic changes.. or at least a ballpark idea of how much coffee I'm looking at until I can continue on Grinding thank-you-very-little.

[noetici]

<p>Generally yes it will show the server as up once it's up.</p><p>They're probably either too busy to update CS, or the news CS has isn't useful enough to provide to us, or they simply don't know how long it's going to take. When it's up, it's up, if they gave you an ETA you'd be upset when it goes past the ETA for whatever reason, more often than not it's just better to not give one.</p>

[Ridiculous]

yes Quinn. best way to find out if Crushbone is up is by consistently logging in and out until your character can comfortable zone back into world, or by checking up on Update Notes when you hit your pre-character patch download screen....? maybe..?

[Jinni123]

as we all [Removed for Content], and ill admit im doing my fair share of [Removed for Content], this just makes our eq2 experience better, me and my friends still laugh about how crushbone used to do this during launch how every server would be up except CRASHbone as it was known at the time, it sucks now but soon we will all look back on this and laugh so stop your [Removed for Content] play go play bloons and wit for the servers to come back up.i love the bone

[kittypack]

<cite>Anap@Crushbone wrote:</cite><blockquote><cite>FroggyBruiser wrote:</cite><blockquote>This is BS! I will go back to my other game full time, if this kinda stuff continues. All sony cares about is money, yet they lack the basic knowledge of customer satisfaction, get a clue!</blockquote>Can I have your stuff?</blockquote>You are asking someone for their gear that is already attuned? ...heh, noob

[Kamimura]

<cite>Jinni123 wrote:</cite><blockquote> but soon we will all look back on this and laugh</blockquote>I don't remember ever looking back and laughing about a server crash.. :p

[Ridiculous]

yeah, right? HAHAHHAHAHA 20$ down the drain to sit here and stare at my computer monitor, oohh good ole' Crushbone.. right.

[Naeowan]

<p>I understand that they don't want to post a false ETA, but some feedback after over 2 hours would be appreciated.  I am an adult and would accept "we have no clue atm".</p>

[danmuntz]

<cite>Odifferous@Crushbone wrote:</cite><blockquote>You are asking someone for their gear that is already attuned? ...heh, noob</blockquote>Who said anything about attuned stuff?

[DarkRanger77]

<p>Well they can't very well give us an update and ETA if they don't have one. There's no use in calling them names cause they've probably heard it a hundred times. Yes they are slow, yes this is a long standing issue and yes this is annoying as hell. They are working to fix it great......but like others said...[Removed for Content]. This is a race if you GM's didn't notice. A race to 80, kind of like your race to Kunark for the level-challenged people not 70 yet. We should be getting something for this, you are screwing us out of discoveries and leveling time. XP potions would be the best solution for this on-going charade of neglect. Double XP causes an issue with giving it to just this server maybe but giving our toons xp potions to claim or just hand them to us I don't care. Just do something other then tell us "omg our stuff broke we're fixing it".</p><p>Klick Klack </p>

[Quinntus]

lets hope<a href="http://eq2players.station.sony.com/network_status.vm" target="_blank" rel="nofollow">http://eq2players.station.sony.com/...twork_status.vm</a>is accurate and when CB comes up, the page is changed

[Kity]

I haven't been on all day, has there been a reason as to why the server is down that I missed?

[Quinntus]

Nope

[Ridiculous]

you know as much (or little) as we know, Kit.

[danmuntz]

<cite>Gnobrin wrote:</cite><blockquote><p><b>Ok, update!</b>Yep, there's a crushbone issue and at the present time the techs are switchin' out some gears and sprockets to correct the issue.</p><p>~Gnobrin!</p></blockquote>I'm not sure if this means it's a hardware issue, or if this is some kind of cute play on words for "we have no idea but are looking into it" - take it as you will.But that's all the info that we have <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />

[Quinntus]

3 hours for a single server to be down is tad odd. Power supply go bad?

[danmuntz]

That's a 5 minute replacement <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />

[Quinntus]

Ok, Ok. Power supply go bad and somebody locked the door to the server cage?

[danmuntz]

Now, that's a possibility!

[VillainsVisi]

It is the Butcherblock server declaring war against us.. [Removed for Content]... I blame them

[Quinntus]

I wonder how long it takes to completely reload the world in the event of a hard drive replacement?

[DeadGopher]

ETA-->  Crushbone will be up again once the Devs have decided it has been down long enough for enough people to go to sleep so that the remaining players can log in without crashing the i386 desktop system that Crushbone runs on.  Come on Sony, at least add a math coprocessor to Crushbone's motherboard!

[Borga007]

<p>EQ2 needs a chat room, at least in 1 when server crashes there's a chat room right there you can get in and talk to other EQ-starved folks, makes for a little more entertainment that staring at forums, altho actually playing the game would be even better about now. </p><p> I'm tired of readin forums and playin LoN.. i wanna play EQ darnit!</p>

[Ridiculous]

it doesn't look too reassuring for those that have loyally stayed on CB since they started characters on EQII, for one and one server only to be shut down with no sort of communication between the server users and Sony. I'd say that this is fairly consistent (esp after merge) and players have been somewhat accommodating with the GMs & Sony...it's understanding if the servers crash after Expansion day, what would Expansion day be without crashes? but like others said before, it's a wee bit odd that one server is down and no one has made as to an ounce of effort to give us any beneficial information *yawns* I had a good group too <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />

[Myriam]

It's Blizzard sabotaging us!

[danmuntz]

<cite>Quinntus wrote:</cite><blockquote>I wonder how long it takes to completely reload the world in the event of a hard drive replacement?</blockquote>Good question.  But I would seriously hope that SoE would be smart enough to have redundancy in that area and could afford to have a hard drive or two (or three) fail and things keep running.I have no clue about the internal workings of SoE's servers, but I would tend to think that the game data isn't on the actual server drives, but probably on a backend array over fiber channel or something... but who knows.I guess the real question and issue here is... redundancy.  If I had a server down for 3+ hours for a hardware problem, I'd be fired pretty quickly.  But then again, I would be keeping a hot and cold spare around too <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />

[Jaxl]

<cite>Quinntus wrote:</cite><blockquote>I wonder how long it takes to completely reload the world in the event of a hard drive replacement?</blockquote>I don't know how they do it, but I'd guess they use a RAID setup meaning you can have a drive fail, hot swap it and nobody ever notices.  edit: poster above me makes a good point, a SAN makes sense..

[zukem]

The ironic thing was.  this afternoon, I was commenting to a guildie how relatively smoothly this expansion was.  So I guess it was all my fault.  On the bright side.  In 10 hours, everyone will be in the same boat we are in with the servers being down.  /sighAn update from a Dev please.  Just so we know at least you are looking into it. 

[kittypack]

<p>3 hours of nada... im goin to sleep.</p>

[Gnobrin]

<p>Very sorry for the wait, all.  There is no present known ETA on the hardware fix for Crushbone.  As per my prior reply to this thread, the techs had to replace hardware, and that can take a while.  I am very sorry for the wait.</p><p>We understand your issues in wanting to get ingame once more, but please note that venting here will not make the process any faster.  Rude behavior will only result in ejection from these forums.</p><p>~Gnobrin.</p>

[danmuntz]

Yeah, but we (Crushbone) will be 13+ hours behind the rest of the world as far as discoveries and such <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" /> <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />

[Naeowan]

<p>/cries</p>

[danmuntz]

Thanks for the update Gnobrin!

[Ridiculous]

Gnob please explain to me the interiors of what hardware? memory hardware of world? anything drastic? consistent glitches that can be fixed in an hour or two? I appreciate the info, just trying to get as much as I can. I'll stop drinking my coffee now if I know I'm only gonna get an hour of gameplay before ANOTHER patch occurs....

[Gnobrin]

<p>Yes Anap, and this issue was not intentionally done to spite you.  Unless you're one of the folks working in the server room at the exact time, patience is the only thing we can have in hopes of progressing the process.  </p><p>This was an unforseen issue, one that is being worked on by the techs at this time.  Believe me, they want the server up and going as much as you do, and are working hard to get it that way.</p><p>~Gnobrin.</p>

[Quinntus]

As <span class="genmed"><b><span style="color: #3366ff;">Anap</span></b></span> pointed out, shouldn't there be redundant hardware systems to handle such outages?

[Dzien]

So what kind of reassurance will we get that this won't happen again? There seems to be a common theme involving crushbone and hardware problems. No other server experiences the same difficulties we do. It may be a minor problem for many, but it will have lasting effects on the progression of this server vs others. We are now at a good disadvantage for WW progression in terms of first kills etc.

[andigro]

<hr /> <p>Yeah, but we (Crushbone) will be 13+ hours behind the rest of the world as far as discoveries and such <img src="http://forums.station.sony.com/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" width="15" height="15" /> <img src="http://forums.station.sony.com/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" width="15" height="15" /></p><hr />  <p>Yeah, can you reset gamewide discoveries until all servers are up and running?  That does kind of suck I agree.</p>

[danmuntz]

Hah. You'll never know what hardware broke. I'd be kind of embarassing for them to say that it was a power supply, or a stick of memory, or maybe a caster on one of the wheels fell off. But, then again, the entire server may have collapsed in upon itself and melted into a pile of goo... then we would feel like crap for giving them a hard time when it was a real "oh-crap" issue. <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />

[Kal]

Well I have good news.  I just saved a ton of Platinum by switching to Geico.:p

[Gutterfly]

Since Test and Test PVP are both showing down now in addition to Crashbone, I'm going to speculate they are robbing from Peter to pay Paul.

[Quinntus]

At least we know that somebody is there after hours doing something.

[Morgue]

<p>Anyone that played EQ around the time of Kunark.. will remember the late delivery on over half the orders.  We did all get one month free time the servers where to say the least unplayable for 2 days after the launch..  It only strike me as ironic that Rise of Kunark would once again cause EQ even its distant kin EQ2 as much trouble as before.  But at the time of Kunark for EQLive,  I dont think sony had bought Everquest yet atleast not completely.  </p><p>Just a thought... </p><p>-raz</p>

[danmuntz]

<cite>Gnobrin wrote:</cite><blockquote><p>Yes Anap, and this issue was not intentionally done to spite you.  Unless you're one of the folks working in the server room at the exact time, patience is the only thing we can have in hopes of progressing the process.  </p><p>This was an unforseen issue, one that is being worked on by the techs at this time.  Believe me, they want the server up and going as much as you do, and are working hard to get it that way.</p><p>~Gnobrin.</p></blockquote>Ack, what?  I'm not popular enough to be single-spited yet by SoE?  Darn.<img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />  Thanks Gnobrin for the updates.  Tell the guys in the server room that I will send them cookies whilst they work!

[Magar]

I don't chase discoveries myself, but I do feel badly for those who are after that piece of the pie.  One would only hope that some sort of compensation would be forth coming..... 

[Meskin]

My previous post stands!  I am on AB, Meskin, look me up, we can start our own guild, CB Outcasts or something and still enjoy the game.

[Meskin]

<cite>Kaldu@Crushbone wrote:</cite><blockquote>Well I have good news.  I just saved a ton of Platinum by switching to Geico.:p</blockquote>LOL!  You and the dude from Beverly Hillbillies!

[Ridiculous]

I was thinking the exact same thing....

[andigro]

<p>I think I figured out how it broke:</p><p><img src="http://regmedia.co.uk/2005/09/09/windows-server-wss-rss.gif" alt="" width="278" height="229" border="0" /></p>

[zukem]

<cite>Quinntus wrote:</cite><blockquote>At least we know that somebody is there after hours doing something. </blockquote>Hopefully, it's not the Janitor on the phone with a dev.  Getting instructions on what to do.  (Don't laugh, I worked for a fortune 500 company. And our idiot General Manager asked why one of our guys wasn't in.  We told him he had to come in to fix a problems with a server last night.  His answer was, couldn't you have told one of the telemarketers, who was in the building at the time, and walked them through it.)

[Fatkiddown]

<cite>Quinntus wrote:</cite><blockquote>3 hours for a single server to be down is tad odd. Power supply go bad?</blockquote>You may know this but just in case for those that don't know,   Crushbone "server" is most likely alot more complicated than just 1 physical server.   Most likely we're talking about at least several 44U racks full of servers/storage/fibre channel backplanes working as a cluster.   There is no magical quick fix switch that they can flip to get the server back up.   Blizzard npsoft whoever you want to pick would be in the same boat if faced with the same hardware issue (if thats the case). <div></div><div> Yea it is nice to have play by play of the status but I know from the hardware end I really could care less what the users think if I'm working on fixing something I get it done as soon as possible end of story and when it is fixed it is fixed.  Wasting my time giving touchy feely updates to some PR guy is only prolonging the time it takes to fix the issue.<div></div><div>So all the crushboners that  are "like totally omg whats taking so long"  take this time to clean the cheetos from your keyboard and let the tech's do their job because there is no doubt that they will fix the issue as soon as possible.</div></div>

[Borga007]

ohhhh! I think we're gettin closer i hope.. server status screen says crushbone (locked) now istead of down!

[DeadGopher]

<p>Gnorbin,</p><p>Why isn't there redundancy built into the hardware?</p><p> I work in a datacenter that supports over 3000 servers.  We would never tell a client that their production application that pays their bills is down because of a hardware problem.  That's unacceptable.  Hardware does fail, but it should never cause an extended outage to production.</p><p>Even if a server fails, that's what clustering is for.  The other nodes in the cluster share the extra work until the broken server node can be brought back into the cluster.</p>

[Fatkiddown]

<cite>andigro wrote:</cite><blockquote><p>I think I figured out how it broke:</p><p><img src="http://regmedia.co.uk/2005/09/09/windows-server-wss-rss.gif" border="0" alt="" width="278" height="229" /></p></blockquote>They run Unix servers, nice try though

[Quinntus]

<span class="server_status_partial">Hmm, look at thisAll servers are up except for</span> <span class="server_status_locked">Crushbone (is locked) <span class="server_status_down">Test PVP</span> <span class="server_status_down">Testthe "is locked" is new (within the last 30 min)</span></span>

[Ridiculous]

come onnnnn come onnnnn I've been up for the past three days of my "Vacation" playing EQ consistently, this is tearing me apart from valuable time. extremely valuable time... and to think if I ever spend my Paid Vacation in Norrath AGAIN!

[Quinntus]

Its up

[Fatkiddown]

<cite>Anap@Crushbone wrote:</cite><blockquote>Yeah, but we (Crushbone) will be 13+ hours behind the rest of the world as far as discoveries and such <img src="/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" /> <img src="/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" /></blockquote>So does that make you cry inside?

[Ridiculous]

kaching

[danmuntz]

I shed a small tear, yes <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />

[zukem]

Crushbone is up!!!!  Or maybe not.  Stuck on entering game.  /sigh

[ayronyn]

<p>Gnorbin, </p><p>I am sure you understand that part of the excitement of each new expansion is cross server competition.  We love to compete with other guilds, other servers and even individuals playing the same class.   For a large percentage of us, this is why we pay you $20/month.  The only thing that can be considered rude about this situation is the constant lack of communication from SOE.  It really is a shame that everytime SOE fails to deliver the reasonable quality of service that their customers should be able to expect they immediately become defensive.  There are many ways to properly handle hardware failures.  A 3+ hour downtime is not one of them.  If you read these posts carefully, the commonality between posts is communication.   All we want to know is should we go to bed and dream of all the server firsts and discos we could be experiencing, or should we wait here for the servers to come back online.  I have been playing everquest since the original Kunark.  I think that after all this time SOE would have figured out how to handle situations like this better.  More importantly how to treat their customers! I respectfully ask for a little more understanding from the SOE with regards to the temperment of thier customers during a time of SOE failure.  I am pretty sure that the people posting in this thread didn't fail to pay their bill.  So please do not tell us we shouldn't use these forums to vent.  Be a good corporation! Take the criticism and make it better.  For once!</p><p> -Ayronyn</p>

[InsertNeko]

<cite>Anap@Crushbone wrote:</cite><blockquote>Yeah, but we (Crushbone) will be 13+ hours behind the rest of the world as far as discoveries and such <img src="/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" /> <img src="/eq2/images/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY<img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" />" /></blockquote>We're also the last server in getting avatars, contested, and clearing raid zones ... so I don't see why us being last in disco also will hurt anything <img src="/smilies/69934afc394145350659cd7add244ca9.gif" border="0" alt="SMILEY" />

[Ridiculous]

it'll crash again because everyone is gonna be logging in at the same time. see the awkward "disconnet" option when you click in play with no load screen? makes me weary

[Fatkiddown]

<cite>Dzien@Crushbone wrote:</cite><blockquote>So what kind of reassurance will we get that this won't happen again? There seems to be a common theme involving crushbone and hardware problems. No other server experiences the same difficulties we do. It may be a minor problem for many, but it will have lasting effects on the progression of this server vs others. We are now at a good disadvantage for WW progression in terms of first kills etc.</blockquote>Well on the good side with the broken hardware we will be getting new hardware <img src="/smilies/8a80c6485cd926be453217d59a84a888.gif" border="0" alt="SMILEY" />    And if all the other servers had 13hr downtime except crushbone we would still be behind the rest in WW progression, don't really think it's the hardware.

[andigro]

<hr /> <blockquote>3 hours for a single server to be down is tad odd. Power supply go bad?</blockquote><p>You may know this but just in case for those that don't know,   Crushbone "server" is most likely alot more complicated than just 1 physical server.   Most likely we're talking about at least several 44U racks full of servers/storage/fibre channel backplanes working as a cluster.   There is no magical quick fix switch that they can flip to get the server back up.   Blizzard npsoft whoever you want to pick would be in the same boat if faced with the same hardware issue (if thats the case).   Yea it is nice to have play by play of the status but I know from the hardware end I really could care less what the users think if I'm working on fixing something I get it done as soon as possible end of story and when it is fixed it is fixed.  Wasting my time giving touchy feely updates to some PR guy is only prolonging the time it takes to fix the issue. So all the crushboners that  are "like totally omg whats taking so long"  take this time to clean the cheetos from your keyboard and let the tech's do their job because there is no doubt that they will fix the issue as soon as possible.</p><hr /><p>Dude, if your server is up, [Removed for Content] are you doing here?   I guess its fun to kick someone when they are down...</p><p>And btw, I cleaned the cheeto dust BEFORE the release was supposed to hit <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" /></p>

[danmuntz]

<cite>Hisenflaye@Crushbone wrote:</cite><blockquote><cite></cite>We're also the last server in getting avatars, contested, and clearing raid zones ... so I don't see why us being last in disco also will hurt anything <img src="/eq2/images/smilies/69934afc394145350659cd7add244ca9.gif" border="0" alt="SMILEY<img src="/smilies/69934afc394145350659cd7add244ca9.gif" border="0" alt="SMILEY" />" /></blockquote>Yeah, to make real progress, you gotta join a RP server like Lucan D'Lere (omg, did I just go there?  SORRY!) <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" /> <img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />

[Magar]

<a href="http://forums.station.sony.com/eq2/posts/list.m?topic_id=393256" target="_blank" rel="nofollow">http://forums.station.sony.com/eq2/...topic_id=393256</a>Looks like we are near the end.....

[danmuntz]

Yay, I'm in.

[InsertNeko]

<cite>Anap@Crushbone wrote:</cite><blockquote><cite>Hisenflaye@Crushbone wrote:</cite><blockquote><cite></cite>We're also the last server in getting avatars, contested, and clearing raid zones ... so I don't see why us being last in disco also will hurt anything <img src="/eq2/images/smilies/69934afc394145350659cd7add244ca9.gif" border="0" alt="SMILEY<img mce_tsrc=" />" /></blockquote>Yeah, to make real progress, you gotta join a RP server like Lucan D'Lere (omg, did I just go there?  SORRY!) <img src="/eq2/images/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY<img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />" /> <img src="/eq2/images/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY<img src="/smilies/3b63d1616c5dfcf29f8a7a031aaa7cad.gif" border="0" alt="SMILEY" />" /></blockquote>TLU leads WW larping progression np

[CrrrOak]

Hey at least you all got to play today.  One thing they didn't say about having this expansion, is if you box (play more than one computer/account at a time) then you also need sound installed on all computers regardless if you wanted to hear it.  After trying different things for 4 hours to fix the problem, I found out sound was now mandatory and had to go buy sound cards for two of my 3 computers.  Yes on occasion I 3box or more lol get over it, you would if you could or was as addicted to eq2 as i am lol.  But yeah, after spending all day long trying to find the problems, fixing them, then to login and find the servers down.  Blah, but glad I didn't get passed over in levels :p too badly(almost 72).  I still won't turn down an xp potion, you know for my time in fixing a problem with sound that was never mentioned beforehand, extra money invested into something I'll never use hint, hint.  LOLOk I'm done ranting.Guess I'll try again tomorrow.

[Gnobrin]

<p>Gallenite posted <a href="http://forums.station.sony.com/eq2/posts/list.m?start=0&topic_id=393256#4427308" rel="nofollow" target="_blank">here</a> in regards to the issue.  Hopefully the server can get warmed up soon to get you all in once more.</p><p>~Gnobrin!</p>

[andigro]

<p>UP!</p>

[Magar]

UP UP UP

[Case21]

<p>Looks like a 20ish Min. Rollback, but we are back on.</p>

[Nogger]

One question.... For a Dev, G-Nobby (I think that's a good name for him <img src="/smilies/283a16da79f3aa23fe1025c96295f04f.gif" border="0" alt="SMILEY" /> )or anyone...Several folks mentioned rolling a new toon on a diff server.What would happen if someone with all 12 slots filled already on the same server, created a new 13th charater during these downtimes? Remember that for most folks, we only see 4 toons or so when the server is down, and as I have 12 slots filled already, if I create that 13th toon and play it untill the servercomes back up, (BTW, I KNOW it's up now, just asking) what would happen when the server came up?Would I lose access to one of my normal toons?Would the New toon be deleted auto-magicly?Just curious... i almost started a new one, but was scared I'd lose one of my storage mules....

[Borga007]

  ummm I thought they fixed Crashbone last night. I just got home tday and its Down Agian! I made a mule on nek server and its still up. This is gettin really old. Well i have an errand to run, hopin it'll be back up by the time i get back. This is Thu at around 11:30

[Rubyflame]

I thought that too... boy is this a rough day... first I can't even log my main b/c it won't let her in... says the zone is temporarily unavailable b/c she's camped in her house... and then the whole server goes down so I can't even play my alts... unless they are fixing the house thing... not happy today <img src="/smilies/9d71f0541cff0a302a0309c5079e8dee.gif" border="0" alt="SMILEY" /> Oh well... maybe when I get home from work tonight it will all be working again. It's just frustrating.

[Morningside]

<a href="http://forums.station.sony.com/eq2/posts/list.m?topic_id=393532" rel="nofollow" target="_blank">UPDATE</a>

[Nekrokas]

Heading home from work soon, is it STILL down??

[Gnobrin]

<p>At the present time, it seems that all Crushbone issues have cleared, it's showing unlocked to our producers.  If there's any other troubles, please let us know!</p><p>~Gnobrin!</p>