Recent server latency
Moderators: Freakzilla, ᴶᵛᵀᴬ, Omphalos
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Recent server latency
Hey, all. We've been having some technical issues lately. Specifically, large and crippling latency spikes. When the site suddenly becomes sluggish and nonresponsive out of nowhere. What's been happening is that large queries have been slowing the database server down. When this happens, all the other open requests start stacking up, and the server slows to a crawl.
Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.
Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- Omphalos
- Inglorious Bastard
- Posts: 6677
- Joined: 05 Feb 2008 11:07
- Location: The Mighty Central Valley of California
- Contact:
Re: Recent server latency
I just remembered that this search feature wont let us search common terms. It wont even let us search something like "Paul" because we use that word so much. Could it be something else bro?
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
As you guys can tell, the server went down again. I examined the logs after bringing it back up. About 10 minutes before it went all pear shaped, a type of system called an open relay attempted own the server. I'm still examining things, but I think we're ok. This may happen a few more times before whoever is trying moves on. Sorry for the downtime.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
All,
I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.
I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.
On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.
I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.
I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.
On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- Freakzilla
- Lead Singer and Driver of the Winnebego
- Posts: 18454
- Joined: 05 Feb 2008 01:27
- Location: Atlanta, Georgia, USA
- Contact:
Re: Recent server latency
I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
- Nekhrun
- Icelandic Wiener
- Posts: 3298
- Joined: 10 Feb 2008 16:27
Re: Recent server latency
Agreed. F 'em. Maybe that's what happened to DN and they took themselves off the grid completely!Freakzilla wrote:I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
As long as we still come up on Dogpile and Netscape we should be okay.
"If he was here to discuss Dune, he sure as hell picked a dumb way to do it." -Omphalos
Happy Memorial Day everyone! -James C. Harwood
"Three of my videos have over 100 views."
"Over 500 views for my 'Open Question' video." -Nebiros
Happy Memorial Day everyone! -James C. Harwood
"Three of my videos have over 100 views."
"Over 500 views for my 'Open Question' video." -Nebiros
- Omphalos
- Inglorious Bastard
- Posts: 6677
- Joined: 05 Feb 2008 11:07
- Location: The Mighty Central Valley of California
- Contact:
Re: Recent server latency
Ban the fuckers. Goddam Gatesian way of thinking will get them in trouble.
-
- Posts: 1504
- Joined: 14 May 2010 14:11
- Location: Grubville
Re: Recent server latency
Smite them!
Take their water!
I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.
Dispatch them with ragabash force!
Take their water!
I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.
Dispatch them with ragabash force!
Leto II is gone for good, except for OM. The "pearl" was just that; a miniscule portion of what Leto was, and not a compressed version of the whole. The pearl that the worms have do not make them Leto, or in any way similar to him.
-Omphalos
-Omphalos
- Freakzilla
- Lead Singer and Driver of the Winnebego
- Posts: 18454
- Joined: 05 Feb 2008 01:27
- Location: Atlanta, Georgia, USA
- Contact:
Re: Recent server latency
First we tattoo him, then we hang him, THEN we kill him!
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
-
- Administrator
- Posts: 2980
- Joined: 17 Feb 2008 18:44
- Location: Den Haag - The Netherlands
Re: Recent server latency
Never have used Bing ... never will. Fuck 'm.
"... the mystery of life isn't a problem to solve but a reality to experience."
“There is no escape—we pay for the violence of our ancestors.”
Sandrider: "Keith went to Bobo's for a weekend of drinking, watched some DVDs,
and wrote a Dune Novel."
“There is no escape—we pay for the violence of our ancestors.”
Sandrider: "Keith went to Bobo's for a weekend of drinking, watched some DVDs,
and wrote a Dune Novel."
- SandChigger
- KJASF Ground Zero
- Posts: 14492
- Joined: 08 Feb 2008 22:29
- Location: A continuing state of irritation
- Contact:
Re: Recent server latency
Fuck Bing.
Fuck Anderson.
Fuck the Herberritts.
Fuck them, fuck them ALL!!!
Fuck Anderson.
Fuck the Herberritts.
Fuck them, fuck them ALL!!!
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
SandChigger wrote:
Fuck them, fuck them ALL!!!
Well. Uh.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
I took the first step today and disabled guest searches for Jacurutu.
Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495
Could you do the same for Tau? It's all done in the ACP.
Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495
Could you do the same for Tau? It's all done in the ACP.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
...aaaaand I just blocked the MSN spider at the firewall.
I think.
I think.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- Freakzilla
- Lead Singer and Driver of the Winnebego
- Posts: 18454
- Joined: 05 Feb 2008 01:27
- Location: Atlanta, Georgia, USA
- Contact:
Re: Recent server latency
...and there was much rejoicing.
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
- Omphalos
- Inglorious Bastard
- Posts: 6677
- Joined: 05 Feb 2008 11:07
- Location: The Mighty Central Valley of California
- Contact:
Re: Recent server latency
did you block the bing bot on the control panel too? If not I can take care of it tonight.ragabash wrote:I took the first step today and disabled guest searches for Jacurutu.
Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495
Could you do the same for Tau? It's all done in the ACP.
- Eyes High
- Patience Personified
- Posts: 2322
- Joined: 22 Jul 2008 15:32
- Location: between the worlds of men and make believe
Re: Recent server latency
Don't forget your protection.SandChigger wrote:Fuck Bing.
Fuck Anderson.
Fuck the Herberritts.
Fuck them, fuck them ALL!!!
What fear is there in the night?
Nothing, but that which is in our own imaginations.
Nothing, but that which is in our own imaginations.
- SandChigger
- KJASF Ground Zero
- Posts: 14492
- Joined: 08 Feb 2008 22:29
- Location: A continuing state of irritation
- Contact:
Re: Recent server latency
Oh, I won't.
What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?
THAT's the kind of protection I'm thinking.
(Yeah, I slipped and fell into a dark place last night. )
What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?
THAT's the kind of protection I'm thinking.
(Yeah, I slipped and fell into a dark place last night. )
- Omphalos
- Inglorious Bastard
- Posts: 6677
- Joined: 05 Feb 2008 11:07
- Location: The Mighty Central Valley of California
- Contact:
Re: Recent server latency
Been a while since I've seen it, but that sounds like American Psycho.SandChigger wrote:Oh, I won't.
What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?
THAT's the kind of protection I'm thinking.
(Yeah, I slipped and fell into a dark place last night. )
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
That would be 'Se7en'. with the ironcially rotated 'v' as the '7'. IT'S SO META
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- SandChigger
- KJASF Ground Zero
- Posts: 14492
- Joined: 08 Feb 2008 22:29
- Location: A continuing state of irritation
- Contact:
Re: Recent server latency
Thanks, Ragabash!
(I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)
(I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)
- ragabash
- The Benefactor
- Posts: 78
- Joined: 05 Feb 2008 01:45
- Location: Sacramento, CA
Re: Recent server latency
Update:
I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.
Hopefully this will help speed us up.
I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.
Hopefully this will help speed us up.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
- Freakzilla
- Lead Singer and Driver of the Winnebego
- Posts: 18454
- Joined: 05 Feb 2008 01:27
- Location: Atlanta, Georgia, USA
- Contact:
Re: Recent server latency
Seems to be doing great!
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
- inhuien
- Posts: 3643
- Joined: 09 Feb 2008 05:03
Re: Recent server latency
This was a triumph.
I'm making a note here: HUGE SUCCESS.
I'm making a note here: HUGE SUCCESS.
- Apjak
- Posts: 519
- Joined: 30 Jun 2008 12:06
- Location: Kansas City
Re: Recent server latency
It's hard to overstate my satifaction.
I don't think the author should make the reader do that much work - Kevin J. Anderson
We think we've updated 'Dune' for a modern readership without dumbing it down.- Brian Herbert
There’s an unwritten compact between you and the reader. If someone enters a bookstore and sets down hard earned money(energy) for your book, you owe that person some entertainment and as much more as you can give. - Frank Herbert
We think we've updated 'Dune' for a modern readership without dumbing it down.- Brian Herbert
There’s an unwritten compact between you and the reader. If someone enters a bookstore and sets down hard earned money(energy) for your book, you owe that person some entertainment and as much more as you can give. - Frank Herbert