Visual evidence of Amazon EC2 network issues

The place for technology related posts.

Moderator: Moderators

Post Reply
User avatar
Sabre
DCAWD Founding Member
Posts: 21432
Joined: Wed Aug 11, 2004 8:00 pm
Location: Springfield, VA
Contact:

Visual evidence of Amazon EC2 network issues

Post by Sabre »

Article

Interesting to see how Amazon might be hitting a wall.
Sabre (Julian)
Image
92.5% Stock 04 STI
Good choice putting $4,000 rims on your 1990 Honda Civic. That's like Betty White going out and getting her tits done.
schvin
DCAWD Groupie
Posts: 1659
Joined: Fri Nov 19, 2004 7:00 pm
Location: washington, dc
Contact:

Re: Visual evidence of Amazon EC2 network issues

Post by schvin »

it's interesting data. i had seen the original, but not this follow-up, thanks.

i'm not sure which east region he is in, but my ping graphs (smokeping) within the ec2 region i have my stuff in (nor my ec2 to slicehost traffic) show any pattern like this, everything has been pretty quiet recently.

so, i am curious to know more about his setup, and kinda (?) thankful that i'm not in the same region. though, i am tempted to move some stuff to the other us east region to see if i can reproduce.

nice pretty graphs, though. will be curious to hear how amazon follows up.
2004 impreza outback
1964 beetle
avriette
DCAWD Groupie
Posts: 1316
Joined: Sun Oct 01, 2006 3:48 pm
Location: Arlington, VA
Contact:

Re: Visual evidence of Amazon EC2 network issues

Post by avriette »

Sabre wrote:Article

Interesting to see how Amazon might be hitting a wall.
It's not a wall. It's an inflection point wherein they must update their infrastructure. My guess is they're using the same kind of setup to Google. Tons of tons of tons of lame-ish whitebox pc's. Standardized, even. The problem is I/O is the hardest thing to do on a computer these days (because the cpu's are all plenty fast). There are any number of ways to increase I/O performance, and who am I to second guess them? I know what I'd do, but it wouldn't be cheap, and since they have essentially a legacy environment they need to play nice with, I can't guess at the internals. I'd seriously be looking at 10/100 gig E, and high-speed infiniband, disks with larger caches, procs with larger caches, or even a true realtime setup. (or maybe even a real RTOS... does anyone make things like the NonStop or a Stratus that can keep up with the machines? The thing is, with a mainframe you get giant performance, and they could be used to triage data before being "chunked" like Google's stuff. They're big, and cost their weight in gold, but you might be able to add a single row (six racks or so) per POP where necessary for traffic. (edit: smaller POPs might use memcache clusters or non-relational databases for lookups)

Computing will always run up against "walls." The good news is we know the maximum fidelity we can use via maths. Since the concepts are largely physical rather than logical, it's easy (as in, obviously possible, although not necessarily obtainable RFN) to develop something that works well on your wall. Think of intelligence as a siege engine hammering on Hard Problems. The bigass mainframes and their ilk (mostly ibm today meh) might be your Mehmet II mega-cannon.

Doesn't Seitz work at Amazon? Is he still around?
rocket scientist
User avatar
Sabre
DCAWD Founding Member
Posts: 21432
Joined: Wed Aug 11, 2004 8:00 pm
Location: Springfield, VA
Contact:

Re: Visual evidence of Amazon EC2 network issues

Post by Sabre »

avriette wrote:Doesn't Seitz work at Amazon? Is he still around?
Not around DCAWD anymore since he sold his STI, but I believe he did mention moving from AOL -> Amazon. It would make sense for him to be part of their EC2 cloud services.
Sabre (Julian)
Image
92.5% Stock 04 STI
Good choice putting $4,000 rims on your 1990 Honda Civic. That's like Betty White going out and getting her tits done.
avriette
DCAWD Groupie
Posts: 1316
Joined: Sun Oct 01, 2006 3:48 pm
Location: Arlington, VA
Contact:

Re: Visual evidence of Amazon EC2 network issues

Post by avriette »

[quote=]Not around DCAWD anymore since he sold his STI, but I believe he did mention moving from AOL -> Amazon. It would make sense for him to be part of their EC2 cloud services.[/quote]

Yeah, we did essentially that when we worked at AOL in 2004-2005. Most of that entire group (maybe twenty people even) has moved to Comcast. I don't know much about the "move," though.
rocket scientist
User avatar
Mr Kleen
DCAWD Founding Member
Posts: 15034
Joined: Mon Apr 18, 2005 6:46 pm
Location: Wiesbaden.DE

Re: Visual evidence of Amazon EC2 network issues

Post by Mr Kleen »

if anyone sees that guy on a regular basis, I still owe him $20. :oops:
Post Reply