(Reading time: 6 – 10 minutes)
One of the things I really love about Website In A Weekend is that I have the coolest, most diverse audience in Blogistan. (prove that I don’t! :) A while back, David Hutchison stopped by with some words of wisdom on hosting. As usual, I instantly roped him in to a guest post. I don’t know David personally, but from email and reading through his hockey goaltending niche blog, I’m impressed: Hockey, rowing coach, physics and computer science teacher. With this article, David is coming to us from inGoal Magazine, his website specializing in hockey goaltending.
Hostest With the Mostest – Being a good neighbor on shared hosting
-by David Hutchison
David kindly invited me to submit a guest article, related to my recent comment on finding a web host. I’ve been enjoying Website in a Weekend and it was my pleasure to submit this. I’m certainly no expert but I hope that my experience is either helpful to you, or the beginning of a conversation on this site that will help others.
I have had an interesting adventure with web hosting as I have grown my site, inGoal Magazine, into a site for hockey goaltenders that receives a reasonable amount of traffic. I began the project, and it remains today, as a hobby. There are several reasons for this that would make an interesting article as well, but that’s for another day. Wanting to incur a minimum in expenses I went with a shared hosting plan, as I suspect most readers will be using. For less than 10 bucks a month you can get a reasonable plan just about anywhere. With shared hosting you are given space on a managed server, along with many others –how many I’m sure depends on your host but I used myIPneighbors.com and found that I am on the same server with 778 others.
It is possible for your site to crash through no fault of your own. One bad neighbor can bring everyone else down. It happened a few times to me – but one day, without realizing it, I was the bad neighbor.
How to be a good neighbour – and maximize your site’s potential on a budget
Eventually, if you aren’t careful, you’ll “outgrow” your shared hosting plan. That’s the message I got from my host one day when our site’s traffic went over 5000 page views and our server crashed. Finally we were getting some decent traffic and we were out of commission. And a quick look around told me that whatever the next step of hosting would be for us, it was going to get expensive. We’re a non-commercial (read: no revenue) site and that just wasn’t an option.
Our host was kind enough to take some time to explain it all to me. We were serving up far too much data – consuming more than our fair share of bandwidth. I was on a hosting plan that had (in theory) unlimited bandwidth. They were willing to fulfill that commitment, but did it only after throttling things so the bandwidth I got was going to come out very slowly. Page load times went through the roof.
The problem was simple.
inGoal Magazine is photo-intensive
People come to see, amongst other things, the latest photos of goalie masks, and professional shots of goalies in action. Back then I was taking the easy route, the route that seemed to provide the most benefit for our readers. I would upload big images, downsize them for posts and use a lightbox plugin so when readers clicked on the shots a much bigger image popped up on the screen.
What does this all mean in reality? One 1024 px wide image at 72 dpi comes in around 250 kb in size. Today I have 31 images in various posts on our homepage. Do a little math and that could be over 7 Mb in photos being served up for a singe pageview! A 5000 page view day would be 35Gb of data.
Clearly I was not being a good neighbour on my site.
So – what is the solution? Today at GoDaddy I would need a $180 per month dedicated server to handle the kind of data I was kicking out. There is no guarantee that it could handle it either – one server can only handle so many simultaneous requests. Cloud hosting sounds like the solution to simultaneous requests, but again it’s not cheap.
There are lots of options to deal with the problem: downsize your images, display fewer on the home page and so on. For us though, it wasn’t the complete answer. I have moved to a maximum of 650px wide, for example, but our readers come for photos and we aren’t willing to compromise a great deal. This situation immediately explained to me why people host images and other media off their site.
My affordable hosting solution
Because we are dealing with photographs – you can’t do this with any other graphics – I host most of my new images on Flickr. For about $25 a year I have a pro account and can host essentially an unlimited number of images. The photographers who contribute to our site do the same. I’m sure places like Photobucket, and Picasa give you similar options, but I haven’t explored them.
This is not for everyone for sure. You can’t upload images that aren’t yours to use (not that you should do this anyway), and you have to link back to the Flickr photo page from the images you insert on your blog. No more fancy lightbox, a curious click on your image needs to head to Flickr. But I’m wiling to do that because I can’t afford the alternative.
The professional solution without these restrictions of course is to go with something like Amazon’s S3 service. As I read it, with Amazon you’re looking at some $0.15 per Gb which for me would be over $200 per month. That was at 5000 page views. My biggest day came recently during the Olympics at 33,000 views.
Thanks to my move to Flickr, a single pageview now requires my host to serve up less than 200Kb. If we assume that trouble came when my server had to deal with about 30 GB of bandwidth then I should be good now up to about 175,000 page views per day. I think it’s safe to say that isn’t about to happen. Problogger serves 30-50 thousand in a day.
Multiple Load Balanced Servers on a Budget
As I noted before, a single dedicated server might not serve my needs. Even if it could handle the data I serve, I have a feeling that at some point it would not handle enough simultaneous requests (one pageview requires many requests). Obviously it’s a different scale, but that’s one reason Google has farms of servers.
Whether it’s the deluxe Amazon solution or my budget conscious Flickr solution though I know that the company serving the bulk of my content is doing it from a large farm of top of the line servers. Even if I went with a new hosting plan and my own dedicated server, I couldn’t do that.
This is just one situation and I expect readers could offer all kinds of suggestions for me and for others in similar situations. I would welcome your comments.
David Hutchison is the editor of inGoal Magazine. Together with a team of writers and photographers who share his commitment and passion for goaltending he is building a leading site for the most important players on any ice hockey team. And he does it at night after the kids go to bed.


You know, I hadn’t even thought about this problem, but I can see how this could ramp into a problem for myself in the next year or so. Something about the visual arts requires a lot of images. I know what to expect, so that leaves only half the battle left.
.-= Sean *Deacon* Neprud´s last blog ..Dispatches from the Spice Mines =-.
I’m thinking about trying that “maxCDN” site that Dave Thackeray recommended. Going to actually, as soon as I get some time.
.-= Dave Doolin´s last blog ..Super or Total? Money Talks But Cache Rules =-.
Honestly, I wouldn’t rule Flickr out. It is one more outpost. We need lots of outposts.
Great point Kelly. I don’t make nearly as much use of Flickr as I could.. it’s more than just a great resource for photos :)
.-= Josh Kohlbach´s last blog ..Bluehost Adds New CPU & Memory Protection Features =-.
I don’t either. I started to do something and then dropped it….note to self: go back. Do something. Flesh it out. Photos are my friend :) (and so is social media)
Josh, Kelly is right about outposts.
Here’s the funny thing about our little boggery circle, and why we should both compete with each other and help each out, like crazy: there’s millions and millions of people out there… those folks are the real competition!
“nothardly” on flickr.
Back to the Spice Mines. Yo, Deacon, pass me one of them there shovels.
.-= Dave Doolin´s last blog ..Mailbag: Looking for recommendations for promoting cornerstone content =-.
http://www.flickr.com/photos/kellydiels/
(BTW, I can’t find “nothardly”)
Maybe it’s “mtngrown.”
Which is the _real_ mtngrown I might add, not johnny-come-lately posers.
http://www.flickr.com/photos/baddeacon/
It is mostly sketches and other random stuff. Things that don’t go in the galleries on my site.
Back to diggin…
.-= Sean *Deacon* Neprud´s last blog ..Dispatches from the Spice Mines =-.
That was a really interesting post. Hopefully I will have these problems in the future :)
I definitely do not have a lot of pictures on my site, but I see how outsourcing some of the load can be efficient, even if it is not just pictures.
And Dave, I would love to hear your experience with maxCDN, when you get the time :)
.-= Patrick Toerner´s last blog ..Picking the Best Domain for SEO =-.
Mid-May at the earliest for maxCDN investigation.
.-= Dave Doolin´s last blog ..Does Google Think You’re a Dirty Rotten Spammer? (Hint: link anchors matter) =-.
Thanks for the MaxCDN tip – I’ll give it a go. $10 is very affordable if the 1TB is storage, not bandwidth. Also great if we can store non-photo graphics.
David,
I think there is possibly an upside to this problem.
Flickr is social media. Flickr is another place for people to find you – it is a satellite that leads to the mothership (your site).
A woman I know, Gwen Bell, is a young Empress Dowager of Social Media, and she is EVERYWHERE. Flickr is one of the paths to her blog.
Gretchen Rubin said recently that ‘ubiquity is the new exclusivity’ and I think that’s true. The more places you scatter breadcrumbs, the more trails for people to follow back to your site.
So your creative solution to the problem solves the problem, and, I suspect, might be a source of future traffic, too.
There are so many gaps and holes to fill and exploit in this space, and more growing all the time. I haven’t even started into using Google Buzz, but I am starting to get referred to archived buzz pages. That’s crazy!
So true!
With some of the shots I have labelled them in Flickr as “as appeared on inGoalMag.com” and have received some traffic that way.
Awesome post mate, this is probably the most comprehensive overview of this type of hosting issue and how to solve it that I’ve read.
Fantastic idea about using flickr btw, a great cheap solution.
.-= Josh Kohlbach´s last blog ..1 Technical Reason Why You Shouldn’t Load Full Posts On Your Home Page In WordPress =-.
Thanks Josh – kind words much appreciated – in fact as I’m sure you know they are the most important payment most f us get for our work!
I have the old http://www.commentluv.com hosted on a shared server and I recently had to completely remove every single file and replace it with a simple html file instead because the traffic to a single page wordpress blog was killing the server!
the flickr idea was a great solution, glad it worked out for you. I had to go the amazon route for comluv.com and it saved the server (for a price)
.-= Andy Bailey´s last blog ..CommentLuv Search Engine Update Coming =-.
Andy, I look forward to having such a high quality problem!
This comment got caught in spam queue, almost surely due to your link. I’m going to raise the limit on links in comments to “Hold 3 or more” instead of 2 or more. I don’t have any problem with legitimate links in comments.
Hi David,
I just first off wanted to thank you for tweeting this post. With getting back into the routine of getting the children to school, I missed this on Monday.
I don’t have a lot of images on the site but it’s something I need to investigate further since from here on in the only way is up and I don’t want the site crashing when that happens. (If I get my way, we’ll get a tweet from Stephen Fry one of these days and man, will that test our shared server!) It was great to get some pointers on how to check these things out because I had no idea.
As for Flickr, we do the same thing with You Tube and I agree with Kelly. The social side of that is really important for us.
Many thanks again,
Eleanor
.-= Eleanor Edwards´s last blog ..Friday Friends: Thank you everyone. You are my #FF stars! =-.