Archive for the ‘Uncategorized’ Category

Scaling and Monitoring the Clouds

Tuesday, May 19th, 2009

The usefulness of Amazon’s EC2 cloud took a step forward recently with the introduction of Amazon’s own real-time monitoring, auto scaling, and load balancing product offerings. Most of these were already services offered by third parties built ontop of Amazon’s and other provider’s clouds, such as Mosso, or through custom implementations of HAProxy, etc. However, the integration should allow for easier administration and better support.     

There continue to be reservations by many companies over the feasibility of running critical systems or placing sensitive data on third party clouds. While we have not lost a major cloud computing provider yet, undoubtedly because they are all still so new, other third party storage providers have recently shutdown as noted in PCWorlds article Will Your Data Disappear When Your Online Storage Site Shuts Down?  Granted that these storage providers’ business models were very different, often giving away storage for free in hopes of up selling users on other products such as printing of photos. ISP’s and hosting providers do go out of business all the time, leaving customers in the lurch. Failure is not reserved for small businesses as we’ve seen recently with banks and car companies. As Alan Williamson, co-founder of AW2.0 a cloud computing firm, stated “Users cannot absolve themselves from being 100 percent responsible for their own data.” The cloud computing offerings are becoming more mature but they still require companies to understand the pros and cons in order to make wise decisions and plans in the event of service outages or business failures.

Checklists

Sunday, March 8th, 2009

The “Annals of Medicine: The Checklist” is an article from the New Yorker in Dec 2007.  Besides reminding us that we really want to avoid a trip to the Intensive Care Unit, it also spells out how checklists are important when performing complex tasks, even if they tend to be routine.  One study showed the implementation of a 5 step process, that was strictly adhered to, prevented eight deaths in just over a years time.  The article states “Checklists established a higher standard of baseline performance.”

Another article “Study: A Simple Surgery Checklist Saves Lives” in Time, describes similar studies and findings.  In the study described, death rates dropped from 1.5% to 0.8%.  Both articles mention the use of checklists by pilots, due to the complexity of the systems and machines that they operate.

Your system, including the application as well as the entire development and deployment process is likely to be very complex. The lesson we should take away from these articles for all our technology teams is that checklists are important, they reduce the number of problems caused by human error.  You don’t need hundreds of steps, the few key steps are all that is required, and then strict adherence to it.  When you finish the release at 2am you’re probably not thinking as clearly as you normally do, don’t rely on your memory for checking the site.  Have a checklist for critical parts of the application to verify before you head to bed.

Sounds of hard drives dying

Thursday, March 5th, 2009

If your laptop starts making any of these sounds you are probably about to have a bad day.  What happens when your servers start making these sounds?  Pulling a server our of rotation for a hard drive failure and then having to ghost, jumpstart, or kickstart it again is a waste of time and resources.  

Depending on your application it might make sense to consider ordering your next set of app servers with solid state drives (SSD) instead of hard disk drives (HDD). When the disk storage is used primarily for the operating system, web/app server, and code these configurations start to make sense. The higher price might very well be offset with the faster speed and lower heat as well as  less energy consumption and greater mean time between failures.  

Venture backed startups

Monday, March 2nd, 2009

Juan Enriquez, a leading authority on the economic and political impacts of life sciences, gave his annual talk at TED this year and had some great insights. His presentation was called “Beyond the crisis, mind boggling science and the arrival of Homo evolutis.” Besides his perspective on the singularity, as in “The Singularity is Near” by Ray Kurzweil, he had an interesting take on the economy.  If you don’t check out the entire 18 min video, go to min 7:00.  He talks about how venture backed startups are 0.02% of the GDP investment but generate 17.8% of the output.  As he states, these companies are the future of the U.S. economy.

Storage Headaches 2

Saturday, February 28th, 2009

We posted a blog last week about how many of our clients decided a year or two ago that as part of their product offering they would provide storage of user data. We pointed out that this occurred with no foresight or cost calculations and so these companies decided that this was either unlimited in amount, perpetual in duration, or worse, both. Today these companies are scrambling to figure out ways to lower the storage cost or charge customers.  I received this notice in my in box today, while Yahoo is not a client of ours it looks like they are facing the same problem.

 

 

 Yahoo!
       

Dear Yahoo! Briefcase user,

We will be officially closing Yahoo! Briefcase on March 30, 2009. Until then, we are offering you the opportunity to download your files back to your computer. You will need to take action before we close, after which any files remaining on Yahoo! Briefcase will be deleted and no longer accessible.

To access your Yahoo! Briefcase account, click the link below: