Posted by Matt Spada on Tue, May 15, 2012
You probably know by now that we love to talk about preparedness. You also understand that testing (aka: practicing) is really the best form of preparedness. We focus, or borderline nag, on the importance of challenging your assumptions that make up your disaster recovery procedures. The goal is discovering inconsistencies or gaps in your plans and finding out which processes you can improve upon. So what kind of company would we be if we didn’t practice what we preach?
On May 3, Agility conducted its annual Table Top Testing Exercise. For 2012, we decided to do things a little bit differently. Per Agility’s tradition, the participants were kept in the dark with regard to what mock disaster scenario we’d be facing, but this year we added a twist. Rather than break away into groups and work out the kinks in small groups, we did a full two days of role playing with the whole company. That’s right, the most terrifying style of public speaking known to man…improv in front of your peers. We pushed ourselves beyond our comfort zone because we know it takes an extreme level of preparation to perform when all the chips are down and everything around you is in chaos.
Agility’s Operations Team, along with some of our fantastic partners like Globecomm Systems, General Electric, Modspace, and many of our generator providers, gathered around tables with our teams in the Charlotte office. Together we learned the Mississippi River had flooded on a Sunday, and by 6:15 PM in our mock scenario, we’d already had 45 members call in and place us on “alert status.” In other words, they were giving us a heads up in the event that the flooding has an impact on their company. By Monday morning, the number of alerts grew to 175 members, with 10 members already beginning the actual recovery process. Tuesday brought us up to 215 alerts and 37 members recovering and the Wednesday numbers jumped to 345 alerts and 72 members in recovery mode. Whew!
We were called up one by one to the front of the room to react, on-demand, to whatever scenario was thrown our way. We had to perform as we normally would in a realistic situation and afterwards, we returned to our teams to discuss what was done and how it could have been done better. During that time, we also answered questions that were posed to confront and even dispute what we thought might happen next. So, in our exercise, we navigated new routes due to closed roads and bridges, brainstormed the most efficient forms of communication during a regional event, challenged our existing procedures for member recoveries and conceptualized new ideas for improvements down every avenue.
Needless to say we had a number of takeaways from this year’s Table Top. We are cross-training more Agility employees to ensure the highest level of productivity during disasters. We’ve scheduled lunch-and-learns on various programs that we want to familiarize ourselves with in order to enhance Agility’s recovery procedures. We have documented details on different solutions for member support, mass communications, and ongoing internal support during regional events, etc.
Together with our partners, we tested, challenged and evaluated ourselves. It was wonderful to see the company and our partners come together in one room with one common goal: continual improvement while always protecting and preserving our 100% success rate.
Tests conducted by our members are never a matter of pass or fail, but rather a progressive journey in always being ready for tomorrow.
Posted by Sarah Rixey on Thu, May 03, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
Testing in Progress
Every year, Agility conducts an internal table top testing exercise that usually consists of a two-day meeting with employees and vendors. The goal is to simulate each of the steps taken during a recovery in order to test our own disaster recovery plan, identify shortcomings, and help key personnel practice their recovery responsibilities.
As a part of this year’s test, we invite you to join us as we document our mock recovery. Follow us on twitter for live updates, educational resources, and tips on how to conduct your very own testing exercise.
Last year’s mock disaster scenario involved a hurricane that made landfall in Florida, traveled up the east coast, and left dozens of members without power. Then to make matters worse, a few days following the “hurricane” a massive tsunami pummeled the west coast affecting members and vendors alike. What will it be this year... how will we cope? Click here to find out.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
Posted by Sarah Rixey on Wed, Apr 25, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
Force of Nature
As we mark the first anniversary of one of the largest tornado outbreaks in U.S. history, the National Oceanic and Atmospheric Administration (NOAA) and the Federal Emergency Management Agency (FEMA) are teaming up this week to save lives from severe weather by encouraging the public to take proactive preparedness measures and inspire others to do the same.
As part of the first ever National Severe Weather Preparedness Week, citizens and municipal officials alike are encouraged to be a "force of nature" through a number of proactive steps:
- Know Your Risk: Be aware of the severe weather risks in your area. It is also important to understand how these potential threats could impact you and your family.
- Take Action: Develop a plan. Put together an emergency kit and practice where and how to take shelter should severe weather strike.
- Be an Example: Actively promote what you're doing when severe weather is headed your way. Create a YouTube video, post your story on Facebook, comment on our LinkedIn page or send a tweet to let people know you are taking shelter as it may encourage others to follow suit.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
Posted by Sarah Rixey on Wed, Apr 18, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
One Fine Day
It’s about time. The U.S. severe weather map, which is usually a rainbow of colors indicating various imminent threats, is a rather blank slate today. What a relief.
And while some may say it is the calm before the storm, others may consider it a day for relaxation. Here at Agility, we view it as an opportunity to plan.
So what can you do to take advantage of the quiet days like today? Click here for a simple disaster recovery to-do list to help you effectively plan today for the disasters of tomorrow.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
Posted by Sarah Rixey on Wed, Apr 18, 2012
Disaster Recovery To-Do List
Update Key Contacts - It is important to maintain up-to-date contact information for all employees, customers and vendors including their names, titles, recovery responsibilities, street address, mailing address, all phone numbers, a friend or relatives contact information, and email addresses. Then, keep this information offsite so if you need to access the information quickly you may do so. If you are a member of Agility you may use your myAgility account to store and update this information.
Develop an Evacuation Plan - Share your plan and meeting place with employees and post it around the building. Schedule a drill so all employees know exactly where to go and what is expected of them.
Make and Emergency Kit – You may have to evacuate at a moment’s notice and most likely will not have time to search for the supplies you need. A disaster supply kit is simply a collection of basic items you may need in the event of an emergency. Click here for a complete list of things to include in your kit.
Back up your Data - Backing up your data is an important task you need to perform on a regular basis. Also, remember to store your data in an offsite data storage facility. There are many offsite storage solutions available. Take a few minutes online and find the best solution for you.
Make Copies of Important Documents - This includes insurance papers, contracts, tax documents etc. Scan them into the computer and then store them offsite. Again, if an Agility member you may use your myAgility account to store this information.
Delegate Responsibility – Every disaster recovery plan should have a list of 'who is responsible to do what tasks.' For example, someone needs to be assigned with the following: securing the existing site, finding a new work site if necessary, arranging for new computer systems, retrieving the backup data, restoring telephone and fax service.... the list goes on. It needs to be decided who will do what. Luckily if you are a member of Agility, you just need to delegate someone to call us and we will take care of the rest.
For more information about how Agility can help your businesses prepare and recover from disaster call 866.364.9696 or visit www.agilityrecovery.com
Posted by Sarah Rixey on Mon, Apr 16, 2012
The Road to Recovery
Location: Columbus, Ohio
Industry: Insurance
Membership Package: ReadySuite
Interruption: Tape Drives
When one of our members in Ohio called in, he wasn’t in a panic. There was no fear or urgency in his voice and there were no sounds of chaos in the background. He had simply called Agility to tell us that he was in need of tape drives. His tape library had failed and he needed a temporary replacement in order to continue backing up his data. Continuity Planner, Tom Combs, exchanged info with him and drew up the next steps of his recovery strategy in less than an hour.
After walking through available options, our member was relieved to know that rather than opting for an exact replacement, he could instead use two of the three tape drives he had access to through his ReadySuite Membership that would save him money. He immediately asked us to send him the equipment, stating “I didn’t want to rush into buying equipment – it was nice to be able to replace it right away.” Last year, he’d tested his recovery plan with Agility, which only added to his peace of mind and confidence in depending on us.
Our member saw that we were truly a partner in recovery and actively seeking out the most cost effective route with no other focus other than getting him back in business. This gave him the peace of mind to be out of the office that same week, knowing that he won’t have to think about tape drives because he has a partner he can trust to be there even when he’s not. He knows that Agility’s got his back.
Posted by Sarah Rixey on Fri, Apr 13, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
Plan. Practice. Prepare.
Resilience – the ability to overcome obstacles, is part of the DNA of all well respected leaders; especially when it comes to disaster recovery. For some people, resilience and the ability to think calmly and react swiftly, comes naturally. For most of us, resilience comes with a great deal of planning, practice, training and experience.
Take the “Miracle on the Hudson” as an example. The pilots of that flight had a 100 page disaster recovery plan at their fingertips. But without intense practice in flight simulators, and his long history of flying glider planes, Captain Chesley Sullenberger’s emergency landing on the Hudson River could have just as easily ended in tragedy.
So what can you do to prepare your organization and become a more resilient leader? Click here for some advice and lessons learned from the heroic actions of Captain Sullenberger and his crew.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
Posted by Mark Norton on Tue, Apr 10, 2012
US Airways Flight 1549 took off from LaGuardia Airport in New York City on January 15, 2009, headed to Charlotte, North Carolina. Three minutes into the flight, the plane struck a flock of Canadian geese which resulted in an immediate and complete loss of both engines. At a mere 3000 feet, the crew of the aircraft quickly determined they would be unable to reach any airfield so they turned to glide over the Hudson. What happened in the next 4 minutes determined the fate of the 155 individuals on board.
Immediately after losing both engines, Captain Sullenberger, took the controls and began considering his options: turn back to LaGuardia, find a nearby airport, or crash land somewhere over Manhattan. While he was speaking with Air Traffic Control, his Co-Pilot, pulled out their Flight Manual (aka their extensive Disaster Recovery Plan which was hundreds of pages), found the 10-page procedure to follow when both engines fail and began frantically working his way down the checklist to re-start the engines.
After a quick assessment Captain Sullenberger determined that an airport landing was going to be impossible under the circumstances. The nervous Air Traffic Controller kept relaying options at all available airports within a 10 mile radius, but nothing was close enough. While trying to suppress his adrenaline, emotions and fear, Captain Sullenberger, fell back to his countless hours as a glider pilot in order to stay in control of the plane. Two minutes after the collision and two minutes from impact, Sullenberger spotted his destination and calmly told the Air Traffic Controller "we’re going to be in the Hudson."
The Co-Pilot continued his relentless efforts to restart the engines without success. As the plane hovered just a couple hundred feet above the Hudson, the Captain instructed the crew and passengers to prepare for an emergency landing by declaring "Brace for Impact!" which were the first words uttered to the passengers and crew since takeoff.
Seconds later the plane skipped across the Hudson and cheers rang out when the plane safely came to a stop after impacting the water at over 150 miles per hour. However, the moments of relief were quickly drowned out by water pouring in the back of the aircraft as the plane began to sink. In less than 25 minutes, the plane would be at the bottom of the Hudson which was a chilly 38 degrees.
As you know, all 155 people escaped death that day by finding safety in nearby ferry boats that came to their aid within minutes, however you may not know why this plane, which was designed to stay afloat, sank so quickly. Turns out there is a 'Ditching' button above the Co-Pilot’s chair which seals the aircraft and prevents it from sinking. So why didn’t the crew press this all important button?
Perhaps it was their inexperience with this situation, the lack of time, or the overwhelming emotions…but I believe it was simply that their plan wasn’t designed for that specific situation.
You see their 10 page procedure for restarting the engines was written to be followed when an aircraft was at 30,000 feet and had almost half an hour of flying time before impact. Their plane was at 3000 feet and had four minutes before crashing so they simply didn’t’ have time to read the last paragraph on the last page which tells them to press a small, little button that would’ve kept the plane from sinking.
In spite of the failed plan, this incredible event could not be described as anything but a success. In fact, the entire crew of Flight 1549 was awarded the Master's Medal of the Guild of Air Pilots and Air Navigators, and many have described their experience as "the most successful ditching in aviation history." However, the reason I believe this is such a herald story is because of the countless hours of experience that Captain Sullenberger had in flying planes without engines. When they were in a grave situation, he was in a familiar place, and simply acted as he was trained.
As a Senior Continuity Planner with Agility, I have found that a lot of organizations and individuals put a heavy emphasis on the plan. My recommendation is that your focus not be so much about the plan, but instead about the recovery and how you can prepare for one. Because of the nature of an emergency which is a sudden, urgent, usually unexpected occurrence requiring immediate action, it is highly unlikely that the event will unfold the way you or I are planning for it to.
I think the Army said it best when describing how to immediately respond to an emergency: "Plans are worthless, but planning is everything." To get started with your 'planning' simply start talking. Schedule a meeting with team members that could play a hands-on role with recovery and begin to understand the different assumptions people have made about what to do and find common ground. Focus on the various ways you could handle an emergency beginning with your communications. Make sure you have a few ways to communicate among yourselves, to your employees, and to key vendors and clients.
Know that when disasters strike, time is running out, and the actions you take in those critical moments will define the future of your organization. The biggest observation I have seen over Agility’s 23 years and 1000 rescues is that the most successful actions taken during a disaster aren’t found on a page, but instead in someone’s trained ability to respond. By the way, if you and I were on flight 1549 and started reading this story immediately after losing both engines, the Captain would be coming on over the intercom right now instructing us to "Brace for Impact!" Are you ready?
Posted by Sarah Rixey on Thu, Apr 05, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
Disaster Assistance
Multiple tornadoes ripped through the Dallas-Fort Worth area Tuesday, flattening homes and thrashing large tractor trailers. And while thankfully no deaths have been reported, people in the area are still suffering as the violent storms left hundreds of homes and businesses in ruins.
After a large natural disaster like this, it is important to know what resources are available to help you get back on your feet. Organizations like the U.S. Small Business Administration (SBA) have developed disaster assistance programs to financially help individuals, families and businesses rebuild after suffering from economic loss.
Disaster assistance is a topic that should not be overlooked. It can play a pivotal role in easing the pain and cost of rebuilding your life following a disaster. To learn more about this subject, join Agility and the SBA April 10th for free educational webinar on everything you should know about disaster assistance funding.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
Posted by Sarah Rixey on Wed, Mar 28, 2012
As part of our comprehensive disaster recovery planning services, Agility Recovery Solutions sends out a free weekly tip through email. If you would like to receive these tips, please sign up here.
Ask Away
We know... disaster recovery can be an overwhelming topic. That is why we developed our 52 week tip program – to address complex issues in a simple and easy to understand format.
And while we strive to address a variety of topics, we know you may still have questions. So this is your chance to ask us anything you want. No subject is off limits and no question will go unanswered.
Here’s how it works. Simply click here to submit your question. Then join us, April 11th for our free webinar, Business Continuity & Disaster Recovery Hot Topics: YOUR QUESTIONS ANSWERED. The most frequently asked questions with wide applicability will be answered on air, while others will be addressed individually offline.
Due to the popularity of this topic, we recommend interested participants submit their questions and register for the webinar as soon as possible.
If you have additional questions or would like to talk with a recovery professional about your business continuity needs visit www.agilityrecovery.com or call 866-364-9696.
