Posts Tagged ‘hurricane preparedness’

SunGard Carlstadt Business Continuity Center serves as Command Post, Shelter During Hurricane Sandy

By George Gobla, Technical Service Delivery Manager

Police, firefighters and EMTs from Moonachie, N.J. used the SunGard Availability Services business continuity center in Carlstadt as an emergency command post during Hurricane Sandy.

Like most other residents of the East Coast, I had been following the news about the approach of Hurricane Sandy vigilantly. As a New Jersey resident, my interest was even greater, as the storm the media dubbed “Frankenstorm” was tracking to make landfall on the evening of October 29 over the New Jersey shoreline and proceed inland.

When it became more likely that Hurricane Sandy would be as destructive as many experts were predicting, the storm was also becoming a concern from a professional standpoint.  As the technical service delivery manager for the Northeast region for SunGard Availability Services, it’s my job to make sure that our facilities in Carlstadt, N.J. – a town about 15 miles west of Manhattan—are operational for our customers during any crisis.

A week prior to the hurricane’s arrival, SunGard activated its three-stage hurricane preparedness process. As part of the process, we carefully followed tested procedures to help keep our employees safe and our customer data secure, our facilities secure and our communications consistent. Along with personnel at other data centers that could be affected by the natural disaster, our on-site facilities team verified that all environmental and electrical gear was in full working order before the storm.

We felt well prepared in Carlstadt despite the fact that New Jersey would face the full power of Hurricane Sandy.

On Monday, October 29, the weather worsened throughout the day. At about 9:30 p.m., I started the one-hour drive from my home to Carlstadt. As I found out later, I was the last person to drive through the local area just before the hurricane hit.

After navigating several detours, I arrived at SunGard’s mega center in Carlstadt—home to two data centers and a business continuity site, which provides customers with a fully functional alternate work space for employees to use while in disaster recovery.

At our Carlstadt data centers, we provide advanced recovery, testing, advanced replication and hosting for customers. That night, my colleagues and I were working furiously to assist customers. Some customers initiated an orderly process of shutting down their equipment, and we were able to control the situation so there was no customer impact due to data center issues.

We also had a number of customers at our facilities and we communicated with them personally and kept them updated throughout the evening. Additionally, there were multiple notifications from our Service Desk and direct phone calls to customers.

As this was happening, at around 11:45 p.m., we had some unexpected visitors. The fire chief of a small nearby town, Moonachie, arrived in his SUV with three ladder trucks, two ambulance squad trucks, and a police cruiser in tow. Moonachie was being overrun with floodwaters from a storm surge caused by Hurricane Sandy, and the officials said they needed refuge and shelter for their own operations, and also for citizens that would be rescued throughout the night.

They asked if SunGard would open its business continuity site for this purpose, and I immediately said yes.

Within minutes, the fire chief had pulled his SUV to the front of the building, opened the back hatch and began using the area to respond to 911 calls and direct emergency operations in the field. Soon after, more emergency responders and the mayor of Moonachie, Dennis Vaccaro, arrived at the business continuity site, and the area became the command post for the duration of the night.

Those that were rescued from their flooded homes, and in some cases from the roofs of their cars, were taken to the SunGard business continuity center. Sheltered and comforted with sheets and blankets, they remained in safety while the hurricane and flooding lashed Moonachie.

In total, our facility provided shelter for approximately 60 residents rescued from danger, and 40 fire, rescue and police.

The Carlstadt facilities remained dry and operational throughout the storm, and I was extremely proud that we were able to assist the community in a small but useful way during Hurricane Sandy.

Frankenstorm is Coming…How’s Your Disaster Recovery Plan Holding Up?

By , CISSP-ISSAP, ISSMP, MBCP, MBCI

Hurricane PreparednessApparently what’s headed for the East Coast is a “monster” of a storm. It’s so bad, in fact, that they’re calling it, “Frankenstorm.” The prediction is that this confluence of forces (including Hurricane Sandy and two other weather fronts) will combine to hit the Northeastern part of the United States the week of October 29 with a force and fury not seen since 1991′s “Perfect Storm” (which, coincidentally, also happened during Halloween week).

So what can your company and your employees do to prepare for what may be coming? If you haven’t already done some rigorous business continuity and disaster recovery planning, now might be a bit too late to start. But you can at least make sure that you have copies of your critical information in more than one location in case the storm damages or destroys your primary computing or storage infrastructure. And, it’s almost – but not quite – too late to locate and sign up for a cloud backup solution, even if you don’t yet have a way to recover your data. At least your data will be safe and you can worry about getting it back later.

If you do have a plan, you’ll need to dust it off and look up the part about “employee notification.” SunGard has a significant number of employees in the Northeastern United States, and we used our own SunGard NotiFind software this afternoon (yup, we eat our own dog food) to tell those potentially affected what the forecasters are predicting and remind them of what they need to do now and next week.

What we are telling our employees is probably important for any company, so let me share some of it in case it might be helpful to you. First of all, every employee should be ready at any time to live without power and communications for at least 72 hours, which means having additional food, water, clothing, and toiletries on hand. Employees should be making alternative arrangements to take care of dependents should they be isolated at the office (such as ensuring that their school-aged children are picked up and cared for).

Non-essential employees should discuss alternative work options with their managers, while mission-critical employees may want to make plans to be in the office or at their backup work site before the storm hits, fortified with enough resources to ride Frankenstorm out. Many companies have “work at home” plans for disasters such as this, but there are reasons why telework may not be the perfect alternative work strategy in a regional disaster such as this.

Some other actions you might advise employees take include:

  • Update their personal emergency contacts (alternate information if evacuation occurs).
  • Make sure they know where their family is and how to contact them. The best bet is to have everyone contact a specific person who lives outside of the disaster area. The chances are higher that their call will get though than if they call someone else within the storm area. (SMS usually works better than voice calls.)
  • Update their contact information in the employee address book to make sure that their manager and coworkers know how to reach them.
  • Review hurricane preparedness plans for both your company and personal situations.
  • If you have oil lamps or generators, ensure that you have enough fuel for them. Make sure that anything that needs batteries has fresh ones available.
  • Don’t forget that Voice over IP (VoIP), cable television, and cell towers may not be working. Even if they are, your cordless phone and cell phone might be out of power.

SunGard has been helping companies recover from disasters for over 30 years and we are ready when you are. Our own key employees have been briefed on the situation and are prepared to take our customers’ calls and help them recover. For us, “Frankenstorm” will be no different than any other disaster, and even though we hope you don’t need to call us for help, we’ll be here if you need us.

Disasters Have a Way of Making You “Wake Up” and Rethink Recovery

By

Hurricane Preparedness When I was a kid growing up in the Southeastern United States, I spent a lot of time in the back of my Mom’s lime-green Dodge station wagon, accompanying her on her many business trips to Miami, Florida. I used to love it when I got asked to go, because a) it meant I could miss school; and b) it meant I could eat as many of those delicious Florida mangoes as I wanted.

I remember driving back with her once during a hurricane – she thought she could “get ahead of it” and get home to Savannah before it got too bad. Well, she was wrong.

The storm seemed to descend from nowhere, and things got so windy, rainy, and gusty that we had to pull over to the side of the road to wait it out. It was actually very scary as she and I sat huddled together in the back seat, witnessing the awesome powers of nature crash through the world around us.

Suddenly, we heard a loud CRACK, followed by the sound of glass breaking. When I turned around to look behind us, I saw that a mango had crashed through our back windshield, creating a giant, gaping hole. I remember being delighted, as it meant I could eat another of my favorite fruits, but my Mom was pretty upset.

Fast forward an unspecified number of years (no chance I’m divulging my age), and now I am working at SunGard Availability Services. When I read this case study on how a series of 2004 hurricanes had forced Florida Hospital to “wake up” and rethink their disaster recovery capabilities, it brought back this memory for me.

While the hurricanes did not force Florida Hospital into a declaration of disaster, it did force them to face the unpleasant truth that they did not have the staff, or the time, or the expertise in place to meet their recovery time and recovery point objectives (RTOs/RPOs). Which is why one of the largest healthcare providers in the entire state turned to SunGard Availability Services for help. In particular, they are now relying on SunGard’s proven expertise to manage all of the aspects associated with testing and recovering their data in the event of a disaster (our “Managed Recovery Program”).

Now that I’m a Mom, I’m actually somewhat appalled at the risk my mother took with me. While I love the idea of mangoes flying unbidden into my kid’s lap, I would never drive home during a hurricane, with or without her. So I’m glad Florida Hospital looked themselves in the mirror and figured it out; it shows a greatness of vision, I think, as well as the wisdom to take responsibility for their destiny and the willingness to take concrete actions to fortify their future.

————————————————————–

You can’t predict a disaster, but you can decide how prepared you’ll be.  To help our customers keep their systems, business processes and people in operation in the face of the increasing threat presented by hurricane seasons, we’ve developed a free Hurricane Planning Toolkit—available now, for a limited time.  Download the FREE Hurricane Preparedness Toolkit 

 

Recovery in the Cloud Boosts Hurricane Season Preparedness

Hurricane season brings into focus the need for companies to reexamine disaster recovery plans.  As we’ve been meeting with companies on how to prepare for the volatile weather season, we advise organizations to approach hurricane preparedness not as a reactive disaster recovery process but as the opportunity to manage a hurricane as a planned event. The plan process can benefit organizations not just on their worst day, in the wake of a disaster, but every day, by revealing critical gaps in the availability of production environments.

Unlike many other weather-related events, hurricanes have a relatively long warning time-frame, which can allow for the proactive relocation of people and corporate assets in advance of the storm rather than waiting for the worst to occur.

As part of hurricane preparedness, companies should examine the role cloud computing can play as a new platform for lower-cost applications recovery.  Infrastructure recovery is evolving to include a combination of physical, virtual and cloud components, allowing organizations to mix and match to meet specific needs of the applications and systems being recovered.  Incorporating this expanded range of options makes it more critical than ever to be sure your  recovery service provider has proven experience in handling real-life production operations along with designing high availability solutions and managing business continuity plans.

Additionally, recovery plans should include a process to guide operations in moving back to production systems from recovery sites following failures and disaster threats, such as after a hurricane passes.

What’s more, many businesses fail to take into consideration the time it takes to move recovered applications back to a production environment following a disruption. Automation capabilities, and careful sequencing of data resynchronization and service restart, are essential in speeding this process and minimizing the impact on business users.

Among the other drivers behind the trend toward recovery in the cloud are:

•Cloud-based recovery services utilize a shared, not dedicated, IT infrastructure which can help reduce customer costs of having additional capacity available when it is needed.
•Cloud computing provides a service pricing model so companies can ramp up capacity as needed during a hurricane response, without incurring added CAPEX.
•Fully-managed recovery services on a cloud platform can help reduce the cost and burden of recovery planning and testing during a disaster.
•Recovery planning and testing can reveal critical gaps in production environments and help close those gaps for improved daily operations.

What are your recovery plans during Hurricane season?