Highly Reliable Systems: Removable Disk Backup & Recovery


Monthly Archives: October 2013

A Cost Comparison of Cloud Backup versus Local

October 30th, 2013 by

We are firm believers that cloud backup makes sense to get data offsite with minimal hassle.  But there are times when local backup with removable disk drives makes more sense financially.  We were curious how a popular business backup service would stack up with someone who was willing to do backups in house and rotate the drives themselves.  So we decided to do a cost comparison of cloud backup versus local backup. For this comparison, we assumed a very small company with a single server that had 1TB of data.  This large data set would typically exist in an engineering firm, doctor with photos of patients (xrays etc), or a video production house.  The actual cost depends upon the assumptions (number of servers, rate of data fill etc).  We used a copy of world class server backup software from StorageCraft and 5 individual media trays rotated in a 1TB NetSwap Plus appliance.  By adding dynamic support contracts for 3 years, we insure the end user would not incur any additional costs. This Netswap Plus system with ShadowProtect would give the user a continuous incremental backup, with the ability to swap point in time drives periodically (Automatic Mirroring Technology).

Over 95% of the time you will want your restore to be done from a local copy.  While its true that you don’t have a real disaster recovery strategy if you don’t include an offsite copy, the difference between restoring an entire server from a local appliance and doing so from online is huge.  Recovery time with a local appliance is measured in hours instead of months for 1TB of data.  This factor alone may influence the decision towards a local solution – or at least a hybrid solution where both local and cloud copies are created.

There is more to this story.   Most lower end Internet connections such as DSL or cable have limited upload speed. We know that initially getting 1TB to the cloud is all but impractical because it would take 132 days working continuously with a typical 768Kpbs DSL upload speed.  Not to mention that during this entire 4.4 months the Internet would be unusable for anything else.  So we throw in the cost of a seed drive as shown on Mozy’s website.   The spreadsheet also has to account for the cost of bandwidth, which will be a factor in this scenario.  In fact, the speed is so limited that many businesses find that to have a practical cloud backup strategy they need to bump up their connection to deal with it.  At a very minimum this upgrade would cost $40 per month but a more typical upgrade of at least 512Kbps we’ve assumed will cost the business $100 per month.  As you can see, over the 3 year lifespan of the hardware, the customer saves a whopping $14,106.00 on hard costs of backup.  For that kind of savings, it may be worth swapping drives or using the NetSwap Plus and SpeedSeed to replicate to another local site.

HighCost

Posted in Blog

October 2013 Newsletter

October 30th, 2013 by

In this months newsletter we release the details of our new Replication & SpeedSeed features in our Network Attached Plus products.

Posted in News

6 Easy Steps to Calculate Data Changed Per Day for Backup. Incremental Backup Calculator

October 25th, 2013 by
Use Windows Explorer to search by Date

Use Windows Explorer to search by Date

If you are going to backup to the cloud (over an internet connection) you will typically first do a full backup, then do incrementals from then on. Most cloud vendors charge for how much data you store and/or send daily.  You also want to know this information to determine if your bandwidth can handle the amount of data during the backup window (typically overnight) that you have available.

How can you estimate the average volume of data that changes on your busy network in an average day? We wrote a incremental backup calculator with instructions here that will do it for you.  Or, let me show you 6 easy steps to calculate data changed per day for backup. We will use Windows Explorer either directly on the server or from a workstation.

  1. Login as administrator so you have rights to see all files. Open Explorer and make sure it is set to display hidden and system files. Otherwise Explorer won’t include these and your calculations may be off.
  2. Click the magnifying glass or search option (see picture or video)
  3. Choose a data range (recommend at least a week but month is probably better) and hit enter
  4. Wait for Windows to display all files/folders modified in that date range.
  5. Select only Files (Ignore folders or you will get a double count) by clicking the first one, scroll to bottom, hold down Shift and click the last one
  6. Right mouse click and select properties.   The total size of files changed over that period will be displayed.  Now just divide the total size by the number of days you selected in step 3 to get a daily average.

The number you calculate should be a worst case scenario.  If you are looking at your C: or system drive you may wish to exclude hiberfil.sys and pagefile.sys from the above file selections in step 5 (or manually subtract them from the total in step 6).  These files can be quite large and will always show up as changed if you have explorer set to show hidden and system files.

If your backup software does file level incrementals the estimate should be close.  If your software is more sophisticated and does block level incrementals, it will be high.  To understand why, imagine you open a large file, change one character, and save it.  A block level incremental backup program will transmit just 1 block.  This could be considerably less than the size of the entire file, which is what you’d have to transmit using a file level incremental backup system.

The video below does a walk through of the steps outlined.  If you have difficulty viewing the video try the YouTube link: http://youtu.be/UoQ8ZfvOOds

 

 

Posted in Blog

15 Reasons to use Backup NAS vs Generic NAS

October 16th, 2013 by

Pros and Cons of DAS, Generic NAS, and Specialty NAS for Backup Network Attached Storage vs. Direct Attached Storage

Network Attached Storage (NAS) devices are very common for adding shared storage to a small business network infrastructure. While providing an inexpensive and convenient way to store extra data, there are some common pitfalls to avoid if you choose to use a conventional NAS device or appliance for your backup. High-Rely makes specialized backup NAS systems and Directly Attached Storage (DAS) devices. Each has a place. In this overview we outline Pros and Cons of conventional NAS system, NAS for backup, and DAS device.WBA lft drive rflct_800

  1. Off-site Backup. The fact is, NAS boxes are usually designed as local storage, not transportable media. Experts widely acknowledge that data not transported offsite on a regular basis does not qualify as a “backup” at all. Many NAS boxes are simply not designed as true backup solutions.  Any NAS intended for backup should either have drives designed for daily removal, or include offsite data replication. Try not to rely on only 1 local copy as a backup. That won’t protect against fire, flood, accidental or deliberate erasure, theft, or a virus that may infect files throughout the local network. High-Rely’s NAS products include Highly-Removable Drive systems as well as Cloud facilities which provide the best of both worlds in an affordable and effective solution.
  2. Backup Focus. Almost every USB drive or NAS appliance mentions backup as one of the uses for the storage. But many of these treat backup as an afterthought. High-Rely designs are available in DAS and NAS all with our Highly-Removable Drives. Many include built in replication, automatic mirroring technology (AMT), and include things like the ability to quickly seed offsite backup. They also work with remote monitoring and Management (RMM) tools to monitor the backup hardware and jobs.  High-Rely’s NetSwap products can make use of our free NetSwap Dashboard utility for monitoring and managing multiple NetSwaps across the internet so that Highly-Removable Drive swaps, Sync and Replication jobs and status can be controlled from one web site.
  3. Automatic Mirroring Technology, Offsite Replication, SpeedSeedTM. These are three features available in some of our specialty backup NAS products that are not typically available in a generic NAS. AMT is where every backup job is automatically copied in the background (mirrored) to a removable drive. When the drive is swapped it creates yet another copy. This not only provides redundancy, but increases software compatibility because backup jobs are unaware of drive swaps. Replication refers to sending the jobs over the Internet to one or more remote locations. SpeedSeed works in conjunction with the other two features, allowing the removable drive to become the “master” drive at the remote site the minute it’s installed so replication can more efficiently use bandwidth to broadcast only changed files. These features can work independently or together. For a video introduction of how this all works please take a look at this 12 minute you tube video:
  4. NAS vs. DAS – Compatibility & Speed.  In Direct Attached Storage the drives are attached directly to a server (host).  This requires a USB or eSATA port, which typically requires an interface card be added. Unfortunately, since 2011 or so many name brand servers (HP, Dell, IBM etc) have been making it harder and harder to add 3rd party storage controllers (Host bus adapters) that allow DAS to work properly. If you need to backup name brand servers and want easy configuration then a backup NAS may be the solution for you. Although DAS can be a challenge to get working with your server, they are typically a little faster. That can be important when you’re backing up or restoring Terabytes of data in only a few hours. A typical Network Attached Storage (NAS) box connects via Gigabit Ethernet running at a raw data rate of 1Gbps. This is 1/3 the raw data rate of eSATA attached DAS, which runs at 3Gbps. In addition backup data transported over the LAN carries the overhead of the network stack (the TCP/IP protocols as well as Ethernet frames). Most Gigabit Ethernet NAS boxes top out at around 150 to 300 GB per hour for backup speeds in the real world. 10-Gigabit cards can improve this, but are expensive. High-Rely drives with a Direct Attached Storage (DAS) run at 300GB to 400GB per hour or more of backup data to the drive. But will also easily interchange with our NAS units for interoperability, allowing you to use the benefits of both at the same location.  Note:  these numbers are only rough guidelines. Actual speed depends on many variables. In general though DAS will move more data more quickly, which could be critical with today’s shrinking restore windows.
  5. Design Reliability.  NAS appliances require motherboards with processors, RAM, bridge chips, glue logic, and a boot device (Flash RAM or boot hard drive). Each of these components generates heat, uses power, and most importantly, is subject to failure. High-Rely backup NAS servers pay special attention to cooling needs and also offer optional redundant power supplies in many models.
  6. WatchDog. Have you ever had a computer lock-up on you? Whether it’s from a power glitch, heat, software bugs, or the odd energetic neutron from a solar flare, we’ve all seen systems become unresponsive. The first rule of computer troubleshooting is “reboot it”. It’s frustrating to know that rare onetime events could prevent you from getting a good backup. Such is the fate of many conventional NAS products, which are computers that are purpose built for storage. One way High-Rely has provided for reliable backups in our products is to include a small circuit called a watchdog, which monitors our NAS appliances to insure the hardware and software are alive and doing what they are supposed to do or it reboots them so they are ready for the next backup software job. If it is unable to reboot the system, an audible alarm notifies the user for attention.baredrive
  7. Protected Hard Drives. Almost all generic NAS drive trays are open at the top and back of the drive (See photo). These are designed to change out if the drive fails, but not intended for regular swap. Such “Bare” drive designs mean hard drives are exposed to shock, static, moisture, and other environmental problems when removed from the unit. Our Highly-Removable Drives fully enclosed and protect the hard drives during handling and transport.
  8. Removable Drive Trays. Many NAS solutions are intended to be fixed storage solutions.  It is important to be able to get multiple sets of physical backup copies so that a rotation scheme can be set up that insures current data is always available off-site.  Therefore, additional Highly-Removable Drives are readily available and inexpensive to purchase allowing you to have an unlimited amount of archive/offsite storage.  Our Highly-Removable Drives also interchange with our DAS products or can allow for emergency/in-field access and faster restores by plugging them in via USB3 or eSATA directly into the server being restored.
  1. Reliable Connectors. As mentioned above, most NAS designs expose the back of the drive so that the male SATA connector on the drive can mate with its equivalent female socket (or in some cases with a standard SATA cable). According to the SATA-IO Committee specifications, this connector is rated for only 50 plug/unplug cycles. Contrast this with the 1,000s of plug/unplug ratings of our Highly-Removable Drives and you realize that our Highly-Removable Drives are designed for the daily rigors of backup and frequent swapping.Media_Protection
  2. Drive Compatibility. Most NAS boxes are based on Linux, which uses a different hard drive format by default than Windows. These formats are referred to as EXT3 or 4 versus NTFS. If there is ever a problem with the NAS, you’d like to be able to pull the hard drive out and recover the data. One of the key features of High-Rely NAS drives is that you can choose NTFS without losing significant performance. This is not the case with all NAS configurations, especially those that use drive spanning or redundant configurations (Raid 0 or 5), which can have proprietary formats. These also have poor data recovery capability. Generic NAS boxes often use RAID 0 schemes, so the ability to recover data in situations where drives partially fail or data is corrupted is severely limited. Companies like Drivesavers.com or Ontrack can’t do as much with complicated proprietary configurations. However they often recover damaged data from single hard drives formatted with NTFS (The Windows standard), even those that have been in fires or floods. We offer backup NAS products with either Windows Storage Server OS or an affordable Linux OS.
  1. Windows Compatibility. The newer Windows Operating Systems are not always able to authenticate Linux based NAS boxes because they use older versions of Samba. Security that has been added to Windows prevents Samba hard drives from being seen because Windows defaults to using the NTLMv2 authentication.. In order for these types of NAS boxes to be compatible you must lower the security of Windows by changing registry settings, possibly impacting your domain security. http://practical-tech.com/operating-system/getting-vista-to-work-with-samba/177/
  1. Easy Administration and Security. Most NAS boxes are based on Linux running Samba to share their hard drives. The problem is that if you change a password in Windows for a user, you may be forced to change the password a second time for the NAS. This extra administrative burden is eliminated when using High-Rely NAS appliances, which can join a Windows domain and inherit the full security capabilities of the host server. They also support iSCSI, allowing drives to be accessed directly as Windows volumes through a network connection.
  2. No User Limitations. Look closely at the specifications of a NAS box and you may discover license limitations that prevent simultaneous access by more than 15 users. High-Rely NAS or DAS drives are not limited.
  1. Warranty and Reliability. Many NAS warranties are only 90 days. The standard High-Rely warranty is 1 year with extended warranties to 5 years available. The care that has gone into the cooling systems, the audible alerts, other facits of reliability and the fact we warrant everything including the hard drives make High-Rely a more enterprise solution than most NAS boxes.
  1. Monitoring or Auditing. Being able to have a log of whether drives were swapped for a backup job, or when a replication completed is important. Generic NAS devices don’t provide this important security and manageability feature. With Direct Attached Storage (DAS) such as High-Rely drives, this information is available to you natively as part of the Windows Event viewer and auditing system. With our NAS products, we support log files, which can be monitored with RMM tools like Labtech, Level Platforms, N-Able and the like.  We also provide for free, a powerful NetSwap Dashboard utility that allows for the monitoring and management of a large number of NetSwaps anywhere on the internet all from one website. 

Summary:4 bay 1 out mock Both network and direct attached removable hard drives (NAS and DAS) can be effective for local backup and offsite storage. High-Rely backup NAS appliances offers more choices, reliability, and flexibility for backup than conventional USB and NAS drives that lack removable drives or specialize in disaster recovery. In addition, there is a line of larger products called a RAIDFrame that use RAIDPac Highly-Removable Drives (up to 24TB each!). These integrate RAID 0/5 controllers to provide for both larger volumes and more redundant storage.

 

 

Posted in Blog

Largest Hard Drive 20TB?

October 2nd, 2013 by

Could we see the largest hard drive be 20TB  by 2020?  Right now, we have the RAIDPac, which can be 8TB when set in RAID5 mode and 12TB in RAID0 mode, but of course we’re cheating a bit when we call that the world’s largest removable storage because each RAIDPac actually has three 4TB drives and a controller in it.

Largest removable Drive for backup - The RAIDPac

Largest removable Drive for backup – The RAIDPac

But if we’re talking about the largest single drive, Seagate Technology plc is demonstrating its next generation heat assisted magnetic recording (HAMR) technology at CEATEC 2013 on TDK Corp.‘s booth October 1-5th 2013.  HAMR technology is said to have the potential to create a 20TB drive by 2020 according to Mark Re, Seagate CTO.

HAMR increases the storage density by heating the platters with a laser at the spots the bits are being recorded.  Heating makes it easier to write and subsequent cooling stabilizes the data.  HAMR is expected to deliver storage densities as high as 50Tb per square inch.  The next generation drives are expected to be 2.5″ enterprise class products spinning at 10,000 rpm. We talk a little more about HAMR and some other competing technologies in this article.  

The demo is discussed in more detail  in this Forbes article.

 

Posted in Blog