NAS


Lime Technology's unRAID 6 Brings Containers and Virtualization to NAS Units

Lime Technology’s unRAID 6 Brings Containers and Virtualization to NAS Units

Consumers looking for network-attached storage have plenty of options. Most businesses go for a commercial off-the-shelf (COTS) unit, while enthusiasts and home users can go for either COTS or do-it-yourself (DIY) units. There are plenty of excellent COTS NAS vendors in the market, including, but not restricted to Asustor, QNAP, Seagate, Synology and Western Digital. QNAP and Synology have been at the forefront of bringing new features to COTS NAS units. On the DIY front, consumers can go for a dedicated NAS build or re-purpose an existing PC.

Some of the popular operating system options for DIY NAS units include Windows and its server variants, NAS4Free, FreeNAS, Rockstor etc. While NAS4Free, FreeNAS and Rockstor are free open source solutions, Windows and its server variants are paid options. Lime Technology’s unRAID is a Linux-based embedded NAS OS that belongs to the latter category.

The following trends have been observed in the evolution of NAS operating systems over the last couple of years:

  • An attempt to move from the traditional EXT3 / EXT4 to the more robust and modern ZFS and btrfs file-systems
  • Movement of enterprise features such as high availability down the product stack
  • Extensive focus on SDKs for enabling third-party applications / mobile-OS-like app stores
  • Extending core functionality via features such as virtualization (NAS acting as a host for virtual machines) etc.

In the COTS space, QNAP’s QTS brought about virtualization support more than a year back. Synology’s high availability feature has been around in their business-class units for some time now. In addition, Synology’s DSM 5.2 as well as QNAP’s QTS 4.2 beta brought about Docker support. Recently, Lime Technology issued a press release to highlight the release of their unRAID Server OS 6.0 and proclaimed it to be the first non-beta NAS OS with support for both virtualization and containers (Docker). Where does unRAID stand in the current ecosystem of NAS units? Is it a good choice for your particular use-case? Read on for our analysis of the press release.

How does unRAID Work?

Traditional RAID systems use RAID 0, RAID 1, RAID 5, RAID 6 or some combination thereof. These RAID levels stripe data over multiple disks and, for non-RAID 0 or RAID 1 systems, also distribute parity blocks across the member disks. unRAID is not like these traditional RAID systems. The closest it can be compared to is RAID 4, a system in which data is striped across member disks and parity is always written to a dedicated parity disk. In the case of unRAID, the data is never striped. A given file is written to only one of the member disks. A dedicated parity disk enables recovery in case of a single disk failure. In addition, the disks can be of different sizes, as long as the parity disks is the largest of the lot.

unRAID 6 is a lightweight system in the sense that it can be booted off even a 512 MB flash drive on any x86_64 system. Usage as a NAS only requires 1 GB of RAM, and the whole system is loaded into and run off the RAM. Earlier versions of unRAID used ReiserFS, but unRAID 6.0 uses XFS by default. The use of a dedicated parity disk has a couple of drawbacks – the stress on the parity disk is comparatively higher when compared to traditional RAID systems, and the performance is bottlenecked by the performance of the parity disk. In addition, with UnRAID’s policy of not striping data across the member disks, the performance is often what one disk can provide. To alleviate these shortcomings, unRAID provides the option of cache pools.

Cache pools can be made up of multiple disks protected using a traditional RAID-1 configuration. Unlike the main pool formatted in XFS, the cache pools are formatted in btrfs. unRAID 6.0 comes in three falvors – Basic ($59), Plus ($89) and Pro ($129). They differ only in the number of supported devices, as shown in the table below.

NAS Units as VM Hosts

We have already covered the usage of COTS NAS units as hosts for virtual machines using QNAP’s QTS. unRAID 6 uses the same KVM / QEMU combination. Like QTS, unRAID also requires Intel VT-x / AMD-V support for running virtual machines.

In addition, unRAID 6 also supports pass-through of PCIe devices such as GPUs. To give an example, it is possible to run Windows as a guest OS on unRAID 6 and also have it take advantage of discrete GPUs in the PCIe slot. This feature is in the works for QNAP’s QTS, but unRAID seems to be the first to bring it to a stable release. It is important to note that PCI device pass-through requires IOMMU (VT-d / AMD-Vi) support.

Docker – Containers for Lightweight Virtualization

Over the last couple of years, OS-level virtualization has taken off, with Docker leading the way. It enables applications to be deployed inside software containers. Portable applications made using VMWare’s ThinApp or Microsoft App-V are very popular in Windows – one can think of Docker as enabling similar functionality on Linux. Arguably, Linux is much more fragmented (with respect to the number of distros) compared to Windows. Docker enables seamless deployment of one application build on a variety of Linux distros / versions. Each application has its own isolated environment, preventing the creation of software compatibility / co-existence conflicts with others.

It must be noted that container technology is not an alternative for full-blown virtualization. To be more specific, the KVM/QEMU combination allows users to run even Windows on top of a Linux OS. On the other hand, Docker allows only apps written for any Linux distro / version to run on a particular machine. Obviously, the hardware requirements and stress on the host machine are comparatively lower for Docker compared to KVM/QEMU.

The benefits of Docker in the server space are not touched upon – unRAID’s Docker feature is meant for use in a home environment.

Concluding Remarks

The nature of unRAID’s approach to data protection severely restricts the target market for the OS, unlike, say, the approach of FreeNAS, NAS4Free or Rockstor. Realizing this, Lime Technology has gone to great lengths to ensure that UnRAID 6 targets power users and enthusiasts with media serving / storage needs. The presence of both Docker and full-blown virtualization with PCIe device pass-through enables it to target users with gaming PCs that need to double up as media storage servers.

unRAID has been having a loyal following (I have been following them on AVSForum since 2009). The new features in unRAID 6.0 will serve to bring in more people into the fold. unRAID’s approach does have some advantages for media serving scenarios:

  • Avoiding striping ensures that it is trivial to take out a disk, mount it on another Linux system and copy off its contents. To drive home the advantage of this aspect – in case of simultaneous failure of two or more disks, it is possible to recover at least some data from the array by mounting the remaining good disks on another PC. (In the case of a RAID-5 array, the whole data is toast).
  • Avoiding striping ensures that only the relevant disk needs to be spun up to read or write data. This may result in substantial power savings for multi-bay units where the power consumption of the member disks far outweighs the consumption of the system components.

However, there is plenty of scope for improvement – particularly since many users tend to have a single NAS for storing both media as well as other data:

  • Improvement in data transfer rates across all types of accesses
  • Automatic / continuous protection against bit-rot (available for the btrfs cache pool, but not the main XFS volume)
  • Increasing disk sizes (and URE ratings remaining the same) make it a risky proposition to run multi-bay storage servers that can withstand only the failure of one disk.
  • Compared to solutions like FreeNAS, NAS4Free and Rockstor, unRAID is closed-source and carries a licensing fee (ranging from $59 for the Basic version to $129 for the Pro).

We have provided a brief overview of unRAID and what v6.0 brings to the table. More information can be gleaned from Lime Technology’s FAQs. If you are an unRAID user, feel free to chime in with more information / opinions in the comments section.

Lime Technology's unRAID 6 Brings Containers and Virtualization to NAS Units

Lime Technology’s unRAID 6 Brings Containers and Virtualization to NAS Units

Consumers looking for network-attached storage have plenty of options. Most businesses go for a commercial off-the-shelf (COTS) unit, while enthusiasts and home users can go for either COTS or do-it-yourself (DIY) units. There are plenty of excellent COTS NAS vendors in the market, including, but not restricted to Asustor, QNAP, Seagate, Synology and Western Digital. QNAP and Synology have been at the forefront of bringing new features to COTS NAS units. On the DIY front, consumers can go for a dedicated NAS build or re-purpose an existing PC.

Some of the popular operating system options for DIY NAS units include Windows and its server variants, NAS4Free, FreeNAS, Rockstor etc. While NAS4Free, FreeNAS and Rockstor are free open source solutions, Windows and its server variants are paid options. Lime Technology’s unRAID is a Linux-based embedded NAS OS that belongs to the latter category.

The following trends have been observed in the evolution of NAS operating systems over the last couple of years:

  • An attempt to move from the traditional EXT3 / EXT4 to the more robust and modern ZFS and btrfs file-systems
  • Movement of enterprise features such as high availability down the product stack
  • Extensive focus on SDKs for enabling third-party applications / mobile-OS-like app stores
  • Extending core functionality via features such as virtualization (NAS acting as a host for virtual machines) etc.

In the COTS space, QNAP’s QTS brought about virtualization support more than a year back. Synology’s high availability feature has been around in their business-class units for some time now. In addition, Synology’s DSM 5.2 as well as QNAP’s QTS 4.2 beta brought about Docker support. Recently, Lime Technology issued a press release to highlight the release of their unRAID Server OS 6.0 and proclaimed it to be the first non-beta NAS OS with support for both virtualization and containers (Docker). Where does unRAID stand in the current ecosystem of NAS units? Is it a good choice for your particular use-case? Read on for our analysis of the press release.

How does unRAID Work?

Traditional RAID systems use RAID 0, RAID 1, RAID 5, RAID 6 or some combination thereof. These RAID levels stripe data over multiple disks and, for non-RAID 0 or RAID 1 systems, also distribute parity blocks across the member disks. unRAID is not like these traditional RAID systems. The closest it can be compared to is RAID 4, a system in which data is striped across member disks and parity is always written to a dedicated parity disk. In the case of unRAID, the data is never striped. A given file is written to only one of the member disks. A dedicated parity disk enables recovery in case of a single disk failure. In addition, the disks can be of different sizes, as long as the parity disks is the largest of the lot.

unRAID 6 is a lightweight system in the sense that it can be booted off even a 512 MB flash drive on any x86_64 system. Usage as a NAS only requires 1 GB of RAM, and the whole system is loaded into and run off the RAM. Earlier versions of unRAID used ReiserFS, but unRAID 6.0 uses XFS by default. The use of a dedicated parity disk has a couple of drawbacks – the stress on the parity disk is comparatively higher when compared to traditional RAID systems, and the performance is bottlenecked by the performance of the parity disk. In addition, with UnRAID’s policy of not striping data across the member disks, the performance is often what one disk can provide. To alleviate these shortcomings, unRAID provides the option of cache pools.

Cache pools can be made up of multiple disks protected using a traditional RAID-1 configuration. Unlike the main pool formatted in XFS, the cache pools are formatted in btrfs. unRAID 6.0 comes in three falvors – Basic ($59), Plus ($89) and Pro ($129). They differ only in the number of supported devices, as shown in the table below.

NAS Units as VM Hosts

We have already covered the usage of COTS NAS units as hosts for virtual machines using QNAP’s QTS. unRAID 6 uses the same KVM / QEMU combination. Like QTS, unRAID also requires Intel VT-x / AMD-V support for running virtual machines.

In addition, unRAID 6 also supports pass-through of PCIe devices such as GPUs. To give an example, it is possible to run Windows as a guest OS on unRAID 6 and also have it take advantage of discrete GPUs in the PCIe slot. This feature is in the works for QNAP’s QTS, but unRAID seems to be the first to bring it to a stable release. It is important to note that PCI device pass-through requires IOMMU (VT-d / AMD-Vi) support.

Docker – Containers for Lightweight Virtualization

Over the last couple of years, OS-level virtualization has taken off, with Docker leading the way. It enables applications to be deployed inside software containers. Portable applications made using VMWare’s ThinApp or Microsoft App-V are very popular in Windows – one can think of Docker as enabling similar functionality on Linux. Arguably, Linux is much more fragmented (with respect to the number of distros) compared to Windows. Docker enables seamless deployment of one application build on a variety of Linux distros / versions. Each application has its own isolated environment, preventing the creation of software compatibility / co-existence conflicts with others.

It must be noted that container technology is not an alternative for full-blown virtualization. To be more specific, the KVM/QEMU combination allows users to run even Windows on top of a Linux OS. On the other hand, Docker allows only apps written for any Linux distro / version to run on a particular machine. Obviously, the hardware requirements and stress on the host machine are comparatively lower for Docker compared to KVM/QEMU.

The benefits of Docker in the server space are not touched upon – unRAID’s Docker feature is meant for use in a home environment.

Concluding Remarks

The nature of unRAID’s approach to data protection severely restricts the target market for the OS, unlike, say, the approach of FreeNAS, NAS4Free or Rockstor. Realizing this, Lime Technology has gone to great lengths to ensure that UnRAID 6 targets power users and enthusiasts with media serving / storage needs. The presence of both Docker and full-blown virtualization with PCIe device pass-through enables it to target users with gaming PCs that need to double up as media storage servers.

unRAID has been having a loyal following (I have been following them on AVSForum since 2009). The new features in unRAID 6.0 will serve to bring in more people into the fold. unRAID’s approach does have some advantages for media serving scenarios:

  • Avoiding striping ensures that it is trivial to take out a disk, mount it on another Linux system and copy off its contents. To drive home the advantage of this aspect – in case of simultaneous failure of two or more disks, it is possible to recover at least some data from the array by mounting the remaining good disks on another PC. (In the case of a RAID-5 array, the whole data is toast).
  • Avoiding striping ensures that only the relevant disk needs to be spun up to read or write data. This may result in substantial power savings for multi-bay units where the power consumption of the member disks far outweighs the consumption of the system components.

However, there is plenty of scope for improvement – particularly since many users tend to have a single NAS for storing both media as well as other data:

  • Improvement in data transfer rates across all types of accesses
  • Automatic / continuous protection against bit-rot (available for the btrfs cache pool, but not the main XFS volume)
  • Increasing disk sizes (and URE ratings remaining the same) make it a risky proposition to run multi-bay storage servers that can withstand only the failure of one disk.
  • Compared to solutions like FreeNAS, NAS4Free and Rockstor, unRAID is closed-source and carries a licensing fee (ranging from $59 for the Basic version to $129 for the Pro).

We have provided a brief overview of unRAID and what v6.0 brings to the table. More information can be gleaned from Lime Technology’s FAQs. If you are an unRAID user, feel free to chime in with more information / opinions in the comments section.

Synology Launches ARM-based DS1515 and RS815 Value Series NAS Units

Synology Launches ARM-based DS1515 and RS815 Value Series NAS Units

Synology introduced their x15+ series in the second half of 2014. The models were all based on the Intel Rangeley platform (x86). It is now time for a refresh of the Value Series using ARM-based SoCs – the x15 models. There are two units being introduced today, the 5-bay DS1515 in the tower form factor (MSRP: $650) and the 4-bay RS815 in a new short-depth rackmount form factor (MSRP: $600).

DS1515

Based on the Annapurna Labs Alpine AL-314 quad-core Cortex-A15 SoC, the unit has four GbE LAN ports, two USB 3.0 and two eSATA ports. The eSATA ports can be used to connect up to two DX513 / DX213 expansion units. This can provide up to a maximum of 10 bays additional to the five on the main unit. The DS1515 comes with 2GB of RAM.

Gallery: Synology DS1515

The unit comes with Synology’s widely respected DiskStation Manager DSM 5.2 OS supporting a wide variety of networking protocols, applications and add-on packages. The AL-314 SoC comes with hardware encryption engines and a dedicated floating point unit. The presence of four LAN ports help in setting up a high-performance high-availability cluster. Claimed throughput numbers indicate up to 403.7 MBps reads and 421.8 MBps writes.

RS815

The RS815 solution is internally the same as the RS814 introduced last year. Carrying the same Marvell ARMADA XP MV78230 that we reviewed a couple of years back in the LenovoEMC ix4-300d, the performance numbers come in at 216.7 MBps reads and 121.8 MBps writes. The eSATA port allows the connection of a RX415 expansion unit. This can provide up to a maximum of 4 bays additional to the four on the main unit.

Gallery: Synology RS815

The important update is the short-depth chassis design. The RS815 is only 29 cm deep, compared to the RS814’s 46 cm. This allows for denser deployments and compatibility with industrial server environments.

It is refreshing to see Synology continuing to invest in ARM-based models for the Value Series. While these are not true 64-bit solutions yet, they will ensure that Intel x86-based solutions are not the only game in town for high-performance NAS units. The presence of four GbE ports on the DS1515 brings a host of exciting use-cases to the table. The Alpine platform might just about cut the grade for 10G NAS units, but it should be an excellent choice for NAS units with GbE LAN ports. The RS815, on the other hand, takes a tried and tested platform and fits it in a new chassis to expand its application areas.

Western Digital My Cloud DL4100 Business NAS Review

Western Digital is a comparatively recent entrant to the fast-growing NAS market. Despite having had a Windows Storage Server-based product for business users for some time now, a custom embedded-Linux based SMB-targeted model was lacking. Avoiding Wi…

Western Digital My Cloud DL4100 Business NAS Review

Western Digital is a comparatively recent entrant to the fast-growing NAS market. Despite having had a Windows Storage Server-based product for business users for some time now, a custom embedded-Linux based SMB-targeted model was lacking. Avoiding Wi…