Interpretation of "on demand": IBM on-demand storage SAN solutions


SAN storage as a private network, first appeared in the IBM mainframe system in 1994 after a standard Unix and Windows systems, to develop rapidly in the past 10 years, particularly in the last couple of years, SAN presents a breakthrough replacement-type .

A new generation of SAN-based virtualization technology networks for the biggest advances in traditional SAN SAN contains a large number of intelligent functions for data. Some of these features are new, while some rely on expensive alternative to the original server software or memory controller functions of the software. The entire SAN network software licenses only need a network without the need to separate each set of servers or storage controllers for the purchase of software. All SAN storage can be unified in one large storage pool, centralized management and distribution, to eliminate the barriers between different brands of storage and restrictions on the roles of various storage devices to maximize performance.

More critical is that this storage network of the On-Demand Storage System (demand storage). On-Demand is the meaning of storage according to business needs, flexible and transparent way to change the store to demand. In a traditional storage architecture, On-Demand is very difficult to achieve. Changes in storage requirements of applications can be categorized into four:

1, the increase or decrease capacity requirements

Changes in the amount of data traffic caused change, and change the amount of data has generated new demands on storage capacity

2, I / O performance requirements of change

Application performance requirements are constantly changing, when Ye Wu Lai temporary peak may have great the I / O 请求 visits, if the effective response will lead directly to applications declining level of service, or have made application errors of operations.

3, changes in data storage safe low

The key data storage should be stored in the SAN in the most secure storage device. However, the data is critical or not, may change. Or the importance of data may change.

4, the data storage requirements change

For example, some data needs daily backup to a remote, or the need for cloning in the local.

On-Demand Storage System does mean is that when the above happens, storage systems can be required to satisfy the demands of immediate requirements, and in Gaibian process, the operation does not affect 应用. IBM next-generation virtual storage network series have these features, it is defined as the On-Demand Storage System.

The concept of virtual storage

In fact, not a new concept of virtual memory, long ago, IBM in large machines (mainframes) on the VM (virtual machine) technology or through a virtual tape, IBM will implement the concept of virtual storage to the tape library (VTS) are used virtual technology. On the whole simple, virtual memory is a kind of smart structure system, which allows customers a transparent and effective manner in the disk and tape store Shu Ju, Tong Yi management Cipan space, enabling customers to more data storage system also makes more users can share the same system. In a virtual storage environment, no matter what back-end physical storage devices, servers and applications that are the logical mapping the physical device. Even if the physical storage changes will not change this logic mapping, the system administrator no longer concerned about the back-end storage, just focus on the management of storage space, all the storage management operations, such as system upgrades, and establish and allocate virtual disk, change the RAID level, expand the storage space much easier than before, storage management becomes easy and simple.

In a virtual storage environment, storage will become transparent to the user, 用户 do not have to Guan Xin difference in function between storage devices, Rong Liang size, equipment type and manufacturer to, all equipment will be unified management and unified functionality, such as giving Flashcopy, such as remote disaster recovery.

Overall, storage virtualization has three levels: server-based virtual memory, virtual memory-based storage devices, network-based virtual memory.

1, host-based virtualization. This approach is adopted in many firms between array LVM (logical volume manager) to establish storage pool, shared operating system in a different array.

2, based on storage virtualization. This virtualization is the number of high intelligent management section of the array itself, can achieve the same array for different hosts to share. These two are the host and storage of "BOX" internal implementation, if transplanted to the functional network, is network-based virtualization.

3, network-based virtualization. This multi-vendor virtualization arrays in a storage pool between, can also be connected with a different host platforms, the host is to see a different array of unified image, to achieve different between host and storage households with and share the real. From the developing trend of storage, network-based virtualization is the development trend. Web-based virtual memory may be divided into in-band (ln-band) or band (Out-of-band) the virtual memory architecture.

IBM virtual storage the new members: Virtualization Engine (virtual engines), SAN File System (SAN uniformity in the file system), are Web-based virtual product.

SAN Volume Controller (abbreviated as SAN VC), SAN controllers, is another new breakthrough in storage industry, as stored in the history of RAID, the storage management system of the host system and virtual tape technology, these important inventions are derived from IBM . SAN Volume Controller is the entire SAN network controller, it's all the SAN storage devices into one large storage pool storage resources and the distribution according to need full use of memory space, performance and features. The traditional SAN network, each storage systems are self-contained, like a separate island, can not constitute a unified continent.

SAN VC to achieve a virtual storage layer (Virtualization Layer) functions, will be added to the SAN storage intelligence network. Now the user can follow the changing needs of applications to allocate storage, but no longer subject to storage subsystem device functionality and performance limitations. SAN VC is the center of a SAN network management control point, and its server operating system and storage subsystem transparent.

The center of the SAN disk controller with a more flexible management capabilities, greatly improving the efficiency of storage management, for example, dynamically create and extend logical volume and so on. Moreover, SAN VC for a variety of storage devices to provide a unified platform for data replication, such as instant copy and remote replication FlashCopy Remote Mirroring. The copy features are allowed to target the source disk volume and disk volume can exist in different brands of disk arrays.

Transparent data migration is the SAN VC's basic functions, when the SAN VC is added to an existing SAN environment, the need to do data migration, SAN VC to an existing disk configuration inherited intact (this is the SAN VC's Image mode), so the application on the server is completely transparent. When the SAN VC fully configured, it can be the original disk volumes and transparent migration of data to other real virtual volume. All of the migration process transparent to the server, so no need to suspend application.

IBM SAE VC is an integrated hardware and software products, professional storage virtualization software running on clustered hardware engine or CLSCO the MDS network switch hardware. As the SAN VC is a completely open design of the storage environment, compatible with a variety of storage devices. Users can integrate a variety of storage solutions including, without worrying about what SAN VC closed. SAN Volume Controller is born with a flexible expansion capability allows users to store performance and storage capacity in the area smooth and seamless upgrades. For example, the expansion will increase the number of controller performance, and to increase the disk storage pool can increase the capacity of these two line extensions can be completed without the need to suspend application. SAN VC console provides automatic alarm to the IBM service center (call home) and remote support capabilities.

SAN File System is installed in a SAN file system, but also a combination of hardware and software products. It provides a variety of operating system platforms provide a unified file storage environment, and file-level data sharing, storage allocation, Serverless data backup, and SAN VC with the same strategy it has a dynamically adjusted according to storage device configuration and transparent migration of data storage virtualization SAN controller functions, and all function purpose is built around a file-level storage services launched.

Application of virtual storage network

We illustrate the application of virtual storage network. The following example is virtual, integration of a number of actual customer case, to show how is the On-De-mand of the storage environment.

H be a large on-line business to a new data warehouse system will increase the number of new software and hardware equipment. Original environment, there have been many storage systems such as IBM's ESS F20, FAStT500 and MA8000. Some of the core applications used to run the database system, OA system and financial system. Some of the basic idle storage devices, the performance of idle equipment can not meet the data storage needs.

CIO want to have a centralized storage system for centralized management and better use of storage devices, and the disaster in the future of data protection. However, the process of data warehouse is very tense, and reorganization of all of the storage system needs a huge amount of work and risk. Moreover, the replacement of all storage and offsite disaster recovery needs to achieve significant capital investment.

Program will also be on-line system of electronic records and information systems (including multi-media information), real-time monitoring of the system (for the cameras recorded under the images), and the future financial system may be incorporated into the core applications. Look also need several storage systems, storage management complexity becomes higher, the relative decline in data security. CIO is how to manage the many storage devices and data storage security concern. When the CIO found that IBM storage virtualization technology, the current problem immediately solved.

Data warehouse storage systems

As the process of data warehouse project is tight, H Company to immediately introduce a set of IBM's SAN Integration Server-SIS. SIS surface, and an optical disk array is not much different, to be known as the canned SAN (SAN in a CAN). The internal is IBM's FAStT disk group, SAN VC virtual controllers and fiber optic switches group composition.

SIS can reach the maximum capacity of 100TB, the maximum I / O throughput 280000IOPS. SIS has a huge capacity and superior performance, while the price is equal to the market price of fiber array.

SIS is almost a "plug and play" storage, data warehouse hardware system is implemented smoothly. Thus, the storage structure does not change the original seem, except that a SIS.

When the CIO began to focus on when considering storage, SIS began to show their talents in a SAN VC.

Transfer to a virtual storage network

All the disk storage device from their own way into the SAN VC allocation and management, SAN VC can be seen as part of SAN. The following is the physical device connection diagram, looks ordinary SAN not seem very different.

In the Device Manager, and through SAN VC (SVC) of the virtual volume management capabilities, first of all to the SVC managed disk volumes. Administrator according to the characteristics of equipment, group equipment and the definition of high-performance low-cost equipment, and in accordance with the server's need to create and allocate storage.

Server A using SIS on the space, when the need for space than SIS when the current capacity, SVC part of ESS's space and SIS synthesis, the capacity required to meet the A. Moreover, since the synthesis of space is constituted by the two physical devices, so performance is also the two devices and.

If, for a server's I / O demands increase suddenly, then, can dynamically change the virtual disk Vdisk the corresponding physical device. For example, the server's Vdisk the original C using a "low-cost group" disk device, if found inadequate performance, you can apply in the case of non-stop, and transparent data transfer to the "high-performance group."

Remote disaster recovery system

When the need for remote data mirroring the fact that protection, you can synchronize different data between storage arrays. In this case, all the production data through a virtual SAN network, have all moved to the SIS and the ESS in the high-speed. MA and FAStT can be put to use the remote as a backup. This ensures that the investment, but also established a Disaster Recovery System to complete real-time protection.

High-speed data sharing system

New electronic document system, a large number of multimedia data, need an efficient file sharing system. IBM's SAN file system based storage networks, providing not only high-speed access, but also has the storage capacity in accordance with policy. For example, the customer defines the following rules:

1, all image files and video information stored in the low-cost storage devices
2, the database files are stored in high-performance storage devices
3, the key file needs to specify the remote mirror
4, program development documents need to keep multiple versions

When these rules are defined to the SAN file system in, the file is stored will be stored automatically in accordance with this rule. If these rules are not defined to the file needs to store, SAN file system will use the default storage system to store.

Strain-demand storage system

The IBM virtual storage based system that provides fully dynamic adjustment of the entire SAN storage capacity, performance and functionality capabilities. And different data types can automatically provide different storage services, with a strong and inclusive, that is to protect the original investment for the future development of a fully open and unlimited room for expansion.