Fusion-io Introduction

本文转载自：https://mariadb.com/kb/en/mariadb/mariadb-documentation/getting-started/getting-installing-and-upgrading-mariadb/mariadb-performance-advanced-configurations/fusion-io-introduction/

Fusion-io Introduction

• ↑ MariaDB Performance & Advanced Configurations ↑
• Configuring MariaDB for optimal performance
• Fusion-io Introduction
• FusionIO DirectFS atomic write support

• Home
• Open Questions
• MariaDB
• All Topics

History Edit Source Flag as Spam/Inappropriate Translate

Created

1 year, 10 months ago

Modified

7 months, 1 week ago

Type

article

Status

active

• History
• Comments

Links

• MariaDB Galera Cluster
• a bug that severely limits XFS performance in concurrent environments.
• here

Edit

Attachments

• GE-Fusionio-MariaDB
  Example configuration, courtesy of www.goldeneggs.fi

Localized Versions

• Introduzione a Fusion-io [it]

Tweet

Contents

Fusion-io develops PCIe based NAND flash memory cards and related software that can be used to speed up MariaDB databases.

The ioDrive branded products can be used as block devices (super-fast disks) or to extend basic DRAM memory. ioDrive is deployed by installing it on an x86 server and then installing the card driver under the operating system. All main line 64-bit operating systems and hypervisors are supported: RHEL, CentOS, SuSe, Debian, OEL etc. and VMware, Microsoft Windows/Server etc. Drivers and their features are constantly developed further.

ioDrive cards support software RAID and you can combine two or more physical cards into one logical drive. Through ioMemory SDK and its APIs, one can integrate and enable more thorough interworking between your own software and the cards - and cut latency.

The key differentiator between a Fusion-io and a legacy SSD/HDD is following: Fusion-io card is connected directly on the system bus (PCIe), this enableshigh data transfer throughput (1.5 GB/s, 3.0 GB/s or 6GB/s) and fast direct memory access (DMA) method can be used to transfer data. ATA/SATA protocol stack is omitted and thereforelatency is cut short. Fusion-io performance is dependent on server speed: the faster processors and the newer PCIe-bus version you have, the better is the ioDrive performance.Fusion-io memory is non-volatile, in other words, data remains on the card even when the server is powered off.

Use cases

1. You can start by using ioDrive for database files that need heavy random access.
2. Whole database on ioDrive.
3. Remove double write buffer in InnoDB (Fusion-io has a patch that guarantees atomic writes, which makes the double write buffer unneeded).
4. Use ioDrive as a write-through read cache. This is possible on server level with Fusion-io directCache software or in VMware environments using ioTurbine software or the ioCache bundle product. Reads happen from ioDrive and all writes go directly to your SAN or disk.
5. Highly Available shared storage with ION. Have two different hosts, Fusion-io cards in them and share/replicate data with Fusion-io's ION software.
6. The luxurious Platinum setup: MariaDB Galera Cluster running on Fusion-io SLC cards on several hosts.

Future suggested development

• Generalize the Fusion-io double write buffer patch so that it automatically disables the double write buffer for files that are on Fusion-IO. Done, read the instructionshere.
• Extend InnoDB disk cache to be stored on Fusion-io acting as extended memory.

Settings for best performance

Fusion-io memory can be formatted with different sector size of either 512 or 4096 bytes. Bigger sectors are expected to be faster, but only if I/O is done in blocks of 4KB or multiples of that. Speaking of MariaDB: if only InnoDB data files are stored in Fusion-io memory, all I/O is done in blocks of 16K and thus 4K sector size can be used. If the InnoDB redo log (I/O block size: 512 bytes) goes to the same Fusion-io memory, then short sectors should be used.

Note: XtraDB has the experimental feature of an increased InnoDB log block size of 4K. If this is enabled, then both redo log I/O and page I/O in InnoDB will match a sector size of 4K.

As of file systems: currently XFS is expected to yield the best performance with MySQL. However depending on the exact version of XFS code in use, one might be affected bya bug that severely limits XFS performance in concurrent environments.

For the pitbull machine where I have run such tests, ext4 was faster than xfs for 32 or more threads:

• up to 8 threads xfs was few percent faster (10% on average).
• at 16 threads it was a draw (2036 tps vs. 2070 tps).
• at 32 threads ext4 was 28% faster (2345 tps vs. 1829 tps).
• at 64 threads ext4 was even 47% faster (2362 tps vs. 1601 tps).
• at higher concurrency ext4 lost it’s bite, but was still constantly better than xfs.

Those numbers are for spinning disks. I guess for Fusion-io memory the XFS numbers will be even worse.

Example configuration

Card models

There are several card models. ioDrive is older generation, ioDrive2 is newer. SLC sustains more writes. MLC is good enough for normal use.

1. ioDrive2, capacities per card 365GB, 785GB, 1.2TB with MLC. 400GB and 600GB with SLC, performance up to 535000 IOPS & 1.5GB/s bandwidth
2. ioDrive2 Duo, capacities per card 2.4TB MLC and 1.2TB SLC, performance up to 935000 IOPS & 3.0GB/s bandwidth
3. ioDrive, capacities per card 320GB, 640GB MLC and 160GB, 320GB SLC, performance up to 145000 IOPS & 790MB/s bandwidth
4. ioDrive Duo, capacities per card 640GB, 1.28TB MLC and 320GB, 640GB SLC, performance up to 285000 IOPS & 1.5GB/s bandwidth
5. ioDrive Octal, capacities per card 5TB and 10TB MLC, performance up to 1350000 IOPS & 6.7GB/s bandwidth
6. ioFX, a 420GB QDP MLC workstation product, 1.4GB/s bandwidth
7. ioCache, a 600GB MLC card with ioTurbine software bundle that can be used to speed up VMware based virtual hosts.
8. ioScale, 3.2TB card, building block to enable all-flash data center build out in hyperscale web and cloud environments. Product has been developed in co-operation with Facebook.

Additional software

• directCache - transforms ioDrive to work as a read cache in your server. Writes go directly to your SAN
• ioTurbine - read cache software for VMware
• ION - transforms ioDrive into a shareable storage
• ioSphere - software to manage and monitor several ioDrives

Login or signup to receive notifications when this page changes.

• ← Configuring MariaDB for optimal performance
• ↑ MariaDB Performance & Advanced Configurations ↑
• FusionIO DirectFS atomic write support →

Comments

注：近期参加MySQL运维学习，老师推荐该文章作为学习和技术提高的扩展阅读，先记录到自己的博客中，随后慢慢消化、学习、提高。本文章与“机器选型&系统规划”主题相关。