dbfs 实施文档

一、DBFS介绍

The Oracle Database File System (DBFS) creates a standard file system interface on top

of files and directories that are stored indata base tables. DBFS is similar to NFS in that

it provides a shared network file systemthat looks like a local file system. Like NFS,

there is a server component and a clientcomponent.

Dbfs在文件和目录之上创建了一个标准的文件系统结构，并且将数据存储在数据库基表里面。DBFS很像NFS，因为它提供了一个与本地文件系统相同的共享的网络文件系统。与NFS一样，由Server与Client组成。

In DBFS, the server is the Oracle Database.Files are stored as SecureFiles LOBs in a

database table. A set of PL/SQL proceduresimplement the file system access

primitives such as create, open, read,write, and list directory. The implementation of

the file system in the database is calledthe DBFS Content Store. The DBFS Content

Store allows each database user to createone or more file systems that can be mounted

by clients. Each file system has its owndedicated tables that hold the file system

content.

在DBFS中，Server为Oracle数据库，文件存储在表的一个SecureFiles LOBs 字段里面。一个PLSQL存储过程的集合，提供了访问文件系统的基本操作，比如说create、open、read、write，ls 。DBFS目录库允许每个数据库用户创建一个或多个文件系统，并且可以被clients使用。每个文件系统拥有专有的数据表，保证文件系统的内容。

体系结构如下图所示

二、Client端安装fuse

确定fuse版本

uname –a

Linux DB-SERVER-02 2.6.18-164.el5#1 SMP Tue Aug 18 15:51:48 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux

本机kernelversion 2.6.18

Kernel version 2.6.x

x>9都需要使用 fuse-2.7.4

下载fuse安装包

下载地址：

http://fuse.sourceforge.net

或者

http://sourceforge.net/projects/fuse

检查kernel-devel 包

# rpm –q kernel-devel

如果没有安装，挂载安装盘后安装package

安装fuse

$ tar -xzvf fuse-2.7.4.tar.gz

$ cd [fuse_src_dir]

$ ./configure --prefix=/usr --with-kernel=[yourkernel dir]

$ make

$ sudo su

# make install

# /sbin/depmod

# /sbin/modprobe fuse

# chmod 666 /dev/fuse

# echo "/sbin/modprobe fuse" >>/etc/rc.modules

示例

查看是否安装了所需安装包

[root@james-test ~]# rpm -q kernel-devel

package kernel-devel is not installed

挂载光盘

[root@james-test dev]# mount /dev/hdc /mnt

mount: block device /dev/hdc iswrite-protected, mounting read-only
安装kernel-devel包

[root@james-test Server]# rpm -ivh kernel-devel-2.6.18-308.el5.x86_64.rpm

Preparing...########################################### [100%]

1:kernel-devel ###########################################[100%]

查看kernelversion

[root@james-test Server]# uname -a

Linux james-test 2.6.18-308.el5#1 SMP Sat Feb 25 12:40:07 EST 2012 x86_64 x86_64 x86_64 GNU/Linux

ftp 将fuse2.7.4 上传至服务器/root目录下

[root@james-test ~]# pwd

/root

[root@james-test ~]# ls -l fuse-2.7.4.tar.gz

-rw-r--r-- 1 root root 506658 Jun 11 13:54 fuse-2.7.4.tar.gz

解压

[root@james-test ~]# tar -xzvf fuse-2.7.4.tar.gz

[root@james-test ~]# cd fuse-2.7.4

安装

[root@james-test fuse-2.7.4]#./configure

[root@james-test fuse-2.7.4]#make

[root@james-test fuse-2.7.4]#make install

[root@james-test fuse-2.7.4]#/sbin/depmod

[root@james-test fuse-2.7.4]#/sbin/modprobe fuse

[root@james-test fuse-2.7.4]#chmod 666 /dev/fuse

[root@james-test fuse-2.7.4]#echo "/sbin/modprobe fuse" >> /etc/rc.modules

三、Server端Oracle数据库配置

Server端配置流程

1创建表空间

新建的表空间用来存储dbfs中相关数据。

2创建用户

新建用户用来管理dbfs相关的文件以及源数据

3授权

管理dbfs的用户需要拥有相关权限

4执行dbfs初始化脚本

Dbfs配置脚本路径：

$ORACLE_HOME/rdbms/admin/dbfs_create_filesystem_advanced

注意，需要使用新建的用户执行该脚本。

示例

使用dba用户登录

[oracle@james-test~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.1.0Production on Thu Aug 2 13:40:42 2012

Copyright (c) 1982, 2009, Oracle. All rights reserved.

Connected to an idle instance.

开启数据库

SQL>startup

ORACLE instance started.

Total System Global Area 1653518336 bytes

Fixed Size 2213896 bytes

Variable Size 956303352 bytes

Database Buffers 687865856 bytes

Redo Buffers 7135232 bytes

Database mounted.

Database opened.

创建表空间fsts（这里使用大文件表空间）

SQL>create bigfile tablespace fsts

2datafile '/u01/apps/oracle/oradata/david/fsts01.dbf'

3 size500m ;

Tablespace created.

创建用户dexter

SQL> create user dexter identified byxiaojun default tablespace fsts quota unlimited on fsts ;

User created.

授权

SQL>grant create session,create table , create procedure , dbfs_role to dexter ;

Grant succeeded.

SQL> conn dexter/xiaojun

Connected.

执行初始化脚本

SQL>@?/rdbms/admin/dbfs_create_filesystem_advanced fsts dir1 nocompressnodeduplicate noencrypt non-partition

四、客户端挂载

客户端使用需要用到dbfs_client命令，相关的程序都在Oracle client中，所以客户端必须安装Oracle client。

客户端配置流程

1.使用root用户

2. Add a new library path.

Command：

# echo "/usr/local/lib" >>/etc/ld.so.conf.d/usr_local_lib.conf

3. Change directory to lib , and create thefollowing symbolic links to the

libclntsh.so.11.1 and libnnz11.so libraries.

Command：

# cd /usr/local/lib

# ln -s $ORACLE_HOME/lib/libclntsh.so.11.1

# ln -s $ORACLE_HOME/lib/libnnz11.so

4. Locate libfuse.so, and create a symbolic linkthis library.

# locate libfuse.so

determined_path /libfuse.so

Command：

# ln –sdetermined_path /libfuse.so

5. Run ldconfigto create the links and cache for the new symbolic links.

Command：

# ldconfig

6. Create a symbolic link to dbfs_client in/sbin as mount.dbfs.

Command：

# ln -s $ORACLE_HOME/bin/dbfs_client/sbin/mount.dbfs

7. Login as admin user. (Oracle recommends th atyou do not perform the next step

as root user.)

8. Mount the DBFS store.

Command：

% dbfs_client @/dbfsdb -owallet,rw,user,direct_io /mnt/dbfs

9. [Optional] To test if the previo us step wassuccessful, list the dbfs directory.

Command：

# ls /mnt/dbfs

后台执行：

nohup dbfs_client ETLUser@DBConnectString/mnt/dbfs < passwordfile.f &

示例

[oracle@james-test~]$ mkdir /u01/dbfs

[oracle@james-test~]$ ls -l /u01

drwxr-xr-x 2 oracle oinstall 4096 Aug2 13:51 dbfs

[root@james-test~]# echo "/usr/local/lib" >>/etc/ld.so.conf.d/usr_local_lib.conf

[root@james-test~]# cd /usr/local/lib

[root@james-testlib]# ln -s /u01/apps/oracle/product/11gr2/db_1/lib/libclntsh.so.11.1

[root@james-testlib]# ln -s /u01/apps/oracle/product/11gr2/db_1/lib/libnnz11.so

[root@james-testlib]# find / -name libfuse.so

/usr/local/lib/libfuse.so

[root@james-testlib]# ln -s /usr/local/lib/libfuse.so

[root@james-testlib]# ldconfig

[root@james-testlib]# ln -s /u01/apps/oracle/product/11gr2/db_1/bin/dbfs_client/sbin/mount.dbfs

[root@james-testlib]# su - oracle

配置密码文件

使用oracle用户作为dbfs挂载的管理用户

创建密码文件

echo xiaojun > passwd.t

查看客户端的配置

[oracle@james-test~]$ vi $ORACLE_HOME/network/admin/tnsnames.ora

DAVID =

(DESCRIPTION =

(ADDRESS = (PROTOCOL = TCP)(HOST =james-test)(PORT = 1521))

(CONNECT_DATA =

(SERVER = DEDICATED)

(SERVICE_NAME = david)

)

)

远程可以登录

[oracle@james-test~]$ sqlplus dexter/xiaojun@david

SQL*Plus: Release 11.2.0.1.0Production on Thu Aug 2 14:17:32 2012

Copyright (c) 1982, 2009, Oracle. All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0- 64bit Production

With the Partitioning, OLAP, Data Mining andReal Application Testing options

SQL>

执行挂载命令

nohup dbfs_client dexter@david /u01/dbfs < passwd.t &

[1] 11665

[oracle@james-test ~]$ nohup: appending outputto `nohup.out'

[oracle@james-test ~]$ df -h

Filesystem Size Used Avail Use% Mounted on

/dev/sda1 30G 15G14G 53% /

/dev/sda3 3.9G 473M3.3G 13% /tmp

tmpfs 2.0G 943M1.1G 48% /dev/shm

/dev/hdc 3.7G 3.7G0 100% /mnt

dbfs 1.5M 57K1.4M 4% /u01/dbfs

五、测试

[oracle@james-test ~]$ ll /u01

drwxr-xr-x 3 root root 0 Aug 2 14:20 dbfs

[oracle@james-test ~]$ ll /u01/dbfs/

total 0

drwxrwxrwx 3 root root 0 Aug 2 14:09 dir1

[oracle@james-test~]$ echo test > /u01/dbfs/dir1/test.t

[oracle@james-test~]$ ll /u01/dbfs/dir1/

total 1

-rw-r--r--1 oracle oinstall 5 Aug 2 14:21 test.t

[oracle@james-test ~]$ cat /u01/dbfs/dir1/test.t

Test

[oracle@james-test~]$ mkdir /u01/dbfs/dir1/sub_dir

[oracle@james-test~]$ echo ffccddssdd > /u01/dbfs/dir1/sub_dir/test2.t

[oracle@james-test~]$ sqlplus dexter/xiaojun@david

SQL*Plus: Release 11.2.0.1.0Production on Thu Aug 2 14:28:49 2012

Copyright (c) 1982, 2009, Oracle. All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0- 64bit Production

With the Partitioning, OLAP, Data Mining andReal Application Testing options

Pathtype=1 表示文件 2表示目录

SQL> select pathname , item , pathtype  from t_dir1 ;     
PATHNAME             ITEM                 PATHTYPE
-------------------- ----------------------------
/test.t               test.t                      1
/sub_dir             sub_dir                    2
/sub_dir/test2.t        test2.t                     1
/                   ROOT                     2
/.sfs                .sfs                        2
/.sfs/attributes        attributes                   2
/.sfs/tools            tools                      2
/.sfs/snapshots        snapshots                  2
/.sfs/RECYCLE      RECYCLE                 2
/.sfs/content          content                    2
 
10 rows selected.

配置完成

作者：任凤军

2012-8-2