编译安装GekkoFS

1.基础依赖安装

apt install git curl cmake autoconf automake libtool libconfig-dev
apt install python3-dev python3 python3-venv

2.逐步安装

2.1 Gekkofs

git clone --recurse-submodules https://storage.bsc.es/gitlab/hpc/gekkofs.git

2.2 配置环境变量

export GKFS_INSTALL_PATH=/opt/software/gekkofs_deps/install
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:${GKFS_INSTALL_PATH}/lib:${GKFS_INSTALL_PATH}/lib64

2.3 使用脚本下载软件依赖

bash dl_dep.sh /opt/software/gekkofs_deps/git

2.4 使用脚本安装软件依赖

bash compile_dep.sh /opt/software/gekkofs_deps/git /opt/software/gekkofs_deps/install -j8

2.5 配置文件

cmake -DCMAKE_BUILD_TYPE:STRING=Release -DCMAKE_PREFIX_PATH:STRING=/opt/software/gekkofs_deps/install -DCMAKE_INSTALL_PREFIX:STRING=/opt/software/gekkofs_deps/install -DGKFS_BUILD_TESTS:BOOL=ON ..

2.6 构建安装Gekkofs

make -j8
make test

make install

3 运行Gekkofs

3.1 运行Gekkofs守护进程

gkfs_daemon -r /opt/filepath/gekkofs/fs_data -m /opt/filepath/gekkofs/pseudo_gkfs_mount_dir -l enp0s3 -H /opt/software/gekkofs_deps/install/bin/gkfs_hosts.txt &

3.2 使用Gekkofs客户端库

LD_PRELOAD=/opt/software/gekkofs_deps/install/lib/libgkfs_intercept.so cp  /opt/test/gekkofs-v0.9.1.tar.gz /opt/filepath/gekkofs/pseudo_gkfs_mount_dir

可以看到chunks目录下我们的文件被分成数据块，块大小限制为512k

3.3 验证文件完整性

3.4 结束进程

4.使用脚本运行Gekkofs

5.遇到的问题

No provider found for “sockets” provider on domain “XXX”
Could not initialize hg_class
Failed to initialize the Margo RPC server

解决方法： -l enp0s3

gkfs_daemon -r /opt/filepath/gekkofs/fs_data -m /opt/filepath/gekkofs/pseudo_gkfs_mount_dir -l enp0s3 -H /opt/software/gekkofs_deps/install/bin/gkfs_hosts.txt &