linux安装superset(亲测)
一.安装python
- 环境centOS7
1.下载依赖
# yum install -y wget
# yum install -y gcc* zlib* openssl* sqlite* mysql-devel python-devel
2.下载python
# cd /opt/
# mkdir python
# cd python/
# wget https://www.python.org/ftp/python/3.6.11/Python-3.6.11.tgz
3.安装python
# tar -xf *.tgz
# cd Python-3.6.11
# ./configure --with-ssl
# make && make install
3.安装virtualenv
# cd /usr/local/bin
# pip3 install virtualenv
# python3 -m venv venv
# . venv/bin/activate
# pip install --upgrade setuptools pip
# pip install apache-superset 或 # pip install apache-superset -i https://pypi.douban.com/simple
4.配置(可选)
配置superset:
# vi /usr/local/bin/venv/lib/python3.6/site-packages/superset/config.py1.配置缓存
# pip install redis CACHE_CONFIG: CacheConfig = {"CACHE_TYPE": "null"} 改为 CACHE_CONFIG = { 'CACHE_TYPE': 'redis', 'CACHE_DEFAULT_TIMEOUT': 60 * 60 * 24, # 1 day default (in secs) 'CACHE_KEY_PREFIX': 'superset_results', 'CACHE_REDIS_URL': 'redis://localhost:6379/0', } 或者 CACHE_CONFIG: CacheConfig = {"CACHE_TYPE": "simple"} TABLE_NAMES_CACHE_CONFIG: CacheConfig = {"CACHE_TYPE": "simple"}
上传文件(必须):
# cd /usr/local/bin/venv/lib/python3.6/site-packages
# rz
_bz2.cpython-36m-x86_64-linux-gnu.so
链接: https://pan.baidu.com/s/1vC4hPyfdN3J15z3g8XCFoA
提取码: 7rt1
修改端口号:
# vi /usr/local/bin/venv/lib/python3.6/site-packages/flask/cli.py
- 改为:
@click.command("run", short_help="Run a development server.")
@click.option("--host", "-h", default="192.168.75.134", help="The interface to bind to.")
@click.option("--port", "-p", default=8088, help="The port to bind to.")
5.安装启动superset
- 初始化数据库
# superset db upgrade
- 创建用户
# superset fab create-admin
- 加载一些数据来处理
# superset load_examples
- 创建默认角色和权限
# superset init
-
# superset run -p 8088 --with-threads --reload --debugger 或 nohup superset run -h 192.168.73.134 -p 8088 &
# deactivate (退出环境)
启动:
# cd /usr/local/bin
# . venv/bin/activate
# nohup superset run &
# deactivate
停止:
# ps -ef |grep superset
# kill -9 ...
驱动:
mysql
- 有三种驱动
# pip install mysqlclient
# pip install pymysql
SQLAlchemy URI : mysql+pymysql://root:[email protected]:3306/clickhouse
- 只使用mysql会中文乱码,使用 mysql+pymysql不会乱码
clickhouse
# pip install sqlalchemy-clickhouse
SQLAlchemy URI : clickhouse://default:[email protected]:8123/default
ES
# pip install elasticsearch-dbapi
SQLAlchemy URI : elasticsearch+http://elastic:[email protected]:9200/
问题解决:
1.No module named ‘pymysql’
ERROR:superset.views.core:Unexpected error No module named ‘pymysql’
# pip install pymysql
2.连接clickhouse密码错误
-
其实用户名和密码是正确的但是就是显示失败
-
参考连接: https://blog.csdn.net/m0_47467356/article/details/105844252
# pip3 install sqlalchemy-clickhouse (通过再次下载确定配置文件位置)
# vi /usr/local/bin/venv/lib/python3.6/site-packages/sqlalchemy_clickhouse/connector.py
1、注释掉sqlalchemy_clickhouse/connector.py中的代码Database._send = _send,
as it will use none auth to check _is_existing_database in infi/clickhouse_orm/database.py
2、或者将更改sqlalchemy_clickhouse/connector.py中的_send函数由：
def _send(self, data, settings=None, stream=False):
if PY3 and isinstance(data, string_types):
data = data.encode('utf-8')
params = self._build_params(settings)
r = requests.post(self.db_url, params=params, data=data, stream=stream)
if r.status_code != 200:
raise Exception(r.text)
return r
替换为：
def _send(self, data, settings=None, stream=False):
if PY3 and isinstance(data, string_types):
data = data.encode('utf-8')
params = self._build_params(settings)
# r = requests.post(self.db_url, params=params, data=data, stream=stream)
r = self.request_session.post(
self.db_url, params=params, data=data, stream=stream, timeout=self.timeout)
if r.status_code != 200:
raise Exception(r.text)
return r
3.CACHE_TYPE is set to null
- "Flask-Caching: CACHE_TYPE is set to null, "
进入vi /usr/local/bin/venv/lib/python3.6/site-packages/superset/config.py
CACHE_CONFIG: CacheConfig = {"CACHE_TYPE": "simple"}
TABLE_NAMES_CACHE_CONFIG: CacheConfig = {"CACHE_TYPE": "simple"}
centOS7,默认的是python2.7版本,要换3.x会出现yum不能使用的情况,以下为修改的方式:
换了python要改两个地方
1,vi /usr/libexec/urlgrabber-ext-down
2.vi /usr/bin/yum
改为#! /usr/bin/python2.7