rgb_rgb

greenplum单机安装

参考：http://www.dbrabbit.com/archivers/centos-5-7%E4%B8%8A%E5%AE%89%E8%A3%85greenplum%E4%B8%80%E5%8F%B0%E8%99%9A%E6%8B%9F%E6%9C%BA.html

[gpadmin@sgpc146 ~]$ ll
total 20
-rw-rw-r-- 1 gpadmin gpadmin    5 Sep 28 19:53 all_hosts
drwxrwxr-x 2 gpadmin gpadmin 4096 Sep 28 20:39 gpAdminLogs
drwxrwxr-x 2 gpadmin gpadmin 4096 Sep 28 20:25 gpconfigs
-rw-rw-r-- 1 gpadmin gpadmin 3193 Sep 28 20:34 gpinitsystem_config
-rw-rw-r-- 1 gpadmin gpadmin    5 Sep 28 20:07 seg_hosts
[gpadmin@sgpc146 ~]$ more all_hosts 
sdw1
[gpadmin@sgpc146 ~]$ more seg_hosts 
sdw1
[gpadmin@sgpc146 ~]$ more /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
#127.0.0.1      localhost.localdomain localhost
127.0.0.1 localhost mdw sdw1
129.100.253.146 sgpc146
[gpadmin@sgpc146 ~]$

1.内核参数设置
设置下列参数到/etc/sysctl.conf文件中.然后运行sysctl -p使其生效.这些参数是不要随便修改它的数字,后面在执行gpcheck的时候会严格校验,发现和其中不一样,会报错.

kernel.shmmax = 500000000
kernel.shmmni = 4096
kernel.shmall = 4000000000
kernel.sem = 250 512000 100 2048
kernel.sysrq = 1
kernel.core_uses_pid = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.msgmni=2048
net.ipv4.tcp_syncookies = 1
net.ipv4.ip_forward = 0
net.ipv4.conf.default.accept_source_route = 0
net.ipv4.tcp_tw_recycle=1
net.ipv4.tcp_max_syn_backlog=4096
net.ipv4.conf.all.arp_filter = 1
net.ipv4.conf.default.arp_filter = 1
net.ipv4.ip_local_port_range=1025 65535
net.core.netdev_max_backlog=10000
vm.overcommit_memory=2

2.设置下列参数到/etc/security/limits.conf文件

* soft nofile 65536
* hard nofile 65536
* soft nproc 131072
* hard nproc 131072

3.用root登陆到Master主机上安装Greenplum binaries
# /bin/bash greenplum-db-4.1.1.8-build-2-RHEL5-x86_64.bin

4.创建gpadmin用户
[root@greenplum tmp]# useradd gpadmin
[root@greenplum tmp]# passwd gpadmin
Changing password for user gpadmin.
New UNIX password:
BAD PASSWORD: it is based on a dictionary word
Retype new UNIX password:
passwd: all authentication tokens updated successfully.

5.创建seg_hosts和all_hosts文件并进行编辑

因为我们就只使用了一台虚拟机既做Master节点,又做Segment节点,因此,这两个文件的内容只要填写一个主机名就行了,在多台的环境下面,需要按照实际环境来进行修改.

6.使用gpssh-exkeys给root用户交换密钥

[root@greenplum greenplum-db]# pwd
/usr/local/greenplum-db
[root@greenplum greenplum-db]# source greenplum_path.sh
[root@greenplum greenplum-db]# cat /home/gpadmin/all_hosts
greenplum.localdomain
[root@greenplum greenplum-db]# gpssh-exkeys -f /home/gpadmin/all_hosts
[STEP 1 of 5] create local ID and authorize on local host
[STEP 2 of 5] keyscan all hosts and update known_hosts file
[STEP 3 of 5] authorize current user on remote hosts
[STEP 4 of 5] determine common authentication file content
[STEP 5 of 5] copy authentication files to all remote hosts
[INFO] completed successfully

7.使用gpssh来同步设置
SSH配置好了之后,就可以用gpssh来同步设置,例如创建用户,同步安装介质等.但是因为我们这里就用到一台虚拟机,此步骤可以忽略,真实情况如下演示所示:
[root@greenplum greenplum-db]# gpssh -f /home/gpadmin/seg_hosts 'useradd gpadmin'
[greenplum.localdomain] useradd: user gpadmin exists

8.修改GreenPlum安装目录的用户和属主
[root@greenplum local]# chown -R gpadmin:gpadmin greenplum-db-4.1.1.8/
[root@greenplum local]# chown -R gpadmin:gpadmin greenplum-db
[root@greenplum local]# ll
total 84
drwxr-xr-x 2 root    root    4096 May 11 2011 bin
drwxr-xr-x 2 root    root    4096 May 11 2011 etc
drwxr-xr-x 2 root    root    4096 May 11 2011 games
lrwxrwxrwx 1 gpadmin gpadmin   22 Feb 19 21:30 greenplum-db -> ./greenplum-db-4.1.1.8
drwxr-xr-x 11 gpadmin gpadmin 4096 Feb 19 21:30 greenplum-db-4.1.1.8
drwxr-xr-x 2 root    root    4096 May 11 2011 include
drwxr-xr-x 2 root    root    4096 May 11 2011 lib
drwxr-xr-x 2 root    root    4096 May 11 2011 lib64
drwxr-xr-x 2 root    root    4096 May 11 2011 libexec
drwxr-xr-x 2 root    root    4096 May 11 2011 sbin
drwxr-xr-x 4 root    root    4096 Feb 18 21:03 share
drwxr-xr-x 2 root    root    4096 May 11 2011 src

9.配置gpadmin用户的环境变量
[gpadmin@greenplum ~]$ cat .bashrc
# .bashrc
# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi
# User specific aliases and functions
source /usr/local/greenplum-db/greenplum_path.sh

10.给master和segment创建data目录
[root@greenplum local]# mkdir /gpmaster
[root@greenplum local]# chown gpadmin:gpadmin /gpmaster/
[root@greenplum local]# mkdir /gpsegment1
[root@greenplum local]# chown gpadmin:gpadmin /gpsegment1/
[root@greenplum local]# mkdir /gpsegment2
[root@greenplum local]# chown gpadmin:gpadmin /gpsegment2/

11.使用gpssh-exkeys给gpadmin用户交换密钥
[gpadmin@greenplum ~]$ id
uid=500(gpadmin) gid=500(gpadmin) groups=500(gpadmin)
[gpadmin@greenplum ~]$ gpssh-exkeys -f /home/gpadmin/all_hosts
[STEP 1 of 5] create local ID and authorize on local host
[STEP 2 of 5] keyscan all hosts and update known_hosts file
[STEP 3 of 5] authorize current user on remote hosts
[STEP 4 of 5] determine common authentication file content
[STEP 5 of 5] copy authentication files to all remote hosts
[INFO] completed successfully

12.同步系统时钟
[gpadmin@greenplum ~]$ gpssh -f seg_hosts -v date
[Reset ...]
[INFO] login greenplum.localdomain
[greenplum.localdomain] Sun Feb 19 22:12:45 CST 2012
[INFO] completed successfully
[Cleanup...]

13.却换到root下面执行运行OS方面的校验
[root@greenplum local]# gpcheck -f /home/gpadmin/all_hosts -m greenplum.localdomain -s greenplum.localdoamin

14.使用gpcheckperf验证网络性能
因为我们使用了一台虚拟机来完成,所以这个步骤可以省略

15.验证磁盘I/O和内存带宽
[root@greenplum local]# gpcheckperf -f /heome/gpadmin/seg_hosts -r ds -D -d /gpsegment1 -d /gpsegment2

初始化gp：

[gpadmin@sgpc146 ~]$ vi gpinitsystem_config 

#### will be created. The number of mirror locations must equal the
#### number of primary locations as specified in the
#### DATA_DIRECTORY parameter.
#declare -a MIRROR_DATA_DIRECTORY=(/data1/mirror /data1/mirror /data1/mirror /data2/mirror /data2/mirror /data2/mirror)


################################################
#### OTHER OPTIONAL PARAMETERS
################################################

#### Create a database of this name after initialization.
#DATABASE_NAME=name_of_database

#### Specify the location of the host address file here instead of
#### with the the -h option of gpinitsystem.
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
CHINE_LIST_FILE=/home/gpadmin/seg_hosts

ARRAY_NAME="EMC Greenplum DW"
SEG_PREFIX=gpseg
PORT_BASE=40000
declare -a DATA_DIRECTORY=(/gpsegment1 /gpsegment2)
MASTER_HOSTNAME=mdw
MASTER_DIRECTORY=/data/master
MASTER_PORT=5432
TRUSTED_SHELL=ssh
CHECK_POINT_SEGMENTS=8
ENCODING=UNICODE
#MIRROR_PORT_BASE=50000
#REPLICATION_PORT_BASE=41000
#MIRROR_REPLICATION_PORT_BASE=51000
#declare -a MIRROR_DATA_DIRECTORY=(/data/mirror /data/mirror)
#DATABASE_NAME=name_of_database
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
[gpadmin@sgpc146 ~]$ vi gpinitsystem_config 

#### will be created. The number of mirror locations must equal the
#### number of primary locations as specified in the
#### DATA_DIRECTORY parameter.
#declare -a MIRROR_DATA_DIRECTORY=(/data1/mirror /data1/mirror /data1/mirror /data2/mirror /data2/mirror /data2/mirror)


################################################
#### OTHER OPTIONAL PARAMETERS
################################################

#### Create a database of this name after initialization.
#DATABASE_NAME=name_of_database

#### Specify the location of the host address file here instead of
#### with the the -h option of gpinitsystem.
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem

ARRAY_NAME="EMC Greenplum DW"
SEG_PREFIX=gpseg
PORT_BASE=40000
declare -a DATA_DIRECTORY=(/gpsegment1 /gpsegment2)
MASTER_HOSTNAME=mdw
MASTER_DIRECTORY=/data/master
MASTER_PORT=5432
TRUSTED_SHELL=ssh
CHECK_POINT_SEGMENTS=8
ENCODING=UNICODE
#MIRROR_PORT_BASE=50000
#REPLICATION_PORT_BASE=41000
#MIRROR_REPLICATION_PORT_BASE=51000
#declare -a MIRROR_DATA_DIRECTORY=(/data/mirror /data/mirror)
#DATABASE_NAME=name_of_database
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem

MACHINE_LIST_FILE=/home/gpadmin/seg_hosts

"gpinitsystem_config" 98L, 3193C written                                                                          
[gpadmin@sgpc146 ~]$ ll
total 20
-rw-rw-r-- 1 gpadmin gpadmin    5 Sep 28 19:53 all_hosts
drwxrwxr-x 2 gpadmin gpadmin 4096 Sep 28 16:57 gpAdminLogs
drwxrwxr-x 2 gpadmin gpadmin 4096 Sep 28 20:25 gpconfigs
-rw-rw-r-- 1 gpadmin gpadmin 3193 Sep 28 20:34 gpinitsystem_config
-rw-rw-r-- 1 gpadmin gpadmin    5 Sep 28 20:07 seg_hosts
[gpadmin@sgpc146 ~]$ gpinitsystem -c /home/gpadmin/gpinitsystem_config
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking configuration parameters, please wait...
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Reading Greenplum configuration file /home/gpadmin/gpinitsystem_config
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Locale has not been set in /home/gpadmin/gpinitsystem_config, will set to default value
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Locale set to en_US.utf8
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Master hostname mdw does not match hostname output
20110928:20:34:19:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking to see if mdw can be resolved on this host
The authenticity of host 'mdw (127.0.0.1)' can't be established.
RSA key fingerprint is 11:2a:87:60:e5:2f:fd:56:d0:eb:96:bb:a9:45:89:df.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'mdw' (RSA) to the list of known hosts.
20110928:20:34:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Can resolve mdw to this host
20110928:20:34:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
20110928:20:34:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250
20110928:20:34:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Detected a single host GPDB array build, reducing value of BATCH_DEFAULT from 60 to 4
20110928:20:34:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking configuration parameters, Completed
20110928:20:34:50:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
.
20110928:20:34:50:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Configuring build for standard array
20110928:20:34:50:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Commencing multi-home checks, Completed
20110928:20:34:50:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Building primary segment instance array, please wait...
..
20110928:20:34:51:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking Master host
20110928:20:34:51:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking new segment hosts, please wait...
.20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-----------------------------------------------------------
20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-This will cause segment->master communication failures
20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-----------------------------------------------------------
.20110928:20:34:52:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-----------------------------------------------------------
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-This will cause segment->master communication failures
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-----------------------------------------------------------

20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checking new segment hosts, Completed
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Greenplum Database Creation Parameters
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:---------------------------------------
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master Configuration
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:---------------------------------------
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master instance name       = EMC Greenplum DW
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master hostname            = mdw
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master port                = 5432
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master instance dir        = /data/master/gpseg-1
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master LOCALE              = en_US.utf8
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Greenplum segment prefix   = gpseg
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master Database            = 
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master connections         = 250
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master buffers             = 128000kB
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Segment connections        = 750
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Segment buffers            = 128000kB
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Checkpoint segments        = 8
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Encoding                   = UNICODE
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Postgres param file        = Off
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Initdb to be used          = /usr/local/greenplum-db/./bin/initdb
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-GP_LIBRARY_PATH is         = /usr/local/greenplum-db/./lib
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Ulimit check               = Passed
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Array host connect type    = Single hostname per node
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [1]      = ::1
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [2]      = 129.100.253.146
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [3]      = 169.254.95.120
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [4]      = 2002:8164:fdd6:b:3640:b5ff:fea2:119c
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [5]      = 2002:8164:fdde:b:3640:b5ff:fea2:119c
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [6]      = fe80::3440:b5ff:fe9b:119f
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [7]      = fe80::3640:b5ff:fea2:119c
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Master IP address [8]      = fec0::b:3640:b5ff:fea2:119c
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Standby Master             = Not Configured
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Primary segment #          = 2
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Total Database segments    = 2
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Trusted shell              = ssh
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Number segment hosts       = 1
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Mirroring config           = OFF
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:----------------------------------------
20110928:20:34:53:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
20110928:20:34:54:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:----------------------------------------
20110928:20:34:54:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-sdw1      /gpsegment1/gpseg0      40000   2       0
20110928:20:34:54:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-sdw1      /gpsegment2/gpseg1      40001   3       1
Continue with Greenplum creation Yy/Nn>
y
20110928:20:34:58:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Building the Master instance database, please wait...
20110928:20:35:09:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Starting the Master in admin mode
20110928:20:35:29:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
20110928:20:35:29:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Spawning parallel processes    batch [1], please wait...
..
20110928:20:35:30:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait...
...................
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:------------------------------------------------
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Parallel process exit status
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:------------------------------------------------
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Total processes marked as completed           = 2
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Total processes marked as killed              = 0
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Total processes marked as failed              = 0
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:------------------------------------------------
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Deleting distributed backout files
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Removing back out file
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-No errors generated from parallel processes
20110928:20:35:49:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/master/gpseg-1
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Gathering information and validating the environment...
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Obtaining Segment details from master...
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.2.1.2 build 2'
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-There are 0 connections to the database
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Master host=sgpc146
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
20110928:20:35:49:018848 gpstop:sgpc146:gpadmin-[INFO]:-Master segment instance directory=/data/master/gpseg-1
20110928:20:35:51:018937 gpstart:sgpc146:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/master/gpseg-1
20110928:20:35:51:018937 gpstart:sgpc146:gpadmin-[INFO]:-Gathering information and validating the environment...
20110928:20:35:51:018937 gpstart:sgpc146:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.2.1.2 build 2'
20110928:20:35:51:018937 gpstart:sgpc146:gpadmin-[INFO]:-Greenplum Catalog Version: '201109210'
20110928:20:35:51:018937 gpstart:sgpc146:gpadmin-[INFO]:-Starting Master instance in admin mode
20110928:20:35:52:018937 gpstart:sgpc146:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20110928:20:35:52:018937 gpstart:sgpc146:gpadmin-[INFO]:-Obtaining Segment details from master...
20110928:20:35:52:018937 gpstart:sgpc146:gpadmin-[INFO]:-Setting new master era
20110928:20:35:52:018937 gpstart:sgpc146:gpadmin-[INFO]:-Master Started...
20110928:20:35:52:018937 gpstart:sgpc146:gpadmin-[INFO]:-Shutting down master
20110928:20:35:53:018937 gpstart:sgpc146:gpadmin-[INFO]:-No standby master configured.  skipping...
20110928:20:35:53:018937 gpstart:sgpc146:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
.. 
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-Process results...
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-   Successful segment starts                                            = 2
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-   Failed segment starts                                                = 0
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-   Skipped segment starts (segments are marked down in configuration)   = 0
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances 
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:35:55:018937 gpstart:sgpc146:gpadmin-[INFO]:-Starting Master instance sgpc146 directory /data/master/gpseg-1 
20110928:20:35:56:018937 gpstart:sgpc146:gpadmin-[INFO]:-Command pg_ctl reports Master sgpc146 instance active
20110928:20:35:56:018937 gpstart:sgpc146:gpadmin-[INFO]:-Database successfully started
20110928:20:35:56:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
20110928:20:35:56:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Loading gp_toolkit...
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Scanning utility log file for any warning messages
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-*******************************************************
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-were generated during the array creation
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Please review contents of log file
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20110928.log
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-To determine level of criticality
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-These messages could be from a previous run of the utility
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-that was called today!
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[WARN]:-*******************************************************
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Greenplum Database instance successfully created
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-------------------------------------------------------
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-To complete the environment configuration, please 
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/data/master/gpseg-1"
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-   to access the Greenplum scripts for this instance:
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-   or, use -d /data/master/gpseg-1 option for the Greenplum scripts
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-   Example gpstate -d /data/master/gpseg-1
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20110928.log
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Review options for gpinitstandby
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-------------------------------------------------------
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-The Master /data/master/gpseg-1/pg_hba.conf post gpinitsystem
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-has been configured to allow all hosts within this new
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
20110928:20:35:57:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-new array must be explicitly added to this file
20110928:20:35:58:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
20110928:20:35:58:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-located in the /usr/local/greenplum-db/./docs directory
20110928:20:35:58:004425 gpinitsystem:sgpc146:gpadmin-[INFO]:-------------------------------------------------------
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$

设置MASTER_DATA_DIRECTORY环境变量

初始化结束后,运行gpstat -s查看状态,会失败,它会提示你需要设置MASTER_DATA_DIRECTORY环境

 
[gpadmin@sgpc146 ~]$ gpstate -s
20110928:20:37:34:020820 gpstate:sgpc146:gpadmin-[INFO]:-Starting gpstate with args: -s
20110928:20:37:34:020820 gpstate:sgpc146:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 4.2.1.2 build 2'
20110928:20:37:34:020820 gpstate:sgpc146:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 8.2.15 (Greenplum Database 4.2.1.2 build 2) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Jun 11 2012 16:28:44'
20110928:20:37:34:020820 gpstate:sgpc146:gpadmin-[INFO]:-Obtaining Segment details from master...
20110928:20:37:34:020820 gpstate:sgpc146:gpadmin-[INFO]:-Gathering data from segments...
. 
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:--Master Configuration & Status
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master host                    = sgpc146
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master postgres process ID     = 19078
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master data directory          = /data/master/gpseg-1
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master port                    = 5432
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master current role            = dispatch
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Greenplum initsystem version   = 4.2.1.2 build 2
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Greenplum current version      = PostgreSQL 8.2.15 (Greenplum Database 4.2.1.2 build 2) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Jun 11 2012 16:28:44
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Postgres version               = 8.2.15
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Master standby                 = No master standby configured
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-Segment Instance Status Report
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Segment Info
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Hostname                          = sgpc146
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Address                           = sdw1
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Datadir                           = /gpsegment1/gpseg0
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Port                              = 40000
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Status
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      PID                               = 19047
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Configuration reports status as   = Up
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Database status                   = Up
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Segment Info
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Hostname                          = sgpc146
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Address                           = sdw1
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Datadir                           = /gpsegment2/gpseg1
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Port                              = 40001
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-   Status
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      PID                               = 19048
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Configuration reports status as   = Up
20110928:20:37:35:020820 gpstate:sgpc146:gpadmin-[INFO]:-      Database status                   = Up

尝试连接到postgres数据库：

[gpadmin@sgpc146 ~]$ psql -d postgres
psql (8.2.15)
Type "help" for help.

postgres=# select datname,datdba,encoding,datacl from pg_database;
  datname  | datdba | encoding |              datacl              
-----------+--------+----------+----------------------------------
 postgres  |     10 |        6 | 
 template1 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
 template0 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
(3 rows)

postgres=# \q
[gpadmin@sgpc146 ~]$ gpstop -a
20110928:20:39:32:021338 gpstop:sgpc146:gpadmin-[INFO]:-Starting gpstop with args: -a
20110928:20:39:32:021338 gpstop:sgpc146:gpadmin-[INFO]:-Gathering information and validating the environment...
20110928:20:39:32:021338 gpstop:sgpc146:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20110928:20:39:32:021338 gpstop:sgpc146:gpadmin-[INFO]:-Obtaining Segment details from master...
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.2.1.2 build 2'
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-There are 0 connections to the database
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='smart'
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-Master host=sgpc146
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=smart
20110928:20:39:33:021338 gpstop:sgpc146:gpadmin-[INFO]:-Master segment instance directory=/data/master/gpseg-1
20110928:20:39:34:021338 gpstop:sgpc146:gpadmin-[INFO]:-No standby master host configured
20110928:20:39:34:021338 gpstop:sgpc146:gpadmin-[INFO]:-Commencing parallel segment instance shutdown, please wait...
... 
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-   Segments stopped successfully      = 2
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-   Segments with errors during stop   = 0
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-Successfully shutdown 2 of 2 segment instances 
20110928:20:39:37:021338 gpstop:sgpc146:gpadmin-[INFO]:-Database successfully shutdown with no errors reported

[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ psql -d postgres
psql: could not connect to server: No such file or directory
        Is the server running locally and accepting
        connections on Unix domain socket "/tmp/.s.PGSQL.5432"?
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ 
[gpadmin@sgpc146 ~]$ gpstart -a
20110928:20:40:00:021497 gpstart:sgpc146:gpadmin-[INFO]:-Starting gpstart with args: -a
20110928:20:40:00:021497 gpstart:sgpc146:gpadmin-[INFO]:-Gathering information and validating the environment...
20110928:20:40:00:021497 gpstart:sgpc146:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.2.1.2 build 2'
20110928:20:40:00:021497 gpstart:sgpc146:gpadmin-[INFO]:-Greenplum Catalog Version: '201109210'
20110928:20:40:00:021497 gpstart:sgpc146:gpadmin-[INFO]:-Starting Master instance in admin mode
20110928:20:40:01:021497 gpstart:sgpc146:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20110928:20:40:01:021497 gpstart:sgpc146:gpadmin-[INFO]:-Obtaining Segment details from master...
20110928:20:40:01:021497 gpstart:sgpc146:gpadmin-[INFO]:-Setting new master era
20110928:20:40:01:021497 gpstart:sgpc146:gpadmin-[INFO]:-Master Started...
20110928:20:40:01:021497 gpstart:sgpc146:gpadmin-[INFO]:-Shutting down master
20110928:20:40:03:021497 gpstart:sgpc146:gpadmin-[INFO]:-No standby master configured.  skipping...
20110928:20:40:03:021497 gpstart:sgpc146:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
.. 
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-Process results...
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-   Successful segment starts                                            = 2
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-   Failed segment starts                                                = 0
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-   Skipped segment starts (segments are marked down in configuration)   = 0
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances 
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-----------------------------------------------------
20110928:20:40:05:021497 gpstart:sgpc146:gpadmin-[INFO]:-Starting Master instance sgpc146 directory /data/master/gpseg-1 
20110928:20:40:06:021497 gpstart:sgpc146:gpadmin-[INFO]:-Command pg_ctl reports Master sgpc146 instance active
20110928:20:40:06:021497 gpstart:sgpc146:gpadmin-[INFO]:-Database successfully started
[gpadmin@sgpc146 ~]$ psql -d postgres
psql (8.2.15)
Type "help" for help.

postgres=# select datname,datdba,encoding,datacl from pg_database;
  datname  | datdba | encoding |              datacl              
-----------+--------+----------+----------------------------------
 postgres  |     10 |        6 | 
 template1 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
 template0 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
(3 rows)

postgres=# select datname,datdba,encoding,datacl from pg_database;
  datname  | datdba | encoding |              datacl              
-----------+--------+----------+----------------------------------
 postgres  |     10 |        6 | 
 template1 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
 template0 |     10 |        6 | {=c/gpadmin,gpadmin=CTc/gpadmin}
(3 rows)

postgres=#

[gpadmin@sggp ~]$ gpcheckperf -f seg_hosts -r ds -D -d segmentdata
/usr/local/greenplum-db/./bin/gpcheckperf -f seg_hosts -r ds -D -d segmentdata

--------------------
-- DISK WRITE TEST
--------------------

--------------------
-- DISK READ TEST
--------------------

--------------------
-- STREAM TEST
--------------------

====================
== RESULT
====================

disk write avg time (sec): 107.08
disk write tot bytes: 33694318592
disk write tot bandwidth (MB/s): 300.09
disk write min bandwidth (MB/s): 300.09 [sdw]
disk write max bandwidth (MB/s): 300.09 [sdw]
-- per host bandwidth --
disk write bandwidth (MB/s): 300.09 [sdw]

disk read avg time (sec): 72.46
disk read tot bytes: 33694318592
disk read tot bandwidth (MB/s): 443.46
disk read min bandwidth (MB/s): 443.46 [sdw]
disk read max bandwidth (MB/s): 443.46 [sdw]
-- per host bandwidth --
disk read bandwidth (MB/s): 443.46 [sdw]

stream tot bandwidth (MB/s): 4814.12
stream min bandwidth (MB/s): 4814.12 [sdw]
stream max bandwidth (MB/s): 4814.12 [sdw]
-- per host bandwidth --
stream bandwidth (MB/s): 4814.12 [sdw]

[gpadmin@sggp ~]$

你可能感兴趣的:(File,database,Build,encoding,GreenPlum,parallel)

Jenkins-pipeline语法说明 xiao-xiang jenkins jenkins 运维
一.简述：JenkinsPipeline是一种持续集成和持续交付（CI/CD）工具，它允许用户通过代码定义构建、测试和部署流程。二.关于jenkinsfile：1.Sections部分：Pipeline里的Sections通常包含一个或多个Directives或Steps：a).agent：指定整个Pipeline或特定阶段将在Jenkins环境中执行的节点位置，具体取决于该agent部分的配置。
从编译器角度理解C++代码的编译和链接原理 crossoverpptx C/C++c++开发语言
1.编译过程中，符号是不生成虚拟地址的。2.链接阶段，各个段就要进行合并了：.text.text、.data.data、.bss.bss步骤一：所有对符号的引用，都要找到该符号定义的地方。常见问题：符号未定义、符号重定义步骤二：符号解析成功以后，给所有的符号分配虚拟地址。3.常用命令//-o：指定生成可执行文件的名称。使用方法为：g++-oafilefile.cppfile.h...//-c：只编
表的创建（列的类型定义） Chasing追～ mysql数据库学习数据库 c++学习 mysql
数据表操作表是一种很重要的数据库对象，是组成数据库的基本元素，由若干个字段组成，主要用来实现存储数据记录。表的操作包括创建表、查询表、修改表和删除表。如何创建一张简单表？ID(class_id)名称（class_name）班主任(class_teacher)101六年级一班马老师102六年级二班潘老师createdatabaseschool;useschool;createtableclass(c
__mkdir创建目录选与握 c++开发语言
1、__mkdir创建一次目录charbuf[80];_getcwd(buf,sizeof(buf));//获取当前工程.cpp文件所在路径strcat(buf,"\\pictureFile\\11");stringdirName=buf;_mkdir(dirName.c_str());//一次创建两级目录2、_mkdir多次创建目录#include"stdafx.h"#include#inclu
Xcode工程pod方式引用第三方SnapKit库流程及问题总结 f8之4 iOS Xcode 笔记 Xcode pod SnapKit
Xcode工程pod方式引用第三方SnapKit库流程及问题总结Podfile文件生成Podfile文件编辑Podfile文件下载库代码问题总结Xcode路径错误CocoaPods版本太低不能写入目录Podfile文件Podfile位于项目目录的根目录下，这里面主要声明了导入第三方库的名称及版本号。生成Podfile文件命令行先cd进入工程所在的目录，执行podinit命令该命令执行成功，目录下会
FISCO BCOS（二十三）———maven和gradle引入FISCO BCOS Javasdk 林中有神君 #FISCO BCOS 2.8.0 maven java mybatis
build.gradle引入依赖dependencies{compile('org.fisco-bcos.java-sdk:fisco-bcos-java-sdk:2.7.2')
PostgreSQL 介绍 candy662 postgresql
PostgreSQL是一个免费的对象-关系数据库服务器(ORDBMS)，在灵活的BSD许可证下发行。PostgreSQL开发者把它念作post-gress-Q-L。PostgreSQL的Slogan是"世界上最先进的开源关系型数据库"。参考内容：PostgreSQL10.1手册什么是数据库？数据库（Database）是按照数据结构来组织、存储和管理数据的仓库。每个数据库都有一个或多个不同的API用
linux环境变量配置文件区别 /etc/profile和~/.bash_profile 思静鱼 Linux&运维安装 linux
在Linux系统中，环境变量可以定义用户会话的行为，而这些变量的加载和配置通常涉及多个文件，如~/.bash_profile和/etc/profile。这些文件的作用和加载时机各有不同。以下是对它们的详细区别和用途的说明：文章目录1.环境变量配置文件的主要分类2.文件的加载时机和优先级3.常见文件的作用和示例4.推荐的配置方法5.总结1.环境变量配置文件的主要分类文件名作用范围加载时机说明/etc
《CPython Internals》阅读笔记：p360-p377 python
《CPythonInternals》学习第20天，p360-p377总结，总计18页。一、技术总结1.seaborn可视化工具。2.dtrace(1)安装sudoapt-getinstallsystemtap-sdt-dev(2)编译./configure--with-dtracemakecleanmake3.snakeviz适用于cProfile的可视化工具。二、英语总结(生词：0)无。关于英语
如何在容器内开发由数入道 docker 容器
在Docker容器内开发是现代开发的一种流行方式，特别是在需要一致性环境和依赖隔离的情况下。以下是详细的思路、方法和步骤，以及一个具体实例说明如何在容器内开发。一、为什么在容器内开发？一致性环境：容器内的开发环境与生产环境一致，避免“本地运行正常，服务器出问题”。依赖隔离：容器隔离不同项目的依赖，避免冲突。团队协作：通过共享Dockerfile或docker-compose，开发团队成员可以使用相
解决Python中libhdfs.so的共享库找不到的问题 code_welike python 开发语言 Python
解决Python中libhdfs.so的共享库找不到的问题在Python开发过程中，有时会遇到导入共享库时出现"ImportError:Cannotfindthesharedlibrary:libhdfs.so"的错误。这个错误通常发生在使用Python访问Hadoop分布式文件系统（HadoopDistributedFileSystem，简称HDFS）时，由于缺少libhdfs.so共享库文件而
【Wordpress网站制作】无法安装插件/主题等权限问题 TUTO_TUTO wordpress 有用没用小功能 apache apache 服务器 linux
前言自学笔记，解决问题为主，亲测有效，欢迎补充。本文重点：解决无法安装插件/主题问题问题描述：OS系统，XAMPP+Wordpress，在安装【插件】和下载【主题/模版】的时候，遇到以下问题。Installationfailed:Couldnotcreatedirectory./Applications/XAMPP/xamppfiles/htdocs/mactestwp/wp-content/up
Redis service failed to start的解决方法关关钧 redis 数据库 python
当进入cmd后，运行命令启动redis服务：redis-server.exe--service-start--service-nameredisserver1然而却报错了：Redisservicefailedtostart.解决方法：1、在解压的目录下找到redis.windows-service.conf2、打开redis.windows-service.conf，搜索logfile3、根据lo
MySQL命令及用法（精华版） MegumiKato丶知识杂谈 mysql 数据库
目录DDL（数据定义语言）数据库操作表操作DML（数据操作语言）DQL（数据查询语言）基本查询条件查询聚合函数分组查询排序查询分页查询DCL（数据控制语言）用户管理权限控制函数字符串函数数值函数日期函数流程函数约束多表查询内连接外连接自连接联合查询子查询标量子查询列子查询行子查询表子查询事务DDL（数据定义语言）用来定义数据库、表、字段。数据库操作查询所有数据库SHOWDATABASES;查询当前
hive窗口函数和hive基础使用醉与浮 hive hive 大数据 hadoop
7.270.连接客户端beeline-ujdbc:hive2://localhost:100001.建库并使用createdatabasexxxusexxx2.建表createtablexxxcreateexternaltableifnotexists如果该外部表不存在则创建外部表被删除时只会删除元数据不会删除数据。（hive不认为自己拥有这份数据）3.导入数据loaddatainpath‘/ro
如何开启Chrome浏览器、Edge浏览器、Firefox浏览器的实验室功能 new code Boy chrome edge firefox
Chrome浏览器：chrome://flagsEdge浏览器：edge://flagsFirefox浏览器：about:config以下Chrome、Edge常用配置开启并行下载：enable-parallel-downloading标签页分组功能：tab-groups开启阅读模式：enable-reader-mode开启深色模式：enable-force-dark开启全局媒体播放控制：glob
JupyterLab xr.open_dataset不识别中文路径拾穗哥 xr 经验分享 python
long0=xr.open_dataset("long.grd")运行以后发现已经生成的long.grd文件找不到FileNotFoundError:[Errno2]Nosuchfileordirectory:'F:\\03-专利\\\\新建文件夹\\ong.grd'多次试验发现：xr.open_dataset不识别中文路径将路径改为英文即可
关于在GitLab的CI/CD中用docker buildx本地化多架构打包dotnet应用的问题公西雒 linux C#gitlab ci/cd docker dotnet QEMU
关于在GitLab的CI/CD中用dockerbuildx本地化多架构打包dotnet应用的问题这是一个DevOps综合性问题dockerbuildx多架构打包.NET应用的问题用QEMU模拟多架构环境打包这是一个DevOps综合性问题网络上的方案都是细分的领域，未见一个集成了GitLab+docker+dotnet的多架构DevOps方案。由此，才产生了这篇文章，来说一说，我在自动化持续交付的过
MongoDB中单对象大小超16M的存储方案 yuanpan mongodb 数据库
在MongoDB中，单个文档的大小限制为16MB。如果某个对象（文档）的大小超过16MB，可以通过以下几种方案解决：1.使用GridFS适用场景：需要存储大文件（如图像、视频、文档等）。原理MongoDB的GridFS是一种专门用于存储超过16MB文件的工具。它会将大文件分割成多个chunk（默认大小255KB），并存储在两个集合中：fs.files：存储文件的元数据（如文件名、大小、类型等）。f
flutter引入高德地图_Flutter接入高德地图后运行报错耀答案 flutter引入高德地图
1、flutter开发接入高德地图包后运行报下面错误信息fatalerror:'simple_permissions/simple_permissions-Swift.h'filenotfound运行在iPhone手机时出现以下错误信息：===BUILDTARGETurl_launcherOFPROJECTPodsWITHCONFIGURATIONDebug===/Users/bobo/flutt
filebeat收集各种类型日志写入logstash，再从logstash中读取日志写入kafka中(有filebeat) 运维实战课程 kafka 分布式
filebeat收集各种类型日志写入logstash，再从logstash中读取日志写入kafka中(有filebeat)如果对运维课程感兴趣，可以在b站上、A站或csdn上搜索我的账号：运维实战课程，可以关注我，学习更多免费的运维实战技术视频0.环境机器规划：192.168.43.163kafka1192.168.43.164kafka2192.168.43.165kafka3192.168.4
【flutter版本升级】【Nativeshell适配】nativeshell需要做哪些更改 allanGold Flutter flutter nativeshell
flutter从3.13.9升级：3.27.2nativeshell组合库中的1、nativeshell_build库替换为github上的最新代码可以解决两个问题：一个是arg("--ExtraFrontEndOptions=--no-sound-null-safety")在新版flutter中这个构建参数不支持了导致的build错误（即内核build错误）一个是bin/cache/artifa
Linux(Centos 7.6)命令详解：wc 豆是浪个 centos linux 运维
1.命令作用打印文件的行数、单词数、字节数，如果指定了多个文件，还会打印以上三种数据的总和(Printnewline,word,andbytecountsforeachFILE,andatotallineifmorethanoneFILEisspecified)2.命令语法Usage:wc[OPTION]...[FILE]...or:wc[OPTION]...--files0-from=F3.参数
微服务（一）山猪打不过家猪 C#.net
文章目录项目地址一、微服务1.1分析User的DomianVerb和Nouns二、运行docker和k8s2.1Docker1.编写dockerfile2.创建dockerimage3.运行docker使用指定端口4.查看当前运行的镜像5.停止当前所有运行的docker6.删除不用的dockerimages7.将本地的image上传到hub里2.2K8S1.创建k8s的部署2.创建node服务3.
在树莓派安装arm gcc工具链 zili09 linux arm gnu linux
InstallGCC需要将gnu工具在树莓派重新编译，具体流程见文档：ThebuildprocessofGNUtoolsforARMembeddedprocessors由于编译需要的时间较长，Github上已经有人将编译过的文件放出来，直接拷贝进/usr/即可，见安装步骤。安装好之后，只需要在厂商提供的工具链build_debug.sh中将ARMGCC_DIR的值改为/usr即可，之后运行脚本将调
【window批处理文件快速入门学习--这份文档就够了】少年近视批处理 adb 学习 batch
一、简介1.1什么是批处理文件？批处理文件（BatchFile）是一种包含一系列DOS命令的文本文件，通常用于自动化重复性任务。文件的扩展名为.bat或.cmd，当在命令提示符下运行时，操作系统会按顺序执行文件中的命令。批处理文件的创建和使用为用户提供了高效的命令行操作方式。示例：创建一个简单的批处理文件，文件名为example.bat，内容如下：@echooffecho这是一个简单的批处理文件。
linux下使用vscode和cmake高效管理c++项目简明教程 zeeq_ Ubuntu C++vscode vscode linux c++
安装vscode及c++环境配置可以参见：https://blog.csdn.net/fangshuo_light/article/details/123635576 首先，创建工程目录，并在vscode中打开该文件夹，在里面创建如下文件夹：include：用于存放.h文件src：用于存放.cpp文件build：cmake生成文件的存放路径CMakeLists.txt：cmake配置文件
three.js中文字符随机生成旋转动画一粒马豆 javascript three.js 中文字符动画
Three.js随机中文字符生成旋转动画body{margin:0;}canvas{display:block;}{"imports":{"three":"https://cdn.jsdelivr.net/npm/[email protected]/build/three.module.js","three/addons/":"https://cdn.jsdelivr.net/npm/[email protected]
PEX: Python Executable魔力工具箱史艾岭
PEX:PythonExecutable魔力工具箱pexAtoolforgenerating.pex(PythonEXecutable)files,lockfilesandvenvs.项目地址:https://gitcode.com/gh_mirrors/pe/pex项目基础介绍及主要编程语言PEX（PythonEXecutable）是Pantsbuild团队维护的一个强大开源项目，致力于简化Py
16进制编辑器 linux,Tweak - Linux下的16进制编辑器 Melo的健身课堂 16进制编辑器 linux
tweak是可以在命令行方式下使用的16进制编辑器，在UbuntuLinux下可以用apt-getinstalltweak安装，用man可以看使用方法。命令格tweak是可以在命令行方式下使用的16进制编辑器，在UbuntuLinux下可以用apt-getinstalltweak安装，用man可以看使用方法。命令格式：tweak[‐l|‐f][‐e][‐wwidth][‐ooffset]filen
书其实只有三类西蜀石兰类
一个人一辈子其实只读三种书，知识类、技能类、修心类。知识类的书可以让我们活得更明白。类似十万个为什么这种书籍，我一直不太乐意去读，因为单纯的知识是没法做事的，就像知道地球转速是多少一样（我肯定不知道），这种所谓的知识，除非用到，普通人掌握了完全是一种负担，维基百科能找到的东西，为什么去记忆？知识类的书，每个方面都涉及些，让自己显得不那么没文化，仅此而已。社会认为的学识渊博，肯定不是站在
《TCP/IP 详解，卷1：协议》学习笔记、吐槽及其他 bylijinnan tcp
《TCP/IP 详解，卷1：协议》是经典，但不适合初学者。它更像是一本字典，适合学过网络的人温习和查阅一些记不清的概念。这本书，我看的版本是机械工业出版社、范建华等译的。这本书在我看来，翻译得一般，甚至有明显的错误。如果英文熟练，看原版更好： http://pcvr.nl/tcpip/ 下面是我的一些笔记，包括我看书时有疑问的地方，也有对该书的吐槽，有不对的地方请指正： 1.
Linux—— 静态IP跟动态IP设置 eksliang linux IP
一.在终端输入 vi /etc/sysconfig/network-scripts/ifcfg-eth0 静态ip模板如下： DEVICE="eth0" #网卡名称 BOOTPROTO="static" #静态IP（必须） HWADDR="00:0C:29:B5:65:CA" #网卡mac地址 IPV6INIT=&q
Informatica update strategy transformation 18289753290
更新策略组件：标记你的数据进入target里面做什么操作，一般会和lookup配合使用，有时候用0,1,1代表 forward rejected rows被选中，rejected row是输出在错误文件里，不想看到reject输出，将错误输出到文件，因为有时候数据库原因导致某些column不能update，reject就会output到错误文件里面供查看，在workflow的
使用Scrapy时出现虽然队列里有很多Request但是却不下载，造成假死状态酷的飞上天空 request
现象就是：程序运行一段时间，可能是几十分钟或者几个小时，然后后台日志里面就不出现下载页面的信息，一直显示上一分钟抓取了0个网页的信息。刚开始已经猜到是某些下载线程没有正常执行回调方法引起程序一直以为线程还未下载完成，但是水平有限研究源码未果。经过不停的google终于发现一个有价值的信息，是给twisted提出的一个bugfix 连接地址如下http://twistedmatrix.
利用预测分析技术来进行辅助医疗蓝儿唯美医疗
2014年，克利夫兰诊所（Cleveland Clinic）想要更有效地控制其手术中心做膝关节置换手术的费用。整个系统每年大约进行2600例此类手术，所以，即使降低很少一部分成本，都可以为诊所和病人节约大量的资金。为了找到适合的解决方案，供应商将视野投向了预测分析技术和工具，但其分析团队还必须花时间向医生解释基于数据的治疗方案意味着什么。克利夫兰诊所负责企业信息管理和分析的医疗
java 线程(一)：基础篇 DavidIsOK java 多线程线程
&nbs
Tomcat服务器框架之Servlet开发分析 aijuans servlet
最近使用Tomcat做web服务器，使用Servlet技术做开发时，对Tomcat的框架的简易分析：疑问：为什么我们在继承HttpServlet类之后，覆盖doGet(HttpServletRequest req, HttpServetResponse rep)方法后，该方法会自动被Tomcat服务器调用，doGet方法的参数有谁传递过来？怎样传递？分析之我见： doGet方法的
揭秘玖富的粉丝营销之谜与小米粉丝社区类似 aoyouzi 揭秘玖富的粉丝营销之谜
玖富旗下悟空理财凭借着一个微信公众号上线当天成交量即破百万，第七天成交量单日破了1000万;第23天时，累计成交量超1个亿……至今成立不到10个月，粉丝已经超过500万，月交易额突破10亿，而玖富平台目前的总用户数也已经超过了1800万，位居P2P平台第一位。很多互联网金融创业者慕名前来学习效仿，但是却鲜有成功者，玖富的粉丝营销对外至今仍然是个谜。　　近日，一直坚持微信粉丝营销
Java web的会话跟踪技术百合不是茶 url会话 Cookie会话 Seession会话 Java Web 隐藏域会话
会话跟踪主要是用在用户页面点击不同的页面时,需要用到的技术点会话:多次请求与响应的过程 1,url地址传递参数,实现页面跟踪技术格式:传一个参数的 url?名=值传两个参数的 url?名=值 &名=值关键代码
web.xml之Servlet配置 bijian1013 java web.xml Servlet配置
定义： <servlet> <servlet-name>myservlet</servlet-name> <servlet-class>com.myapp.controller.MyFirstServlet</servlet-class> <init-param> <param-name>
利用svnsync实现SVN同步备份 sunjing SVN 同步 E000022 svnsync 镜像
1. 在备份SVN服务器上建立版本库 svnadmin create test 2. 创建pre-revprop-change文件 cd test/hooks/ cp pre-revprop-change.tmpl pre-revprop-change 3. 修改pre-revprop-
【分布式数据一致性三】MongoDB读写一致性 bit1129 mongodb
本系列文章结合MongoDB，探讨分布式数据库的数据一致性，这个系列文章包括：数据一致性概述与CAP 最终一致性(Eventually Consistency) 网络分裂(Network Partition)问题多数据中心(Multi Data Center) 多个写者(Multi Writer)最终一致性一致性图表(Consistency Chart) 数据
Anychart图表组件-Flash图转IMG普通图的方法白糖_ Flash
问题背景：项目使用的是Anychart图表组件，渲染出来的图是Flash的，往往一个页面有时候会有多个flash图，而需求是让我们做一个打印预览和打印功能，让多个Flash图在一个页面上打印出来。那么我们打印预览的思路是获取页面的body元素，然后在打印预览界面通过$("body").append(html)的形式显示预览效果，结果让人大跌眼镜：Flash是
Window 80端口被占用 WHY? bozch 端口占用 window
平时在启动一些可能使用80端口软件的时候，会提示80端口已经被其他软件占用，那一般又会有那些软件占用这些端口呢？下面坐下总结： 1、web服务器是最经常见的占用80端口的，例如：tomcat , apache , IIS , Php等等； 2
编程之美-数组的最大值和最小值-分治法（两种形式） bylijinnan 编程之美
import java.util.Arrays; public class MinMaxInArray { /** * 编程之美数组的最大值和最小值分治法 * 两种形式 */ public static void main(String[] args) { int[] t={11,23,34,4,6,7,8,1,2,23}; int[]
Perl正则表达式 chenbowen00 正则表达式 perl
首先我们应该知道 Perl 程序中，正则表达式有三种存在形式，他们分别是：匹配：m/<regexp>;/ （还可以简写为 /<regexp>;/ ，略去 m）替换：s/<pattern>;/<replacement>;/ 转化：tr/<pattern>;/<replacemnt>;
[宇宙与天文]行星议会是否具有本行星大气层以外的权力呢? comsci
举个例子: 地球,地球上由200多个国家选举出一个代表地球联合体的议会,那么现在地球联合体遇到一个问题,地球这颗星球上面的矿产资源快要采掘完了....那么地球议会全体投票,一致通过一项带有法律性质的议案,既批准地球上的国家用各种技术手段在地球以外开采矿产资源和其它资源........ &
Oracle Profile 使用详解 daizj oracle profile 资源限制
Oracle Profile 使用详解转一、目的： Oracle系统中的profile可以用来对用户所能使用的数据库资源进行限制，使用Create Profile命令创建一个Profile，用它来实现对数据库资源的限制使用，如果把该profile分配给用户，则该用户所能使用的数据库资源都在该profile的限制之内。二、条件：创建profile必须要有CREATE PROFIL
How HipChat Stores And Indexes Billions Of Messages Using ElasticSearch & Redis dengkane elasticsearch Lucene
This article is from an interview with Zuhaib Siddique, a production engineer at HipChat, makers of group chat and IM for teams. HipChat started in an unusual space, one you might not
循环小示例，菲波拉契序列，循环解一元二次方程以及switch示例程序 dcj3sjt126com c 算法
# include <stdio.h> int main(void) { int n; int i; int f1, f2, f3; f1 = 1; f2 = 1; printf("请输入您需要求的想的序列："); scanf("%d", &n); for (i=3; i<n; i
macbook的lamp环境 dcj3sjt126com lamp
sudo vim /etc/apache2/httpd.conf /Library/WebServer/Documents 是默认的网站根目录重启Mac上的Apache服务这个命令很早以前就查过了，但是每次使用的时候还是要在网上查：停止服务：sudo /usr/sbin/apachectl stop 开启服务：s
java ArrayList源码下 shuizhaosi888 ArrayList源码
版本 jdk-7u71-windows-x64 JavaSE7 ArrayList源码上：http://flyouwith.iteye.com/blog/2166890 /** * 从这个列表中移除所有c中包含元素 */ public boolean removeAll(Collection<?> c) {
Spring Security（08）——intercept-url配置 234390216 Spring Security intercept-url 访问权限访问协议请求方法
intercept-url配置目录 1.1 指定拦截的url 1.2 指定访问权限 1.3 指定访问协议 1.4 指定请求方法 1.1 &n
Linux环境下的oracle安装 jayung oracle
linux系统下的oracle安装本文档是Linux(redhat6.x、centos6.x、redhat7.x) 64位操作系统安装Oracle 11g(Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production)，本文基于各种网络资料精心整理而成，共享给有需要的朋友。如有问题可联系：QQ：52-7
hotspot虚拟机 leichenlei java HotSpot jvm 虚拟机文档
JVM参数 http://docs.oracle.com/javase/6/docs/technotes/guides/vm/index.html JVM工具 http://docs.oracle.com/javase/6/docs/technotes/tools/index.html JVM垃圾回收 http://www.oracle.com
读《Node.js项目实践：构建可扩展的Web应用》 ——引编程慢慢变成系统化的“砌砖活” noaighost Web node.js
读《Node.js项目实践：构建可扩展的Web应用》 ——引编程慢慢变成系统化的“砌砖活” 眼里的Node.JS 初初接触node是一年前的事，那时候年少不更事。还在纠结什么语言可以编写出牛逼的程序，想必每个码农都会经历这个月经性的问题：微信用什么语言写的？facebook为什么推荐系统这么智能，用什么语言写的？dota2的外挂这么牛逼，用什么语言写的？……用什么语言写这句话，困扰人也是阻碍
快速开发Android应用 rensanning android
Android应用开发过程中，经常会遇到很多常见的类似问题，解决这些问题需要花时间，其实很多问题已经有了成熟的解决方案，比如很多第三方的开源lib，参考 Android Libraries 和 Android UI/UX Libraries。编码越少，Bug越少，效率自然会高。但可能由于根本没听说过、听说过但没用过、特殊原因不能用、自己已经有了解决方案等等原因，这些成熟的解决
理解Java中的弱引用 tomcat_oracle java 工作面试
　不久之前，我面试了一些求职Java高级开发工程师的应聘者。我常常会面试他们说，“你能给我介绍一些Java中得弱引用吗？”，如果面试者这样说，“嗯，是不是垃圾回收有关的？”，我就会基本满意了，我并不期待回答是一篇诘究本末的论文描述。　　然而事与愿违，我很吃惊的发现，在将近20多个有着平均5年开发经验和高学历背景的应聘者中，居然只有两个人知道弱引用的存在，但是在这两个人之中只有一个人真正了
标签输出html标签" target="_blank">关于标签输出html标签 xshdch jsp
http://back-888888.iteye.com/blog/1181202 关于<c:out value=""/>标签的使用，其中有一个属性是escapeXml默认是true(将html标签当做转移字符，直接显示不在浏览器上面进行解析)，当设置escapeXml属性值为false的时候就是不过滤xml，这样就能在浏览器上解析html标签， &nb