Greenplum 元数据信息

Greenplum 元数据信息

Greenplum 元数据信息
1、 获取集群中数据库信息
  1.1 集群中的创建的数据库信息
  1.2 查看每个数据库的储存大小
  1.3 查看集群中hostname
  1.4 查看集群数据库的版本信息
  1.5 查看集群master与segment安装的信息
2、 查看数据库下schema信息
  2.1 查看数据库下创建的schema信息
  2.2 查看数据库下每个schema的大小
3、 查看schema下表的信息
  3.1 查看schema下的表的清单
  3.2 查看表的字段的信息
  3.3 查看schema下的每个表的大小
  3.4 获取表的生命周期
  3.5 获取表的膨胀率
  3.6 查看表的倾斜率
  3.7 查看需要Analyze的表
  3.8 查看表的字段个类型信息
  3.9 查看表字段的注释信息
  3.10 查看数据库中的 AO 表
  3.11 查看数据库中的堆表
  3.12 查看external外部表信息
  3.13 查看超过1GB倾斜率的表
4 查看集群中用户相关的信息
  4.1 集群中创建的用户信息
  4.2 用户创建的表信息
5 集群中Function的信息
  5.1 查看创建的所有Function的信息
  5.2 查看制定schema下的Function信息
6 集群中资源队列的信息
  6.1 查看创建的资源队列
  6.2 查看资源队列的参数配置
7 查看索引相关的信息
  7.1 查看索引大小超过表总大小 1/2  的系统表大小和索引大小
  7.2 查看制定schem上表的索引
  7.3 索引活跃度IO活跃度查看
  7.4 索引活跃度IO访问活跃度
  7.5 查看 Master与Segment上索引不一致的问题
  7.6 查看索引的使用次数
8 集群中正在运行的SQL信息
  8.1 查看正在运行的SQL信息
  8.2 查看SQL的锁
9 查询数据库与表的年龄
  9.1 查询数据库的年龄
  9.2 查询表的年龄

1、获取集群中数据库信息

1.1 集群中的创建的数据库信息

select datname from pg_database where datname not in ('template1','template0','postgres');

1.2 查看每个数据库的储存大小

select pg_size_pretty(pg_database_size('databases')) as databasesize, 'databases' as databasename


databases : 数据库信息

1.3 查看集群中hostname

SELECT hostname FROM gp_segment_configuration group by hostname order by hostname;

1.4 查看集群数据库的版本信息

select version()

1.5 查看集群master与segment安装的信息

SELECT * FROM gp_segment_configuration;content为-1的为master节点，

2、查看数据库下schema信息

2.1 查看数据库下创建的schema信息

select nspname as schemaname from pg_namespace where nspname!~'pg_*' ORDER BY nspname

2.2 查看数据库下每个schema的大小

select pg_size_pretty(cast(sum(pg_relation_size( schemaname || '.' || tablename)) as bigint)), schemaname
from pg_tables t inner join pg_namespace d on t.schemaname=d.nspname group by schemaname;

3、查看schema下表的信息

3.1 查看schema下的表的清单

select 'schemaname '||'.'||c.relname as tablenamefrom pg_catalog.pg_class c, pg_catalog.pg_namespace nwheren.oid = c.relnamespaceand n.nspname='schemaname 'and pc.relstorage IN ('type')



schemaname : schema的名字type：a和c是AO表,h是heap表,x是外表

3.2 查看表的字段的信息

select table_schema||'.'||table_name as tablename,column_name,case character_maximum_length is null  when 't' then data_typeelse data_type||'('||character_maximum_length||')' end as character_maximum_lengthfrom information_schema.columns where table_schema='schema'and table_name='tablename';schema :  

​​​​​​​schema的信息Tablename : 表的名字

3.3 查看schema下的每个表的大小

select schemaname||'.'||tablename,pg_relation_size(schemaname || '.' || tablename)/1024/1024/1024 as tablesizefrom pg_tables t inner join pg_namespace d on t.schemaname=d.nspnameand nspname='schema 'ORDER BY tablesize desclimit 100;

​​​​​​​schema :  schema的信息

3.4 获取表的生命周期

select staactionname,stausename,stasubtype,to_char(statime,'yyyy-mm-dd hh24:mm:ss')||'' as statimefrom pg_stat_last_operation where objid = 'tablename'::regclass  order by statime desctablename : 表的名字

3.5 获取表的膨胀率

select percent_hiddenfrom gp_toolkit.__gp_aovisimap_compaction_info('main.t_ent_baseinfo'::regclass)ORDER BY percent_hidden desc;

3.6 查看表的倾斜率

SELECT max(c) AS MaxSegRows, min(c) AS MinSegRows,
substr((max(c)-min(c))*100.0/max(c)||'',0,8) AS PercentageDifferenceBetween
FROM (SELECT count(*) c, gp_segment_id FROM tablename
GROUP BY 2) AS a
​​​​​​​
atablename : 表的名字

3.7 查看需要Analyze的表

select smischema||'.'||smitable as tablename,smisize,smicols,smirecs from gp_toolkit.gp_stats_missing where smisize='f' limit 10;

3.8 查看表的字段个类型信息

select table_schema||'.'||table_name as tablename,column_name,case character_maximum_length is null  when 't' then data_typeelse data_type||'('||character_maximum_length||')' end as character_maximum_lengthfrom information_schema.columns where table_schema='schema'and table_name='tablename';schema ：schem信息tablename : 表的名字

3.9 查看表字段的注释信息

SELECT 'tablename' as table_name      ,a.attname                            AS column_name      ,format_type(a.atttypid, a.atttypmod) AS data_type      ,d.description                        AS description         ,a.attnum      ,a.attnotnull                         AS notnull      ,coalesce(p.indisprimary, FALSE)      AS primary_key      ,f.adsrc                              AS default_valFROM   pg_attribute    aLEFT   JOIN pg_index   p ON p.indrelid = a.attrelid AND a.attnum = ANY(p.indkey)LEFT   JOIN pg_description d ON d.objoid  = a.attrelid AND d.objsubid = a.attnumLEFT   JOIN pg_attrdef f ON f.adrelid = a.attrelid  AND f.adnum = a.attnumWHERE  a.attnum > 0AND    NOT a.attisdroppedAND    a.attrelid = 'tablename'::regclassORDER  BY a.attnum;tablename : 表的名字

3.10 查看数据库中的 AO 表

select t2.nspname, t1.relname from pg_class t1, pg_namespace t2where t1.relnamespace=t2.oid and relstorage in ('c', 'a');

3.11 查看数据库中的堆表

select t2.nspname, t1.relname from pg_class t1, pg_namespace t2where t1.relnamespace=t2.oid and relstorage in ('h') and relkind='r';

3.12 查看external外部表信息

select t2.nspname, t1.relname from pg_class t1, pg_namespace t2where t1.relnamespace=t2.oid and relstorage in ('x') and relkind='r';

3.13 查看超过1GB倾斜率的表

SELECT'select ''' || schemaname || '.' || tablename || ''' tabname' ||E' ,pg_size_pretty(sum(pg_relation_size(\'' || schemaname || '.' || tablename || E'\'))::bigint) assum_relation_size' ||E' ,pg_size_pretty(max(pg_relation_size(\'' || schemaname || '.' || tablename || E'\'))) as max_relation_size'||E' ,pg_size_pretty(min(pg_relation_size(\'' || schemaname || '.' || tablename || E'\'))) as min_relation_size'||E' ,max(pg_relation_size(\'' || schemaname || '.' || tablename || E'\'))::numeric(100,1)/min(pg_relation_size(\'' || schemaname || '.' || tablename || E'\')) skew_info ' || E' from gp_dist_random(\'gp_id\') ' || E'wherepg_relation_size(\'' || schemaname || '.' || tablename || E'\' )<>0;' as question_table_sqlFROMpg_tablesWHEREpg_relation_size(tablename) > 1.0 * 1024 * 1024 * 1024and schemaname not in ('information_schema','pg_catalog')ORDER BYpg_relation_size(tablename)DESC;

4 查看集群中用户相关的信息

4.1 集群中创建的用户信息

select rolname,case rolsuper when 't' then '是管理员' when 'f' then '不是管理员'end as rolsuper, case rolcreaterole when 't' then '可以创建角色' when 'f' then '不可以创建角色' end as rolcreaterole,case rolcreatedb  when 't' then '可以创建DB' when 'f' then '不可以创建DB' end as rolcreatedb,case rolcanlogin  when 't' then '可以登录' when 'f' then '不可以登录' end as rolcanlogin,case rolconnlimit when  '-1' then '没有限制' else '有限制' end as rolconnlimit,case  when rolvaliduntil is null  then '永不失效' else '有失效时间' end as rolvaliduntil,rsqnamefrom pg_roles,gp_toolkit.gp_resqueue_status where rolname not like 'gpcc%' and pg_roles.rolresqueue=gp_toolkit.gp_resqueue_status.queueidorder by rolname

4.2 用户创建的表信息

select grantee,table_schema||'.'||table_name as tablename,
privilege_type,is_grantablefrom information_schema.table_privileges 
where grantee= 'gpadmin'  limit 100

5 集群中Function的信息

5.1 查看创建的所有Function的信息

SELECT pg_proc.proname AS proname,pg_type.typname AS typename,pg_proc.pronargs
 AS argscount FROM pg_proc JOIN pg_type ON(pg_proc.prorettype = pg_type.oid) 
​​​​​​​WHERE pg_type.typname != 'void'and pg_proc.proname like 'sp_%' ORDER BY pg_proc.proname ;

void : 返回的类型

sp_% : 函数的前缀

5.2 查看制定schema下的Function信息

SELECT pg_proc.proname AS proname,pg_type.typname AS typename,pg_proc.pronargs AS argscount FROM pg_proc JOIN pg_type ON(pg_proc.prorettype = pg_type.oid) WHERE pg_type.typname != 'void'and pg_proc.proname like 'sp_%' and pronamespace = (SELECT pg_namespace.oid FROM pg_namespace WHERE nspname = 'schema' )ORDER BY pg_proc.proname ;

void : 返回的类型
sp_% : 函数的前缀
​​​​​​​schema : 制定的schema的信息

6 集群中资源队列的信息

6.1 查看创建的资源队列

select  * from pg_resqueue

6.2 查看资源队列的参数配置

select rsqname,resname,ressetting from pg_resqueue_attributes

7 查看索引相关的信息

7.1 查看索引大小超过表总大小 1/2 的系统表大小和索引大小

select indrelid::regclass tab,pg_size_pretty(avg(pg_total_relation_size(indrelid))::bigint) all_size,case when avg(pg_relation_size(indrelid))+ sum(pg_total_relation_size(indexrelid)) = avg(pg_total_relation_size(indrelid)) then 't' else 'f' end,pg_size_pretty(avg(pg_relation_size(indrelid))::bigint) tab_size,pg_size_pretty(sum(pg_total_relation_size(indexrelid))::bigint) all_idx_sizefrom pg_indexwhere indrelid in (select oid from pg_class where relnamespace in (select oid frompg_namespace wherenspname='pg_catalog') )group by indrelid::regclasshaving sum(pg_total_relation_size(indexrelid))::bigint >=avg(pg_total_relation_size(indrelid))::bigint * 0.5order by sum(pg_total_relation_size(indexrelid)) desclimit  50;获取的前50条信息

7.2 查看制定schem上表的索引

select * from pg_stat_all_indexes where schemaname in ('schema1',[schema2,schema3]);

7.3 索引活跃度IO活跃度查看

select * from pg_catalog.pg_statio_all_indexes where schemaname in ('schema1',[schema2,schema3]);

7.4 索引活跃度IO访问活跃度

select * from pg_catalog.pg_stat_all_indexes where schemaname in ('schema1',[schema2,schema3]);

7.5 查看 Master与Segment上索引不一致的问题

以下语句只要有数据输出表示有的表索引不一致，请进一步查看
select distinct n.nspname,c.relname from gp_dist_random('pg_class') r ,pg_classc,pg_namespace nwhere r.oid=c.oid and r.relhasindex<>c.relhasindexand c.relnamespace = n.oid limit 10

7.6 查看索引的使用次数

selectrelname, indexrelname, idx_scan, idx_tup_read, idx_tup_fetchfrompg_stat_user_indexesorder byidx_scan asc, idx_tup_read asc, idx_tup_fetch asc;

8 集群中正在运行的SQL信息

8.1 查看正在运行的SQL信息

select datname,procpid,usename,current_query,waiting, 
to_char(query_start,'yyyy-mm-dd hh24:mm:ss') as query_start,
to_char(backend_start,'yyyy-mm-dd hh24:mm:ss') as backend_start,((substr(now()||'',0,20)::timestamp) - (substr(query_start||'',0,20)::timestamp))||'' 
as takingTime,client_addr,application_name,waiting_reason  from pg_stat_activity where current_query <> ''order by takingTime desc

8.2 查看SQL的锁

select b.query_start,a.* fromgp_toolkit.gp_locks_on_relation a, 
pg_stat_activity b where a.lorpid=b.procpidand a.lorrelname
 not like 'pg_%' and a.lorrelname not like 'gp_%' order by 1desc;

9 查询数据库与表的年龄

9.1 查询数据库的年龄

select datname,age(datfrozenxid) from pg_database where age(datfrozenxid) > 1500000000
1500000000: 15亿的年龄
如果超过15亿，建议用户在业务空闲时间段，执行：
 set vacuum_freeze_min_age = 0; 
 vacuum freeze;

9.2 查询表的年龄

select * from (select pt.schemaname||'.'||ts.relname as tablename,pg_relation_size(pt.schemaname||'.'||ts.relname)/1024/1024/1024 as tablesizegb,ts.relfrozenxid,ts.stausename,ts.stasubtype,ts.statime from (SELECT ps.stausename,ps.staactionname,ps.stasubtype,pc.relname,ps.statime,age(relfrozenxid) as relfrozenxidFROM pg_stat_last_operation ps,pg_class pc WHERE ps.objid = pc.oidand age(pc.relfrozenxid) > 1500000000) ts,pg_tables ptwhere ts.relname = pt.tablenameorder by tablesizegb desc) txdwhere txd.tablesizegb > 0

1500000000 : 15 亿的年龄
tablename : 表的名字
如果超过 15 亿，建议用户在业务空闲时间段，执行：
set vacuum_freeze_min_age = 0;
vacuum freeze tablename;