R语言链接redshift数据库

在工作中进行数据挖掘,机器学习,数据分析等等,需要使用到数据库。但是如何链接数据库,可能统计学的学生在学校接触并不多。R基本上所有的数据库的链接都支持:

RODBC - R中ODBC数据库范围. 官网:http://cran.r-project.org/web/packages/RODBC/

DBI - 在R和数据库管理系统之间定义一个公共的接口. 官网:https://github.com/rstats-db/DBI

elastic - Elasticsearch HTTP API的包装器. 官网:https://github.com/ropensci/elastic

mongolite - R中Mongo客户端. 官网:https://github.com/jeroenooms/mongolite

RMySQL - R语言的MySQL数据库接口. 官网:http://cran.r-project.org/web/packages/RMySQL/

ROracle - R中Oracle数据库的接口. 官网:http://cran.r-project.org/web/packages/ROracle/index.html

RPostgreSQL - R语言的PostgreSQL数据库系统接口. 官网:https://code.google.com/p/rpostgresql/

RSQLite - R语言SQLite数据库接口. 官网:http://cran.r-project.org/web/packages/RSQLite/

RJDBC - 通过JDBC接口访问数据库. 官网:http://cran.r-project.org/web/packages/RJDBC/

rmongodb - R中MongoDB驱动. 官网:https://github.com/mongosoup/rmongodb

rredis - R中Redis驱动. 官网:http://cran.r-project.org/web/packages/rredis/

RCassandra -Apache Cassanda直接接口(不是JAVA),提供了最多的基本功能. 官网:http://cran.r-project.org/web/packages/RCassandra/index.html

RHive - 通过Apache Hive的R扩展促进分布式计算. 官网:https://github.com/nexr/RHive

RNeo4j - Neo4j图形数据库驱动. 官网:https://github.com/nicolewhite/Rneo4j

链接redshift

链接redshift数据库的方法有很多,一一列举:

  1. RJDBC
install.packages("RJDBC")
library(RJDBC)

# download Amazon Redshift JDBC driver
download.file('http://s3.amazonaws.com/redshift-downloads/drivers/RedshiftJDBC41-1.1.9.1009.jar','RedshiftJDBC41-1.1.9.1009.jar')

# connect to Amazon Redshift
driver <- JDBC("com.amazon.redshift.jdbc41.Driver", "RedshiftJDBC41-1.1.9.1009.jar", identifier.quote="`")
# url <- ":/?user=&password=
url <- "jdbc:redshift://demo.ckffhmu2rolb.eu-west-1.redshift.amazonaws.com
:5439/demo?user=XXX&password=XXX"
conn <- dbConnect(driver, url) 


library(RJDBC)

# download Amazon Redshift JDBC driver
download.file('http://s3.amazonaws.com/redshift-downloads/drivers/RedshiftJDBC41-1.1.9.1009.jar','RedshiftJDBC41-1.1.9.1009.jar')

# connect to Amazon Redshift
driver <- JDBC("com.amazon.redshift.jdbc41.Driver", "RedshiftJDBC41-1.1.9.1009.jar", identifier.quote="`")
# url <- ":/?user=&password=
url <- "jdbc:redshift://jiayundatapro.cls0csjdlwvj.us-west-2.redshift.amazonaws.com:5439/jiayundata?user=ds_report&password=DataAs1234"
conn <- dbConnect(driver, url)

显示数据库中的表格

# list tables
dbGetTables(conn)
dbGetQuery(conn, "SELECT table_name FROM information_schema.tables WHERE table_schema = 'public'")

# get some data from the Redshift table
dbGetQuery(conn, "select count(*) from flights")

# this is not a good idea – the table has more than 100 Mio. rows”
# fligths <- dbReadTable(conn, "flights")

# close connection
dbDisconnect(conn)
  1. dplyr
    这个包是数据分析的包,但是也可以用来链接数据库
# now run analyses with the dplyr package on Amazon Redshift
install.packages("dplyr")
library(dplyr)
library(RPostgreSQL)
#myRedshift <- src_postgres("",
#   host = ",
#   port = ,
#   user = "

获取某一个表

# create table reference
flights <- tbl(myRedshift, "flights")
# 或者
dplyr::tbl(con, dbplyr::in_schema("abc", "mytable1"))
# 或者
remote_df = dplyr::tbl(sc,from = "db.financer_tbl") # 定义数据源表 
# 或者 
remote_df = dplyr::tbl(sc,from = dplyr::sql("select * from db.financer_tbl limit 10")) #

# simple and default R commands analyzing data frames
dim(flights)
colnames(flights)
head(flights)

#the summarize command reduces grouped data to a single row.
summarize(flights, avgdelay=mean(arrdelay))
summarize(flights, avgdelay=max(arrdelay))

链接好数据库,获取数据,然后就可以进行各种数据操作了。

3.再添加几种方式

require(redshift)

conn <- redshift.connect('jdbc:postgresql://jiayundatapro.cls0csjdlwvj.us-west-2.redshift.amazonaws.com:5439/jiayundata', "xxx", "xxxx")

tables <- redshift.tables(conn)

mydata <- dbGetQuery(conn, paste('select * from milin.clicktime'))


连外附上连接mysql的方式

my_db <- src_mysql(dbname = "rmysql",
                   host = localhost,
                   port = 3306,
                   user = "rmysql",
                   password = "rmysql")

你可能感兴趣的:(R语言链接redshift数据库)