Sed练习笔记

 

笔记内容：
*抽取域
*匹配正则表达式
*比较域
*增加、附加、替换
sed [选项] sed命令 输入文件 （命令要加单引号）
sed [选项] -f sed脚本文件 输入文件    （脚本解释器）

***【参数】***
a、文本定位参数
x 行号    x，y 行号范围
/pattern/ 查询包含pattern的行 /pattern/part/ 查询包含两个关键字的行
pattern/,x 在给定行号上查询pattern
x,/pattern 通过行号和关键字查询匹配行
x,y! 查询不包含行号为x和y的行

b、sed编辑命令
p 打印匹配行 = 显示文件行号
a\ 在定位行号后附加信文本信息    i\ 在定位行号后插入新文本信息
d 删除定位行 c\ 用新文本替换定位文件
s 使用替换模式替换相应关键字 r 从另一个文件中读文本
w 写文本到一个文件  y 传送字符  n 安静模式，只显示修改的

***【编程举例】***
# cat file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

1、p(rint) 显示第二行
# sed '2p' file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

# sed -n '2p' file
It was an evening of splendid music and company.

2、打印范围 1-3
# sed -n '1,3p' file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.

3、打印关键字 Neave
# sed -n '/Neave/p' file
The local nurse Miss P.Neave was in attendance.

4、使用关键字和行号进行查询 The
# sed -n '/The/p' file
The honeysuckle band played all night long for only $90.
The local nurse Miss P.Neave was in attendance.

# sed -n '4,/The/p' file
The local nurse Miss P.Neave was in attendance.

5、匹配元字符$    （必须使用\屏蔽特殊含义）
# sed -n '/\$/p' file
The honeysuckle band played all night long for only $90.

6、显示整个文件
# sed -n '1,$p' file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

7、任意以ing结尾的  后跟任意字母0次或多次，以ing结尾，模式为/.*ing/
# sed -n '/.*ing/p' file
It was an evening of splendid music and company.

8、打印行首、打印最后一行
# sed -n '1p' file
The honeysuckle band played all night long for only $90.
# sed -n '$p' file
The local nurse Miss P.Neave was in attendance.

9、打印行号  （使用=号，格式为/pattern/=）
# sed -n '/music/=' file
2
# sed -e '/music/=' file
The honeysuckle band played all night long for only $90.
2
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
如果只关心行号及匹配行，则使用：
# sed -n -e '/music/p' -e '/music/=' file
It was an evening of splendid music and company.
2

10、附加文本，使用 a\ ，可以将指定文本一行或多行附加到指定行。’\’表示换行
举例：创建脚本append.sed
# vim append.sed
#!/bin/sed -f
/company/ a\
Then suddenly it happened.
# chmod +x append.sed
# ./append.sed file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Then suddenly it happened.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

11、插入文本，类似于附加文本，只是它在行前面插入
举例：创建脚本insert.sed
# vim insert.sed
#!/bin/sed -f
/attendance/ i\
Utter confusion followed.
# chmod +x insert.sed
#./insert.sed file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
Utter confusion followed.
The local nurse Miss P.Neave was in attendance.

12、修改文本，修改命令将用新文本替代关键字所在行的文本
举例：创建脚本change.sed
# vim change.sed
#!/bin/sed -f
/honeysuckle/ c\
The Office Dibble band played well.
# chmod +x change.sed
#./change.sed file
The Office Dibble band played well.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

也可以使用行号来替换：
#!/bin/sed -f
3 c\
The Office Dibble band played well.

13、混合附加、插入、修改文本的脚本例子
# vim mix.sed
#!/bin/sed -f
#This is the change on line 1
1 c\
The Dibble band were grooving.
#Then insert a line
/evening/ i\
They played some great tunes.
#change the last line, a $ means lasr line
$ c\
Nurse Neave was too tipsy to help
#stick in a new line before the last line
3 a\
Where was the nurse to help?
# chmod +x mix.sed
# ./mix.sed file
The Dibble band were grooving.
They played some great tunes.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
Where was the nurse to help?
Nurse Neave was too tipsy to help

14、删除文本，可以是行号，行范围，最后一行，正则表达式匹配删除等
# sed '1d' file
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
# sed '1,3d' file
The local nurse Miss P.Neave was in attendance.
# sed '$d' file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
# sed '/Neave/d' file
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.

15、替换文本，格式为[a,b]s/pre/post/[g p w n]
s 是一个替换操作，查询pre，替换为post
g 默认情况下只替换第一次匹配到的关键字，g为全局替换
p 默认sed将所有被替换的行都显示出来，加p选项则-n无效。
w 文件名，此选项将发生改变的行写入到另一个文件中
n 不打印输出结果
举例：
# sed 's/night/NIGHT/' file
The honeysuckle band played all NIGHT long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
# sed 's/The/Wow!/g' file
Wow! honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
Wow! local nurse Miss P.Neave was in attendance.
# sed 's/splendid/SPLENDID/w sed.out' file （文件名在引号里边）
The honeysuckle band played all night long for only $90.
It was an evening of SPLENDID music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
# cat sed.out
It was an evening of SPLENDID music and company.

***【使用替换修改字符串】***
要附加或修改一个字符传，可以使用&命令。&在查找出来的关键字前面加上自己的字符串
格式为： s/nurse/"Hello"&/p
举例：
# sed -n 's/nurse/"Hello" &/p' file
The local "Hello" nurse Miss P.Neave was in attendance.

***【将sed结果写入另一个文件】***
格式： [2,n] w filename
举例：
# sed '1,2 w filedt' file （将1，2行输出到文件filedt中）
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
# cat filedt
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
# sed '/Neave/ w dht' file （将关键字Neave所在行写入到文件dht中）
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.
# cat dht
The local nurse Miss P.Neave was in attendance.

***【从文件中读文本】***
sed允许从另一个文件中读文本，并将其文本附加在当前文件，此命令放在匹配行后面
举例：
# echo "Boom boom went to the music." > sedex.txt
# sed '/company/r sedex.txt' file （将文件sedex.txt的内容加到company行后）
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.
Boom boom went to the music.
Too bad the disco floor fell through at 23:10.
The local nurse Miss P.Neave was in attendance.

***【匹配后退出】***
举例：查询/.a.*/，
# sed '/a/q' file （在第一行就查到了a关键字，退出）
The honeysuckle band played all night long for only $90.
# sed '/m/q' file (在第二行查询到m关键字，退出)
The honeysuckle band played all night long for only $90.
It was an evening of splendid music and company.

***【处理字符实例--处理控制字符】***
# vim dos.txt
12332##DISO##45.12^M
00332##LPSO##23.11^M
01299###USPD###34.46^M
a、用一个空格替换掉##
b、删除起始域中最前面的0
c、删除行尾控制字符
# sed 's/##*/ /g' dos.txt （替换##为空格）
12332 DISO 45.12^M
00332 LPSO 23.11^M
01299 USPD 34.46^M
# sed 's/^0*//g' dos.txt  （将0替换掉）
12332##DISO##45.12^M
332##LPSO##23.11^M
1299###USPD###34.46^M
# sed 's/\^M//g' dos.txt  （将^M替换掉）
12332##DISO##45.12
00332##LPSO##23.11
01299###USPD###34.46

***【处理字符实例--处理报文输出】***
# vim sql.txt
Database        Size(MB)        Date Created
--------------------------------------------
GOSOUTH         2244            12/11/97
TRISUD          5632            8/9/99
(2 rows affected)

处理数据使得到下面的数据：
GOSOUTH
TRISUD

解决思路：
a、使用s/-*//g 删除横线------
b、使用/^$/d 删除空行
c、使用$d 删除最后一行
d、使用1d删除第一行
e、使用awk{print $1}打印第一行

# cat sql.txt | sed 's/-*//g' | sed '/^$/d' | sed '1d' | sed '$d' | awk '{print $1}'
GOSOUTH
TRISUD

***【处理字符实例--去除行首数字】***
# vim UNH.txt
12345UND  SPLLFC  234344
9999999UND  SKKLT  3423
1UND  SPLLY  434

# sed 's/^[0-9]*//g' UNH.txt
UND  SPLLFC  234344
UND  SKKLT  3423
UND  SPLLY  434

***【处理字符实例--附加文本Passed】***
# vim ok.txt
AC456
AC492169
AC9967
AC88345
# sed 's/[0-9][0-9]*/& Passed/g' ok.txt （&与Passed的位置关系决定了Passed的放在前还是后，这里是放在后面）
AC456 Passed
AC492169 Passed
AC9967 Passed
AC88345 Passed

***【处理字符实例--从shell向sed传值及从sed输出中设置shell变量】***
# name="It's a go situation"
# replace=nice
# echo $name |sed "s/go/$replace/g" （注意双引号）
It's a nice situation

# new_name=`echo $name |sed "s/go/$replace/g"`
# echo $new_name
It's a nice situation

***【快速一行命令集】***
's/\.$//g'  删除句尾的点
'-e /abcd/d'    删除包含abcd的行
's/  */ /g'     删除一个以上的空格，用一个空格代替
's/^  *//g' 删除行首空格
's/\.  */ /g'   删除句点后跟两个或更多的空格，用一个空格代替
's/^$/d'    删除空行
's/^.//g'   删除行首字符
's/COL\(...\)//g'   删除紧跟COL后的三个字母
's/^\///g'  删除全文的/
's/^\///'   删除全文每一行出现的第一个/
's/ / //g'
实例：
1、删除路径名第一个/符号
# echo $PWD | sed 's/^\///'
root/Desktop

2、追加/插入文本
# echo "Mr Willis" | sed 's/Mr/& Bruce/g'
Mr Bruce Willis

3、删除首字符
# echo "accounts.doc" |sed 's/^.//'
ccounts.doc

4、删除文件扩展名
# echo "accounts.doc" |sed 's/\..*//g'
accounts

5、增加文件扩展名
# echo accounts | sed 's/$/&.doc/'
accounts.doc

6、替换字符系列（+变为of，%换为located）
# x="Department+payroll%Building G"
# echo $x |sed 's/+/ of /g' |sed 's/%/ located /g'
Department of payroll located Building G
（RHEL6成功  +和%不算是特殊字符吗？）

2012-3-21练习笔记