Ubuntu Server部署SecCrawler

• 今天看到了新闻推送了一个新闻推送的工具，新出来的，好东西啊。

SecCrawler

直接下载打包好的，不编译了。。
https://github.com/Le0nsec/SecCrawler/releases/download/v2.0/SecCrawler_linux_amd64_v2.0.tar.gz

看到先知社区要selenium，根据此法安装

在Ubuntu server中安装chrome以及chromedriver_yyqq188的博客-CSDN博客_ubuntu 服务器安装chrome

安装完毕后 google-chrome-stable -version 出现数值则安装成功

安装完毕后，生成初始配置文件

./SecCrawler -init

编辑配置文件config.yml，格式一定是yaml格式。
ChromeDriver可以写绝对路径
测试一下

./SecCrawler -test

  _____            _____                    _
 / ____|          / ____|                  | |
| (___   ___  ___| |     _ __ __ ___      _| | ___ _ __
 \___ \ / _ \/ __| |    | '__/ _  \ \ /\ / / |/ _ \ '__|
 ____) |  __/ (__| |____| | | (_| |\ V  V /| |  __/ |
|_____/ \___|\___|\_____|_|  \__,_| \_/\_/ |_|\___|_|                                                                                              
[*] load config success!

[+] register bot: [DingBot]
[+] register crawler: [Anquanke]
[+] register crawler: [EdgeForum]
[+] register crawler: [QiAnXin]
[+] register crawler: [SeebugPaper]
[+] register crawler: [Tttang]
[+] register crawler: [XianZhi]

[♥] crawler start at 2022/02/23 14:55:29 星期三
[*] [EdgeForum] crawler result:
2022/02/23 14:55:30 星期三

Sylas：数据库综合利用工具
https://github.com/Ryze-T/Sylas

V8 沙箱绕过
https://tttang.com/archive/1443/

最近的 Coinbase 漏洞赏金奖
https://blog.coinbase.com/retrospective-recent-coinbase-bug-bounty-award-9f127e04f060

TQLCTF V&N战队 WriteUp
https://www.cnblogs.com/yesec/p/15921349.html

影子凭据（译文）
https://tttang.com/archive/1440/

[*] send to DingBot: {"errcode":0,"errmsg":"ok"}
[*] [QiAnXin] crawler result:
2022/02/23 14:55:31 星期三

2022/02/23 11:09:10
Bvp47——来自美国国安局方程式组织的顶级后门
https://forum.butian.net/share/1327

[*] send to DingBot: {"errcode":0,"errmsg":"ok"}
[*] [SeebugPaper] crawler result:
2022/02/23 14:55:32 星期三

[!] 2022/02/23 14:55:32 crawl [SeebugPaper] error: no records in the last 24 hours

[*] [Tttang] crawler result:
2022/02/23 14:55:33 星期三

2022/02/23 10:39:00
VNCTF2022公开赛Blockchain-VNloan
https://tttang.com/archive/1445/

[*] send to DingBot: {"errcode":0,"errmsg":"ok"}
[*] [XianZhi] crawler result:
2022/02/23 14:55:35 星期三

2022/02/22 21:40:11
菜鸡一次艰难的审计
https://xz.aliyun.com/t/10871

2022/02/22 21:38:28
内网安全-隧道穿透漫游
https://xz.aliyun.com/t/10867

2022/02/22 21:37:34
某cms复现学习
https://xz.aliyun.com/t/10872

2022/02/22 21:36:52
甲方利用开源工具进行钓鱼演练
https://xz.aliyun.com/t/10878

2022/02/22 21:34:10
大规模缓存投毒总结
https://xz.aliyun.com/t/10848

[*] send to DingBot: {"errcode":0,"errmsg":"ok"}
[*] [Anquanke] crawler result:
2022/02/23 14:55:36 星期三

[!] 2022/02/23 14:55:36 crawl [Anquanke] error: no records in the last 24 hours

期待更多新闻源~