娱乐头条-03spider

娱乐头条-03spider_第1张图片

1.确定首页的URL

娱乐头条-03spider_第2张图片

访问这个URL

https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page=1&expIds=20200106A0JR02|20200106A0JQFA|20200106A0JFB9|20200106A0DWAP|20200106A0JGBR|20200106A0JHTK|20200106A0JI0G|20200106A0JIH6|20200106A0JJ9Z|20200106A0JLXW|20200106A0JNFB|20200106A00XQL|20200106A0JVJ3|20200106A0JVL5|20200106A0K03B|20200106A0JN2R|20200106A0JQOE|20200106A0JSOC|20200106A0JSYG|20200106A0JY8S&callback=__jp6

娱乐头条-03spider_第3张图片

简化URL(page和callback之间的都删除),再次访问

https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page=1&callback=__jp6

娱乐头条-03spider_第4张图片这个url就是我们要确定的url

2.发送请求获取参数

先添加依赖

        
            org.apache.httpcomponents
            httpclient
            4.5.6
        
    public void main() throws Exception{
        //1.确定url
        String indexUrl = "https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page=1&callback=__jp6";

        //2.发送请求,获取数据
        //创建HttpClients对象
        CloseableHttpClient httpClient = HttpClients.createDefault();
        //创建请求方式对象
        HttpGet get = new HttpGet(indexUrl);
        //执行请求操作
        CloseableHttpResponse response = httpClient.execute(get);

        if(response.getStatusLine().getStatusCode() == 200){
            HttpEntity entity = response.getEntity();
            String res = EntityUtils.toString(entity);
            System.out.println(res);
        }
    }

娱乐头条-03spider_第5张图片

3.解析数据的思路

什么是跨域?

       简单的来说,出于安全方面的考虑,页面中的JS无法访问其他服务器上的数据,即“同源策略”。而跨域就是通过某些手段来绕过同源策略限制,实现不同服务器之间通信的效果。

什么是JSONP?

       在同源策略下,在某个服务器下的页面是无法获取到该服务器以外的数据的,但img\iframe\script等标签是个例外,这些标签可以通过src属性请求到其他服务器上的数据。利用script标签的开放策略,我们可以实现跨域请求数据,当然,也需要服务端的配合。当我们正常的请求一个json数据的时候,服务端返回的是一串json类型的数据,而我们使用jsonp模式来请求数据的时候,服务端返回的是一段可执行的js代码。

举个例子,假如需要从服务器(url)获取的数据如下:

    {"id":123,"name":张三,"age":12}

那么,使用json方式请求(url?callback=foo)的数据将会是如下:

     foo({"id":123,"name":张三,"age":12})

思路:去头尾   将剩下的json格式的字符串转换成一个java对象(看简化的url最后callback)

娱乐头条-03spider_第6张图片      

4.解析数据的实现

添加依赖

        
            com.alibaba
            fastjson
            1.2.47
        
    public void main() throws Exception{
        //1.确定url
        String indexUrl = "https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page=1&callback=__jp6";

        //2.发送请求,获取数据
        //创建HttpClients对象
        CloseableHttpClient httpClient = HttpClients.createDefault();
        //创建请求方式对象
        HttpGet get = new HttpGet(indexUrl);
        //执行请求操作
        CloseableHttpResponse response = httpClient.execute(get);

        if(response.getStatusLine().getStatusCode() == 200){
            HttpEntity entity = response.getEntity();
            String res = EntityUtils.toString(entity);
            res = toJsonString(res);//截取字符串
            //System.out.println(res);
            Map map = jsonToMap(res);//转为map对象
        }
    }

    //截取结果字符串
    public String toJsonString(String src){
        int start = src.indexOf("{");
        int end = src.lastIndexOf("}")+1;
        return src.substring(start,end);
    }

    //json字符串转换为java对象
    public Map jsonToMap(String src){
        return JSON.parseObject(src, HashMap.class);
    }

得到的res

{"code":0,"msg":"","data":[{"app_id":"20200106A0O59K00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144808337_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643559759","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0O59K","img":"https://inews.gtimg.com/newsapp_ls/0/11144808337_640330/0","img_count":28,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144808337_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144808337_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144779611_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144808337_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144808337_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144808337_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144808337_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144808337_870492/0"},"intro":"1月6日,阅文风云盛典在上海开启录制,很多知名演员来到现场助阵,除此之外也有不少备受大家期待的当红编剧和作家到场,而他们在红毯上的动向也是最让人关注的。关晓彤以一袭白色水晶裙登场,裙摆与长发间都有闪……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144808337_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144808337_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144808338_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144808339_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144779611_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144784672_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144779608_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144808337_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144808338_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144808339_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144808337_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144808337_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144808337_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144808337_870492/0"]},"keywords":"关晓彤;阅文;肖战","media_icon":"https://inews.gtimg.com/newsapp_ls/0/5489913596_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144778372/641","https://inews.gtimg.com/newsapp_bt/0/11144778373/641","https://inews.gtimg.com/newsapp_bt/0/11144778374/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:11:11","report":"{\"ext\": \"44+0\"+ \"all\": \";;;72+7\"+ \"3h\": \"5590530+383246;2778593+201973;ent:1204926+93453#tv:0+0;72+7;6409+453\"+ \"app\": \";;;15916+552;;0;0;0;25081;45.43659;0.03468;1.57584\"+ \"day\": \"33013074+2591064;16178876+1361251;ent:6489037+524317#tv:0+0;72+7;70533+5385\"}","s_group":2,"showtype":"article","source":"萌神木木","source_fans":0,"source_id":"5113868","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0O59K00","tag_label":[["关晓彤","80996"],["阅文","271346"],["肖战","237936"]],"tags":"关晓彤;阅文;肖战","title":"阅文盛典红毯高清图:关晓彤水晶裙闪亮登场,肖战化身暗黑系王子","title_len":29.11111,"ts":1578309071,"update_time":"2020-01-06 19:11:11","url":"https://xw.qq.com/cmsid/20200106A0O59K00","view_count":44,"vurl":"https://new.qq.com/omn/20200106/20200106A0O59K00.html"},{"app_id":"20200106A0MGE700","article_type":1,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144839145_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"欧美娱乐","category2_id":"110","category_chn":"娱乐","category_id":"1","comment_id":"4643310119","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0MGE7","img":"https://inews.gtimg.com/newsapp_ls/0/11144839145_640330/0","img_count":9,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144839145_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144839145_295195/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144839145_400320/0","485X350":"https://inews.gtimg.com/newsapp_ls/0/11144834692_485350/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144839145_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144839145_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144839145_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144839145_870492/0"},"intro":"当地时间2020年1月5日,第77届金球奖颁奖典礼在美国洛杉矶举办,男明星们纷纷穿西装出席格外干练端庄,而红毯作为女明星的第一“战场”,必然少不了一番争奇斗艳。相差17岁的好莱坞两大女神妮可·基德曼……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144839145_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144839145_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144839146_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144839147_295195/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144839145_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144839146_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144839147_400320/0"],"485X350":["https://inews.gtimg.com/newsapp_ls/0/11144834692_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144834693_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144834694_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144834695_485350/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144839145_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144839145_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144839145_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144839145_870492/0"]},"keywords":"斯嘉丽·约翰逊;妮可·基德曼","media_icon":"https://inews.gtimg.com/newsapp_ls/0/2819348763_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144387937/641","https://inews.gtimg.com/newsapp_bt/0/11144387948/641","https://inews.gtimg.com/newsapp_bt/0/11144387938/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:15:00","report":"{\"ext\":\"0+0\"+\"all\":\";;;0+0\"+\"3h\":\"5412073+383246;210815+11604;ent:1204926+93453#movie:13109+450;0+0;130+9\"+\"app\":\";;;1+0;;0;0;0;0;0.0;0.0;0.0\"+\"day\":\"32834617+2591064;2654316+137853;ent:6489037+524317#movie:69552+2394;0+0;488+40\"}","s_group":2,"showtype":"picture","source":"站酷海洛娱乐","source_fans":0,"source_id":"6667303","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0MGE700","tag_label":[["斯嘉丽·约翰逊","323309"],["妮可·基德曼","305841"]],"tags":"斯嘉丽·约翰逊;妮可·基德曼","title":"53岁妮可·基德曼和斯嘉丽穿红裙同框 身高相差20cm输赢一目了然","title_len":29.444445,"ts":1578309300,"update_time":"2020-01-06 19:15:00","url":"https://xw.qq.com/cmsid/20200106A0MGE700","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0MGE700.html"},{"app_id":"20200106A0OBSQ00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144850738_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643589964","comment_num":5,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":1,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OBSQ","img":"https://inews.gtimg.com/newsapp_ls/0/11144850738_640330/0","img_count":8,"img_type":1,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144850738_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144845355_294195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144845355_354264/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144850738_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144850738_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144850738_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144850738_870492/0"},"intro":"序言:2020年1月6日,有八卦媒体曝光疑似马蓉的动态。马蓉疑似与一个中年男子一同现身,该男子身穿蓝色西装,看到镜头还特地护住女方。随后,两人挽手同回酒店,看起来关系亲密。有媒体就此向马蓉方求证,马……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144850738_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144845355_294195/0","https://inews.gtimg.com/newsapp_ls/0/11144845373_294195/0","https://inews.gtimg.com/newsapp_ls/0/11144845366_294195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144845355_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144845373_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144845366_354264/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144850738_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144850738_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144850738_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144850738_870492/0"]},"keywords":"马蓉;王宝强","media_icon":"https://inews.gtimg.com/newsapp_ls/0/8279574616_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144843000/641","https://inews.gtimg.com/newsapp_bt/0/11144843001/641","https://inews.gtimg.com/newsapp_bt/0/11144843002/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:18:32","report":"{\"ext\":\"2+5\"+\"all\":\";;;675+12\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453;675+12;27039+1219\"+\"app\":\";;;0+0;;0;0;0;0;0;0;0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317;675+12;247746+19247\"}","s_group":2,"showtype":"article","source":"今日影视头条","source_fans":0,"source_id":"5174463","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OBSQ00","tag_label":[["马蓉","84720"],["王宝强","87921"]],"tags":"马蓉;王宝强","title":"马蓉方否认恋情,因为和王宝强的财产分割还没完成,不想谈恋爱","title_len":28.11111,"ts":1578309512,"update_time":"2020-01-06 19:18:32","url":"https://xw.qq.com/cmsid/20200106A0OBSQ00","view_count":2,"vurl":"https://new.qq.com/omn/20200106/20200106A0OBSQ00.html"},{"app_id":"20200106A0OC0A00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144854265_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643591511","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OC0A","img":"https://inews.gtimg.com/newsapp_ls/0/11144854265_640330/0","img_count":4,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144854265_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144854265_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144849137_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144854265_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144854265_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144854265_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144854265_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144854265_870492/0"},"intro":"1月4日,陈翔30岁生日会在成都如期举办,近600名香橙从全国各地赶来,和自己喜欢了9年的男孩一起相聚庆祝。陈翔为粉丝们演唱了多首歌曲,还现场弹唱了自己未发布的新歌《有时》,作为礼物送给粉丝。1月的……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144854265_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144854265_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144854266_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144854267_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144849137_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144849120_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144849142_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144854265_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144854266_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144854267_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144854265_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144854265_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144854265_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144854265_870492/0"]},"keywords":"陈翔","media_icon":"https://inews.gtimg.com/newsapp_ls/0/4703990059_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144848249/641","https://inews.gtimg.com/newsapp_bt/0/11144848250/641","https://inews.gtimg.com/newsapp_bt/0/11144848252/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:18:55","report":"{\"ext\":\"0+0\"+\"all\":\";;;10+0\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453;10+0;30080+2489\"+\"app\":\";;;0+0;;0;0;0;0;0;0;0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317;10+0;36734+2920\"}","s_group":2,"showtype":"article","source":"秃顶少女裘千尺","source_fans":0,"source_id":"9087387","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OC0A00","tag_label":[["陈翔","102233"]],"tags":"陈翔;往后余生","title":"陈翔三十岁生日会感恩粉丝 而立之年人生开启新篇章","title_len":23.555555,"ts":1578309535,"update_time":"2020-01-06 19:18:55","url":"https://xw.qq.com/cmsid/20200106A0OC0A00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OC0A00.html"},{"app_id":"20200106A0OHSH00","article_type":1,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144907042_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643621546","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OHSH","img":"https://inews.gtimg.com/newsapp_ls/0/11144907042_640330/0","img_count":5,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144907042_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144907042_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144832811_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144907042_400320/0","485X350":"https://inews.gtimg.com/newsapp_ls/0/11144906690_485350/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144907042_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144907042_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144907042_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144907042_870492/0"},"intro":"1月5日晚上于正突然发文称要写一个剧本,而剧本里的故事是真实改编。他在文中描绘了故事细节,引发网友对故事主人公的热议,大家纷纷猜测他暗指的人是赵丽颖陈晓,1月6日于正连发两条微博解释此事,但评论区却……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144907042_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144907042_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144907043_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144907044_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144832811_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144832806_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144832808_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144907042_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144907043_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144907044_400320/0"],"485X350":["https://inews.gtimg.com/newsapp_ls/0/11144906690_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144906691_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144906692_485350/0","https://inews.gtimg.com/newsapp_ls/0/11144906693_485350/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144907042_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144907042_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144907042_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144907042_870492/0"]},"keywords":"赵丽颖;于正","media_icon":"https://inews.gtimg.com/newsapp_ls/0/2661393194_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144828504/641","https://inews.gtimg.com/newsapp_bt/0/11144828510/641","https://inews.gtimg.com/newsapp_bt/0/11144828536/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:28:15","report":"{\"ext\":\"0+0\"+\"all\":\";;;564+27\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453;564+27;10582+591\"+\"app\":\";;;0+0;;0;0;0;0;0;0;0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317;564+27;108917+7407\"}","s_group":2,"showtype":"picture","source":"烫手煽娱","source_fans":0,"source_id":"5084737","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OHSH00","tag_label":[["赵丽颖","81790"],["于正","256172"]],"tags":"赵丽颖;于正","title":"赵丽颖新造型太迷人!扎高马尾配抹胸纱裙,变俏皮小公主","title_len":25.11111,"ts":1578310095,"update_time":"2020-01-06 19:28:15","url":"https://xw.qq.com/cmsid/20200106A0OHSH00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OHSH00.html"},{"app_id":"20200106A0OM1C00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11145006936_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643648536","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OM1C","img":"https://inews.gtimg.com/newsapp_ls/0/11145006936_640330/0","img_count":48,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11145006936_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11145006936_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144924399_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11145006936_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11145006936_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11145006936_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11145006936_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11145006936_870492/0"},"intro":"1月6日,精品风格盛典在北京举办,是近期范冰冰又一次“公益”加身出席的活动,虽然错过了年底时尚典礼大潮,但在开年来一波红毯也是不错的,只是灯光太暗,没了打光加持,明星脸色发黄,被强行黑脸,显出老态。……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11145006936_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11145006936_295195/0","https://inews.gtimg.com/newsapp_ls/0/11145006937_295195/0","https://inews.gtimg.com/newsapp_ls/0/11145006938_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144924399_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144924878_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144925266_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11145006936_400320/0","https://inews.gtimg.com/newsapp_ls/0/11145006937_400320/0","https://inews.gtimg.com/newsapp_ls/0/11145006938_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11145006936_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11145006936_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11145006936_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11145006936_870492/0"]},"keywords":"袁姗姗;王子文;范冰冰","media_icon":"https://inews.gtimg.com/newsapp_ls/0/490544980_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144918661/641","https://inews.gtimg.com/newsapp_bt/0/11144918662/641","https://inews.gtimg.com/newsapp_bt/0/11144918664/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:32:25","report":"{\"ext\":\"0+0\"+\"all\":\";;;11+0\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453#movie:13109+450;11+0;103+7\"+\"app\":\";;;1+0;;0;0;0;0;0.0;0.0;0.0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317#movie:69552+2394;11+0;1871+69\"}","s_group":2,"showtype":"article","source":"番茄娱评","source_fans":0,"source_id":"5267320","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OM1C00","tag_label":[["袁姗姗","84096"],["王子文","206999"],["范冰冰","82177"]],"tags":"袁姗姗;王子文;范冰冰","title":"精品风格盛典红毯直击:袁姗姗大秀好身材,王子文肉色打底衣抢镜","title_len":29.11111,"ts":1578310345,"update_time":"2020-01-06 19:32:25","url":"https://xw.qq.com/cmsid/20200106A0OM1C00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OM1C00.html"},{"app_id":"20200106A0OLMF00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144937966_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"港台娱乐","category2_id":"108","category_chn":"娱乐","category_id":"1","comment_id":"4643645783","comment_num":1,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OLMF","img":"https://inews.gtimg.com/newsapp_ls/0/11144937966_640330/0","img_count":9,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144937966_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144937966_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144923962_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144937966_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144937966_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144937966_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144937966_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144937966_870492/0"},"intro":"本文由娱乐八卦情报局原创,未经允许任何商业不得转载1月6日,梁咏琪在ins晒出了一条动态,配文:“每年西班牙人最期待的节日三王节又来了,这个三王节面包好紧要,家乡的味道年年都令家中的西班牙先生感动得……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144937966_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144937966_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144937967_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144937969_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144923962_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144924414_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144923380_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144937966_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144937967_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144937969_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144937966_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144937966_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144937966_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144937966_870492/0"]},"keywords":"梁咏琪;索菲亚;Sergio","media_icon":"https://inews.gtimg.com/newsapp_ls/0/779341756_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144922354/641","https://inews.gtimg.com/newsapp_bt/0/11144922356/641","https://inews.gtimg.com/newsapp_bt/0/11144922358/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:33:08","report":"{\"ext\":\"0+1\"+\"all\":\";;;8+0\"+\"3h\":\"5412073+383246;1503128+95818;ent:1204926+93453;8+0;35897+2828\"+\"app\":\";;;32+1;;0;0;0;1;1.0;0.03125;0.03125\"+\"day\":\"32834617+2591064;8049774+621320;ent:6489037+524317;8+0;110209+11787\"}","s_group":2,"showtype":"article","source":"娱乐八卦情报局","source_fans":0,"source_id":"5363789","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OLMF00","tag_label":[["梁咏琪","100476"],["索菲亚","129218"],["SERGIO","1875389"]],"tags":"梁咏琪;索菲亚;sergio","title":"梁咏琪一家三口过节,手把手教女儿做蛋糕,4岁索菲亚越长越漂亮","title_len":28.666666,"ts":1578310388,"update_time":"2020-01-06 19:33:08","url":"https://xw.qq.com/cmsid/20200106A0OLMF00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OLMF00.html"},{"app_id":"20200106A0OQLQ00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144969549_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"电影","category2_id":"101","category_chn":"娱乐","category_id":"1","comment_id":"4643675298","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":4,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OQLQ","img":"https://inews.gtimg.com/newsapp_ls/0/11144969549_640330/0","img_count":5,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144969549_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144969549_295195/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144969549_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144969549_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144969549_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144969549_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144969549_870492/0"},"intro":"今天在金球奖上获得最佳剧情电影的一战题材影片《1917》,采用了“一镜到底”的方式拍摄,“这部电影的设计初衷就是一个镜头”。门德斯称,这部电影是他迄今为止完成的“技术上最困难的事情”,但也是最令人愉……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144969549_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144969549_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144969552_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144969553_295195/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144969549_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144969552_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144969553_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144969549_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144969549_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144969549_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144969549_870492/0"]},"keywords":"罗杰·迪金斯","media_icon":"https://inews.gtimg.com/newsapp_ls/0/dbg_2144844_100100/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/10484252062/641","https://inews.gtimg.com/newsapp_bt/0/10484252065/641","https://inews.gtimg.com/newsapp_bt/0/10484252063/641"],"news_level":4,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:38:04","report":"{\"ext\":\"0+0\"+\"all\":\";;;79+0\"+\"3h\":\"5412073+383246;122297+7408;ent:1204926+93453#movie:13109+450;79+0;112084+5734\"+\"app\":\";;;66+1;;0;0;0;73;73.0;0.01515;1.10606\"+\"day\":\"32834617+2591064;861498+61555;ent:6489037+524317#movie:69552+2394;79+0;445416+18276\"}","s_group":2,"showtype":"article","source":"新京报","source_fans":0,"source_id":"26134","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OQLQ00","tag_label":[["罗杰·迪金斯","325036"]],"tags":"罗杰·迪金斯","title":"一镜到底的电影到底有多难拍?","title_len":13.555555,"ts":1578310684,"update_time":"2020-01-06 19:38:04","url":"https://xw.qq.com/cmsid/20200106A0OQLQ00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OQLQ00.html"},{"app_id":"20200106A0OUQV00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11145000897_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643702883","comment_num":1,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OUQV","img":"https://inews.gtimg.com/newsapp_ls/0/11145000897_640330/0","img_count":9,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11145000897_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11145000897_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144876727_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11145000897_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11145000897_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11145000897_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11145000897_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11145000897_870492/0"},"intro":"陆毅和鲍蕾也是娱乐圈比较低调恩爱的夫妻了,出道多年的陆毅一直兢兢业业演戏,也奉献了许多经典角色,而作为妻子的鲍蕾更是为了家庭退出娱乐圈,当起了全职太太。如今陆毅一家四口过得幸福圆满,两个女儿也是又高……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11145000897_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11145000897_295195/0","https://inews.gtimg.com/newsapp_ls/0/11145000899_295195/0","https://inews.gtimg.com/newsapp_ls/0/11145000900_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144876727_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144891556_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144992823_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11145000897_400320/0","https://inews.gtimg.com/newsapp_ls/0/11145000899_400320/0","https://inews.gtimg.com/newsapp_ls/0/11145000900_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11145000897_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11145000897_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11145000897_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11145000897_870492/0"]},"keywords":"陆毅;颜值;鲍蕾","media_icon":"https://inews.gtimg.com/newsapp_ls/0/2797024383_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144862269/641","https://inews.gtimg.com/newsapp_bt/0/11144862270/641","https://inews.gtimg.com/newsapp_bt/0/11144862271/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:43:34","report":"{\"ext\":\"0+1\"+\"all\":\";;;82+5\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453;82+5;5160+369\"+\"app\":\";;;0+0;;0;0;0;0;0;0;0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317;82+5;31819+2786\"}","s_group":2,"showtype":"article","source":"里尚七七","source_fans":0,"source_id":"6617504","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OUQV00","tag_label":[["陆毅","92921"],["颜值","84416"],["鲍蕾","105841"]],"tags":"陆毅;颜值;鲍蕾","title":"陆毅瘦身成功颜值回春!换新发型像90后,携妻女庆生太抢眼","title_len":26.222221,"ts":1578311014,"update_time":"2020-01-06 19:43:34","url":"https://xw.qq.com/cmsid/20200106A0OUQV00","view_count":0,"vurl":"https://new.qq.com/omn/20200106/20200106A0OUQV00.html"},{"app_id":"20200106A0EMWQ00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11142800365_640330/0","category":"ent","category1_chn":"社会","category1_id":"37","category2_chn":"刑事犯罪","category2_id":"3708","category_chn":"社会","category_id":"37","comment_id":"4642403058","comment_num":203,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":1,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0EMWQ","img":"https://inews.gtimg.com/newsapp_ls/0/11142800365_640330/0","img_count":10,"img_type":1,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11142800365_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11142800365_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11142784562_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11142800365_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11142800365_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11142800365_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11142800365_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11142800365_870492/0"},"intro":"1月5日,明道哥哥林明弘勒死妻儿后上吊自杀,轰动两岸娱乐圈。据6日下午最新报道,林明弘死亡时间大约在4日下午至5日凌晨,初步排除另有凶嫌涉案,林明弘一家三口遗体已转移至台北第一殡仪馆,家属于6日上午……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11142800365_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11142800365_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142800366_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142800367_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11142784562_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142786024_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142783259_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11142800365_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142800366_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142800367_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11142800365_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11142800365_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11142800365_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11142800365_870492/0"]},"keywords":"林明弘;明道","media_icon":"https://inews.gtimg.com/newsapp_ls/0/1309942018_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11140620033/641","https://inews.gtimg.com/newsapp_bt/0/11142762318/641","https://inews.gtimg.com/newsapp_bt/0/11142762319/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 17:38:42","report":"{\"ext\": \"35803+203\"+ \"all\": \";;;121544+13846\"+ \"3h\": \"2152354+127982;753314+45979;ent:1204926+93453;61730+8308;137806+10946\"+ \"app\": \";;;424548+129257;;74;0;127;13176579;101.94093;0.30446;31.03672\"+ \"day\": \"12642939+870589;3460900+258283;ent:6489037+524317;121544+13846;760733+68473\"}","s_group":2,"showtype":"article","source":"开开森森","source_fans":0,"source_id":"5520031","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0EMWQ00","tag_label":[["林明弘","4844306"],["明道","97581"]],"tags":"林明弘;明道","title":"明道哥哥一家三口遗体于8日解剖,家属取消招魂仪式疑等明道回台处理","title_len":31.11111,"ts":1578303522,"update_time":"2020-01-06 17:38:42","url":"https://xw.qq.com/cmsid/20200106A0EMWQ00","view_count":35803,"vurl":"https://new.qq.com/omn/20200106/20200106A0EMWQ00.html"},{"app_id":"20200106A0EQUS00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11142925339_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4642415416","comment_num":10,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0EQUS","img":"https://inews.gtimg.com/newsapp_ls/0/11142925339_640330/0","img_count":66,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11142925339_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11142925339_295195/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11142925339_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11142925339_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11142925339_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11142925339_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11142925339_870492/0"},"intro":"靳东的新剧《精英律师》看了吗?真的,靳东还是比较适合这种职场精英剧,去“油”效果显著。蓝盈莹是女主角。但整部剧话题度最高的不是她,而是靳东的秘书栗娜——朱珠。女N号栗娜,是网友投出来的“最希望和男主……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11142925339_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11142925339_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142925340_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142925342_295195/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11142925339_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142925340_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142925342_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11142925339_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11142925339_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11142925339_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11142925339_870492/0"]},"keywords":"朱珠;刘亦菲;靳东;陈楚河;蓝盈莹","media_icon":"https://inews.gtimg.com/newsapp_ls/0/10917705904_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/10877571433/641","https://inews.gtimg.com/newsapp_bt/0/11142787683/641","https://inews.gtimg.com/newsapp_bt/0/11142787684/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 14:50:42","report":"{\"ext\":\"36743+10\"+\"all\":\";;;32936+1941\"+\"3h\":\"5412073+383246;2683251+201973;ent:1161432+90205#movie:13109+447#tv:0+0;21306+1270;21597+1301\"+\"app\":\";;;13635+1744;;0;0;3;250637;143.71388;0.12791;18.38188\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6445543+521069#movie:69552+2391#tv:0+0;32936+1941;34730+2048\"}","s_group":2,"showtype":"article","source":"GirlDaily","source_fans":0,"source_id":"15862231","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0EQUS00","tag_label":[["朱珠","223841"],["刘亦菲","84098"],["靳东","81225"]],"tags":"朱珠;刘亦菲;靳东;陈楚河;蓝盈莹","title":"艳压刘亦菲,甩豪门二代被骂“花瓶”,网友:我就是馋她身子","title_len":25.777779,"ts":1578293442,"update_time":"2020-01-06 14:50:42","url":"https://xw.qq.com/cmsid/20200106A0EQUS00","view_count":36743,"vurl":"https://new.qq.com/omn/20200106/20200106A0EQUS00.html"},{"app_id":"20200106A0EUY500","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11142859889_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"港台娱乐","category2_id":"108","category_chn":"娱乐","category_id":"1","comment_id":"4642428186","comment_num":127,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0EUY5","img":"https://inews.gtimg.com/newsapp_ls/0/11142859889_640330/0","img_count":8,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11142859889_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11142859889_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11142842311_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11142859889_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11142859889_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11142859889_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11142859889_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11142859889_870492/0"},"intro":"1月6日,林心如和霍建华家的小公主也迎来3岁生日,就在刚刚,身为妈妈的林心如也在个人社交平台晒出女儿生日现场系列照片。对于迎来3岁生日的女儿,林心如也为她开了一个生日party,邀请亲朋好友来参加。……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11142859889_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11142859889_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142859890_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142859891_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11142842311_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142843379_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142844043_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11142859889_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142859890_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142859891_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11142859889_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11142859889_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11142859889_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11142859889_870492/0"]},"keywords":"林心如;霍建华","media_icon":"https://inews.gtimg.com/newsapp_ls/0/2326364468_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11142739724/641","https://inews.gtimg.com/newsapp_bt/0/11142739178/641","https://inews.gtimg.com/newsapp_bt/0/11142739162/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 14:55:44","report":"{\"ext\":\"27363+127\"+\"all\":\";;;84824+6298\"+\"3h\":\"5412073+383246;1503128+95818;ent:1161432+90205;38467+2281;58535+3488\"+\"app\":\";;;1083015+186301;;17;0;123;8234896;44.2021;0.17202;7.60368\"+\"day\":\"32834617+2591064;8049774+621320;ent:6445543+521069;84824+6298;142233+9783\"}","s_group":2,"showtype":"article","source":"八怪娱","source_fans":0,"source_id":"6045349","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0EUY500","tag_label":[["林心如","91824"],["霍建华","255070"]],"tags":"林心如;霍建华","title":"林心如为3岁女儿庆生,小兔主题很温馨,表白女儿:谢谢你完整了我们","title_len":30.222221,"ts":1578293744,"update_time":"2020-01-06 14:55:44","url":"https://xw.qq.com/cmsid/20200106A0EUY500","view_count":27363,"vurl":"https://new.qq.com/omn/20200106/20200106A0EUY500.html"},{"app_id":"20200106A0HCGC00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11143491466_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"港台娱乐","category2_id":"108","category_chn":"娱乐","category_id":"1","comment_id":"4642722924","comment_num":3,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":1,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0HCGC","img":"https://inews.gtimg.com/newsapp_ls/0/11143491466_640330/0","img_count":5,"img_type":1,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11143491466_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11143373110_294195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11143373110_354264/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11143491466_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11143491466_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11143491466_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11143491466_870492/0"},"intro":"向佐和郭碧婷是娱乐圈中一对高颜值夫妇,两人婚后经常会发合影或者是合体录视频向网友撒糖,我们也能看出他们的感情十分稳定,郭碧婷真的是嫁给了幸福。网友在看到她手上夸张的美甲以及脸上的素颜后,也表示那才是……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11143491466_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11143373110_294195/0","https://inews.gtimg.com/newsapp_ls/0/11143371435_294195/0","https://inews.gtimg.com/newsapp_ls/0/11143371393_294195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11143373110_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143371435_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143371393_354264/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11143491466_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11143491466_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11143491466_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11143491466_870492/0"]},"keywords":"郭碧婷;向佐;网红","media_icon":"https://inews.gtimg.com/newsapp_ls/0/4192090520_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11143365385/641","https://inews.gtimg.com/newsapp_bt/0/11143365386/641","https://inews.gtimg.com/newsapp_bt/0/11143365387/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 16:07:01","report":"{\"ext\":\"12263+3\"+\"all\":\";;;31801+1246\"+\"3h\":\"5412073+383246;1503128+95818;ent:1204926+93453;31086+1213;30237+1183\"+\"app\":\";;;1783+155;;0;0;1;3738;24.11613;0.08693;2.09647\"+\"day\":\"32834617+2591064;8049774+621320;ent:6489037+524317;31801+1246;32364+1345\"}","s_group":2,"showtype":"article","source":"娱乐大橘子","source_fans":0,"source_id":"10437746","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0HCGC00","tag_label":[["郭碧婷","104351"],["向佐","239826"],["网红","86231"]],"tags":"郭碧婷;向佐;网红","title":"向佐的网红滤镜有多厉害?看到身边的郭碧婷,网友:差点没认出来","title_len":28.666666,"ts":1578298021,"update_time":"2020-01-06 16:07:01","url":"https://xw.qq.com/cmsid/20200106A0HCGC00","view_count":12263,"vurl":"https://new.qq.com/omn/20200106/20200106A0HCGC00.html"},{"app_id":"20200106A0HQAX00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11143461726_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4642771694","comment_num":0,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0HQAX","img":"https://inews.gtimg.com/newsapp_ls/0/11143461726_640330/0","img_count":8,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11143461726_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11143461726_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11143454175_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11143461726_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11143461726_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11143461726_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11143461726_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11143461726_870492/0"},"intro":"易烊千玺的弟弟长大了,卷发化妆拍戏,网友:又一个大佬预订了!文/娱公易烊千玺出了名以后,把他的弟弟也给带火了。千玺特别宠爱他的弟弟,他经常会在微博上晒他们两个人的合照。易烊千玺刚出道的时候,他的弟弟……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11143461726_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11143461726_295195/0","https://inews.gtimg.com/newsapp_ls/0/11143461727_295195/0","https://inews.gtimg.com/newsapp_ls/0/11143461728_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11143454175_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143454172_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143454174_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11143461726_400320/0","https://inews.gtimg.com/newsapp_ls/0/11143461727_400320/0","https://inews.gtimg.com/newsapp_ls/0/11143461728_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11143461726_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11143461726_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11143461726_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11143461726_870492/0"]},"keywords":"易烊千玺;楠楠","media_icon":"https://inews.gtimg.com/newsapp_ls/0/3061029541_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11143448669/641","https://inews.gtimg.com/newsapp_bt/0/11143448671/641","https://inews.gtimg.com/newsapp_bt/0/11143448672/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 16:17:41","report":"{\"ext\":\"10585+0\"+\"all\":\";;;12388+526\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453#music:2075+53;12355+524;12404+525\"+\"app\":\";;;3928+462;;0;0;0;13591;29.41775;0.11762;3.46003\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317#music:12354+348;12388+526;12459+528\"}","s_group":2,"showtype":"article","source":"影子说","source_fans":0,"source_id":"7787915","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0HQAX00","tag_label":[["易烊千玺","256996"],["楠楠","294493"]],"tags":"易烊千玺;楠楠","title":"易烊千玺的弟弟长大了,卷发化妆拍戏,网友:又一个大佬预订了!","title_len":28.222221,"ts":1578298661,"update_time":"2020-01-06 16:17:41","url":"https://xw.qq.com/cmsid/20200106A0HQAX00","view_count":10585,"vurl":"https://new.qq.com/omn/20200106/20200106A0HQAX00.html"},{"app_id":"20200106A0OGJH00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144888559_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643614839","comment_num":1,"duration":0,"ext":{"tonality_score":2,"news_score":4,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0OGJH","img":"https://inews.gtimg.com/newsapp_ls/0/11144888559_640330/0","img_count":20,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144888559_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144888559_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144855401_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144888559_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144888559_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144888559_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144888559_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144888559_870492/0"},"intro":"2020年1月6日,阅文原创文学风云盛典(简称阅文盛典)在上海举行,当天上海的气温很低,可明星和粉丝们的热情却不减。接下来,小编就来盘点下这次阅文盛典红毯直播上各位明星们的造型与名场面。首先是关晓彤……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144888559_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144888559_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144888562_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144888563_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144855401_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144854293_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144856528_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144888559_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144888562_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144888563_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144888559_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144888559_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144888559_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144888559_870492/0"]},"keywords":"关晓彤;王凯;肖战;阅文","media_icon":"https://inews.gtimg.com/newsapp_ls/0/2813961772_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144844911/641","https://inews.gtimg.com/newsapp_bt/0/11144844912/641","https://inews.gtimg.com/newsapp_bt/0/11144844913/641"],"news_level":4,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:24:41","report":"{\"ext\":\"1+1\"+\"all\":\";;;36+9\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453#tv:0+0;36+9;2773+142\"+\"app\":\";;;0+0;;0;0;0;0;0;0;0\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317#tv:0+0;36+9;45601+1635\"}","s_group":2,"showtype":"article","source":"传媒一班001","source_fans":0,"source_id":"5034188","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0OGJH00","tag_label":[["关晓彤","80996"],["王凯","84773"],["肖战","237936"]],"tags":"关晓彤;王凯;肖战;阅文","title":"阅文红毯名场面:关晓彤穿水晶裙似仙女,肖战显羞涩,王凯压轴","title_len":27.666666,"ts":1578309881,"update_time":"2020-01-06 19:24:41","url":"https://xw.qq.com/cmsid/20200106A0OGJH00","view_count":1,"vurl":"https://new.qq.com/omn/20200106/20200106A0OGJH00.html"},{"app_id":"20200106A0L0D300","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11144939474_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4643133608","comment_num":75,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0L0D3","img":"https://inews.gtimg.com/newsapp_ls/0/11144939474_640330/0","img_count":8,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11144939474_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11144941305_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11144106137_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11144941305_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11144939474_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11144939474_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11144939474_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11144939474_870492/0"},"intro":"爆料图中的女子并非马蓉本人,并表示现在是假期,马蓉和女儿在国外度假中,强调马蓉目前一直是单身状态,还透露与王宝强财产分割后续还没有完全处理完。当年,王宝强马蓉离婚一事闹得沸沸扬扬,虽然大众对她更多的……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11144939474_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11144941305_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144941306_295195/0","https://inews.gtimg.com/newsapp_ls/0/11144941307_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11144106137_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144106099_354264/0","https://inews.gtimg.com/newsapp_ls/0/11144106103_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11144941305_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144941306_400320/0","https://inews.gtimg.com/newsapp_ls/0/11144941307_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11144939474_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11144939474_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11144939474_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11144939474_870492/0"]},"keywords":"马蓉;王宝强;离婚","media_icon":"https://inews.gtimg.com/newsapp_ls/0/6156173885_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11144102270/641","https://inews.gtimg.com/newsapp_bt/0/11144102271/641","https://inews.gtimg.com/newsapp_bt/0/11144102272/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 19:34:47","report":"{\"ext\":\"324+75\"+\"all\":\";;;5851+121\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453;5850+120;6199+141\"+\"app\":\";;;148881+5721;;0;0;72;294455;51.46915;0.03843;1.97779\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317;5851+121;14789+576\"}","s_group":2,"showtype":"article","source":"十口娱乐","source_fans":0,"source_id":"5476343","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0L0D300","tag_label":[["马蓉","84720"],["王宝强","87921"],["离婚","88971"]],"tags":"马蓉;王宝强;离婚","title":"马蓉否认新恋情称目前无暇恋爱,还透露与王宝强财产分割未处理完","title_len":29.555555,"ts":1578310487,"update_time":"2020-01-06 19:34:47","url":"https://xw.qq.com/cmsid/20200106A0L0D300","view_count":324,"vurl":"https://new.qq.com/omn/20200106/20200106A0L0D300.html"},{"app_id":"ENT2020010601465700","article_type":120,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11142592686_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"港台娱乐","category2_id":"108","category_chn":"娱乐","category_id":"1","comment_id":"4642403058","comment_num":203,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":1,"video_count":1},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106014657","img":"https://inews.gtimg.com/newsapp_ls/0/11142592686_640330/0","img_count":3,"img_type":1,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11142592686_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11142800365_295195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11142784562_354264/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11142800365_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11142592686_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11142592686_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11142592686_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11142592686_870492/0"},"intro":"台媒曝明道哥哥被逼债走绝路,生前卖卤肉饭,自杀前一周店铺已不营业","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11142592686_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11142800365_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142800366_295195/0","https://inews.gtimg.com/newsapp_ls/0/11142800367_295195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11142784562_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142786024_354264/0","https://inews.gtimg.com/newsapp_ls/0/11142783259_354264/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11142800365_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142800366_400320/0","https://inews.gtimg.com/newsapp_ls/0/11142800367_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11142592686_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11142592686_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11142592686_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11142592686_870492/0"]},"keywords":"明道","media_icon":"","mini_img":"","multi_imgs":[""],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 20:36:49","report":"{\"ext\": \"21776+203\"+ \"all\": \";;;177341+15152\"+ \"3h\": \"5412073+383246;1503128+95818;ent:1204926+93453#twentyf:0+0;30172+2063;0+0\"+ \"app\": \";;;10569684+1579427;;226;0;0;41504552;26.27823;0.14943;3.92675\"+ \"day\": \"32834617+2591064;8049774+621320;ent:6489037+524317#twentyf:0+0;177341+15152;0+0\"}","s_group":2,"showtype":"zt","source":"腾讯新闻","source_fans":0,"source_id":"news_news_ent","source_logo":"","strategy":2,"surl":"http://view.inews.qq.com/a/ENT202001060146570U","tag_label":[["明道","97581"]],"tags":"明道","title":"台媒曝明道哥哥被逼债走绝路,生前卖卤肉饭,自杀前一周店铺已不营业","title_len":31.11111,"ts":1578314209,"update_time":"2020-01-06 20:36:49","url":"https://xw.qq.com/zt/20200106014657/ENT2020010601465700","view_count":21776,"vurl":"https://new.qq.com/zt/template/?id=ENT2020010601465700"},{"app_id":"20200106A0HDAB00","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11143388568_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"港台娱乐","category2_id":"108","category_chn":"娱乐","category_id":"1","comment_id":"4642725411","comment_num":4,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":1,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0HDAB","img":"https://inews.gtimg.com/newsapp_ls/0/11143388568_640330/0","img_count":7,"img_type":1,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11143388568_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11143368671_294195/0","354X264":"https://inews.gtimg.com/newsapp_ls/0/11143368671_354264/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11143388568_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11143388568_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11143388568_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11143388568_870492/0"},"intro":"据台媒报道,艺人明道的胞兄一家三口于1月5日下午被发现陈尸台北内湖安泰街福德宫后山区树林里,明道哥哥为上吊自尽,而嫂子和侄子卧倒一旁,脖子有勒痕,很明显是哥哥先将妻子和儿子勒死之后,自己自杀的。而这……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11143388568_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11143368671_294195/0","https://inews.gtimg.com/newsapp_ls/0/11143368689_294195/0","https://inews.gtimg.com/newsapp_ls/0/11143368695_294195/0"],"354X264":["https://inews.gtimg.com/newsapp_ls/0/11143368671_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143368689_354264/0","https://inews.gtimg.com/newsapp_ls/0/11143368695_354264/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11143388568_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11143388568_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11143388568_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11143388568_870492/0"]},"keywords":"明道;自杀","media_icon":"https://inews.gtimg.com/newsapp_ls/0/3115077998_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11143300595/641","https://inews.gtimg.com/newsapp_bt/0/11143300621/641","https://inews.gtimg.com/newsapp_bt/0/11143300601/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 16:07:32","report":"{\"ext\":\"13300+4\"+\"all\":\";;;7440+226\"+\"3h\":\"5412073+383246;1503128+95818;ent:1204926+93453;7132+215;6962+209\"+\"app\":\";;;65+3;;1;0;0;317;105.66667;0.04615;4.87692\"+\"day\":\"32834617+2591064;8049774+621320;ent:6489037+524317;7440+226;7364+224\"}","s_group":2,"showtype":"article","source":"小周聊动漫","source_fans":0,"source_id":"8117081","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0HDAB00","tag_label":[["明道","97581"],["自杀","95861"]],"tags":"明道;自杀","title":"明道哥哥负债自杀,妻子儿子遗体无挣扎痕迹,很有可能是用药了!","title_len":28.666666,"ts":1578298052,"update_time":"2020-01-06 16:07:32","url":"https://xw.qq.com/cmsid/20200106A0HDAB00","view_count":13300,"vurl":"https://new.qq.com/omn/20200106/20200106A0HDAB00.html"},{"app_id":"20200106A0H29400","article_type":0,"bimg":"https://inews.gtimg.com/newsapp_ls/0/11143330116_640330/0","category":"ent","category1_chn":"娱乐","category1_id":"1","category2_chn":"中国娱乐","category2_id":"112","category_chn":"娱乐","category_id":"1","comment_id":"4642689463","comment_num":6,"duration":0,"ext":{"tonality_score":2,"news_score":3,"img_type":3,"video_count":0},"flag":0,"fm_url":"","from":"cms_pool","id":"20200106A0H294","img":"https://inews.gtimg.com/newsapp_ls/0/11143330116_640330/0","img_count":11,"img_type":3,"imgs":{"294X195":"https://inews.gtimg.com/newsapp_ls/0/11143330116_294195/0","295X195":"https://inews.gtimg.com/newsapp_ls/0/11143330116_295195/0","400X320":"https://inews.gtimg.com/newsapp_ls/0/11143330116_400320/0","580X328":"https://inews.gtimg.com/newsapp_ls/0/11143330116_580328/0","640X330":"https://inews.gtimg.com/newsapp_ls/0/11143330116_640330/0","640X470":"https://inews.gtimg.com/newsapp_ls/0/11143330116_640470/0","870X492":"https://inews.gtimg.com/newsapp_ls/0/11143330116_870492/0"},"intro":"#于正秒删# 于正秒删一条社交平台动态,引发网友热议,于正发文说正在写一部取材于真实故事的剧“男孩和女孩因戏结缘,后一起演了男女主产生感情,女孩越来越红,男孩想证明自己却停留在原地,然后不告而别,分……","irs_imgs":{"294X195":["https://inews.gtimg.com/newsapp_ls/0/11143330116_294195/0"],"295X195":["https://inews.gtimg.com/newsapp_ls/0/11143330116_295195/0","https://inews.gtimg.com/newsapp_ls/0/11143330117_295195/0","https://inews.gtimg.com/newsapp_ls/0/11143330118_295195/0"],"400X320":["https://inews.gtimg.com/newsapp_ls/0/11143330116_400320/0","https://inews.gtimg.com/newsapp_ls/0/11143330117_400320/0","https://inews.gtimg.com/newsapp_ls/0/11143330118_400320/0"],"580X328":["https://inews.gtimg.com/newsapp_ls/0/11143330116_580328/0"],"640X330":["https://inews.gtimg.com/newsapp_ls/0/11143330116_640330/0"],"640X470":["https://inews.gtimg.com/newsapp_ls/0/11143330116_640470/0"],"870X492":["https://inews.gtimg.com/newsapp_ls/0/11143330116_870492/0"]},"keywords":"于正;赵丽颖;陈晓","media_icon":"https://inews.gtimg.com/newsapp_ls/0/11018224017_200200/0","mini_img":"","multi_imgs":["https://inews.gtimg.com/newsapp_bt/0/11143317297/641","https://inews.gtimg.com/newsapp_bt/0/11143317298/641","https://inews.gtimg.com/newsapp_bt/0/11143317299/641"],"news_level":3,"play_url_high":"","play_url_medium":"","play_url_small":"","pool_type":"pc:article","publish_time":"2020-01-06 15:54:49","report":"{\"ext\":\"10612+6\"+\"all\":\";;;18280+936\"+\"3h\":\"5412073+383246;2683251+201973;ent:1204926+93453#tv:0+0;18087+929;17276+885\"+\"app\":\";;;58+4;;0;0;0;247;61.75;0.06897;4.25862\"+\"day\":\"32834617+2591064;16083534+1361251;ent:6489037+524317#tv:0+0;18280+936;17498+893\"}","s_group":2,"showtype":"article","source":"七颜酱","source_fans":0,"source_id":"17827792","source_logo":"","strategy":2,"surl":"http://kuaibao.qq.com/s/20200106A0H29400","tag_label":[["于正","256172"],["赵丽颖","81790"],["陈晓","81807"]],"tags":"于正;赵丽颖;陈晓","title":"于正秒删社交动态,称取材真实爱情故事,暗指赵丽颖和陈晓","title_len":26.11111,"ts":1578297289,"update_time":"2020-01-06 15:54:49","url":"https://xw.qq.com/cmsid/20200106A0H29400","view_count":10612,"vurl":"https://new.qq.com/omn/20200106/20200106A0H29400.html"}],"datanum":19,"seq":"20200106204256-PNY4jcZxB52hN9Ht","biz":5000,"s_group":"2","other":null}

5.获取新闻的列表对象

抽取关键信息

"title":
"intro":
"publish_time":
"vurl":
"source":

1、创建实体类

public class News {

    private Integer id;
    private String title;
    private String intro;
    private String source;
    private String vurl;
    private Date publishTime;

    @Override
    public String toString() {
        return "News{" +
                "id=" + id +
                ", title='" + title + '\'' +
                ", intro='" + intro + '\'' +
                ", source='" + source + '\'' +
                ", vurl='" + vurl + '\'' +
                ", publishTime=" + publishTime +
                '}';
    }

    public Integer getId() {
        return id;
    }

    public void setId(Integer id) {
        this.id = id;
    }

    public String getTitle() {
        return title;
    }

    public void setTitle(String title) {
        this.title = title;
    }

    public String getIntro() {
        return intro;
    }

    public void setIntro(String intro) {
        this.intro = intro;
    }

    public String getSource() {
        return source;
    }

    public void setSource(String source) {
        this.source = source;
    }

    public String getVurl() {
        return vurl;
    }

    public void setVurl(String vurl) {
        this.vurl = vurl;
    }

    public Date getPublishTime() {
        return publishTime;
    }

    public void setPublishTime(Date publishTime) {
        this.publishTime = publishTime;
    }
}

2、添加将新闻数据转换为新闻对象的方法

    //新闻数据转换为新闻对象
    public List mapToBean(List src) throws Exception{

        SimpleDateFormat format = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");

        List list = new ArrayList();

        for(Map map:src){
            News news = new News();
            news.setTitle(map.get("title").toString());
            news.setIntro(map.get("intro").toString());
            news.setSource(map.get("source").toString());
            news.setVurl(map.get("vurl").toString());
            String publish_time = map.get("publish_time").toString();
            news.setPublishTime(format.parse(publish_time));
            list.add(news);
        }
        return list;
    }

3、在main方法中添加遍历

            List list = mapToBean((List) map.get("data"));//转为新闻对象
            for(News news:list){
                System.out.println(news);
            }

娱乐头条-03spider_第7张图片

6.保存新闻的数据

娱乐头条-03spider_第8张图片

1、创建一张表

娱乐头条-03spider_第9张图片

2、导包(直接在前面的进行添加)

        
            org.mybatis
            mybatis
            3.4.6
        

        
            mysql
            mysql-connector-java
            5.1.38
        


        
            log4j
            log4j
            1.2.12
        


        
            org.slf4j
            slf4j-api
            1.7.25
        

        
            org.slf4j
            slf4j-log4j12
            1.7.25
            test
        

3、实体类(参考上面)

4、工具类

public class MyBatisUtils {

    private static SqlSessionFactory factory = null;

    static{
        String resource = "Mybatis-config.xml";
        InputStream inputStream = null;
        try {
            inputStream = Resources.getResourceAsStream(resource);
        } catch (IOException e) {
            e.printStackTrace();
        }
        factory  = new SqlSessionFactoryBuilder().build(inputStream);
    }

    public static SqlSession getSession(){
        return factory.openSession();
    }
}

5、mapper接口

public interface NewsMapper {
    Integer batchSave(@Param("news") List list);
}

6、mapper映射文件



    
        insert into news(title,intro,source,vurl,publish_time)
        VALUES
        
            (#{item.title},#{item.intro},#{item.source},#{item.vurl},#{item.publishTime})
        
    

7、db配置文件

driver=com.mysql.jdbc.Driver
url=jdbc:mysql:///spider
username=root
password=root

8、主配置文件



    
    


    
        
        
            
            
            
            
                
                
                
                
            
        
    


    
        
    

9、日志文件

# Global logging configuration
log4j.rootLogger=ERROR, stdout
# MyBatis logging configuration...
log4j.logger.com.xj=TRACE
# Console output...
log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%5p [%t] - %m%n

10、EntertainmentSpider.java

public class EntertainmentSpider {

   public void main() throws Exception{
        //1.确定url
        String indexUrl = "https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page=1&callback=__jp6";

        //2.发送请求,获取数据
        //创建HttpClients对象
        CloseableHttpClient httpClient = HttpClients.createDefault();
        //创建请求方式对象
        HttpGet get = new HttpGet(indexUrl);
        //执行请求操作
        CloseableHttpResponse response = httpClient.execute(get);

        if(response.getStatusLine().getStatusCode() == 200){
            HttpEntity entity = response.getEntity();
            String res = EntityUtils.toString(entity);
            res = toJsonString(res);//截取字符串
            //System.out.println(res);
            Map map = jsonToMap(res);//转为map对象

            List list = mapToBean((List) map.get("data"));//转为新闻对象

            Integer count = saveNews(list);//保存新闻的数据
            System.out.println(count);


        }
    }

    //截取结果字符串
    public String toJsonString(String src){
        int start = src.indexOf("{");
        int end = src.lastIndexOf("}")+1;
        return src.substring(start,end);
    }

    //json字符串转换为java对象
    public Map jsonToMap(String src){
        return JSON.parseObject(src, HashMap.class);
    }

    //新闻数据转换为新闻对象
    public List mapToBean(List src) throws Exception{

        SimpleDateFormat format = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");

        List list = new ArrayList();

        for(Map map:src){
            News news = new News();
            news.setTitle(map.get("title").toString());
            news.setIntro(map.get("intro").toString());
            news.setSource(map.get("source").toString());
            news.setVurl(map.get("vurl").toString());
            String publish_time = map.get("publish_time").toString();
            news.setPublishTime(format.parse(publish_time));
            list.add(news);
        }
        return list;
    }

    //保存新闻的数据
    public int saveNews(List list){

        SqlSession session = MyBatisUtils.getSession();
        NewsMapper mapper = session.getMapper(NewsMapper.class);
        Integer res = mapper.batchSave(list);
        session.commit();
        session.close();
        return res;
    }

}

娱乐头条-03spider_第10张图片

7.循环获取所有的新闻元素

修改EntertainmentSpider中main方法的代码

    public void main() throws Exception{

        Integer page = 0;

        while(true){
            //1.确定url
            String indexUrl = "https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page="+page+"&callback=__jp6";

            //2.发送请求,获取数据
            //创建HttpClients对象
            CloseableHttpClient httpClient = HttpClients.createDefault();
            //创建请求方式对象
            HttpGet get = new HttpGet(indexUrl);
            //执行请求操作
            CloseableHttpResponse response = httpClient.execute(get);

            if(response.getStatusLine().getStatusCode() == 200){
                HttpEntity entity = response.getEntity();
                String res = EntityUtils.toString(entity);
                res = toJsonString(res);//截取字符串
                //System.out.println(res);
                Map map = jsonToMap(res);//转为map对象


                //页面没有数据时,结束循环
                if(Integer.parseInt(map.get("datanum").toString()) == 0){
                    break;
                }


                List list = mapToBean((List) map.get("data"));//转为新闻对象

                Integer count = saveNews(list);//保存新闻的数据
                System.out.println(page);
            }

            page++;

        }
    }

8.去除重复的新闻数据

上面保存的数据存在一个问题:数据重复

娱乐头条-03spider_第11张图片

1、添加依赖

        
            redis.clients
            jedis
            3.1.0
        

2、添加一个方法,并修改main方法中的代码

public class EntertainmentSpider {

    public void main() throws Exception{

        Integer page = 0;

        while(true){
            //1.确定url
            String indexUrl = "https://pacaio.match.qq.com/irs/rcd?cid=146&token=49cbb2154853ef1a74ff4e53723372ce&ext=ent&page="+page+"&callback=__jp6";

            //2.发送请求,获取数据
            //创建HttpClients对象
            CloseableHttpClient httpClient = HttpClients.createDefault();
            //创建请求方式对象
            HttpGet get = new HttpGet(indexUrl);
            //执行请求操作
            CloseableHttpResponse response = httpClient.execute(get);

            if(response.getStatusLine().getStatusCode() == 200){
                HttpEntity entity = response.getEntity();
                String res = EntityUtils.toString(entity);
                res = toJsonString(res);//截取字符串
                //System.out.println(res);
                Map map = jsonToMap(res);//转为map对象


                //页面没有数据时,结束循环
                if(Integer.parseInt(map.get("datanum").toString()) == 0){
                    break;
                }


                List list = mapToBean((List) map.get("data"));//转为新闻对象

                if(list.size()>0){
                    Integer count = saveNews(list);//保存新闻的数据
                }

                System.out.println(page);
            }

            page++;

        }
    }

    //截取结果字符串
    public String toJsonString(String src){
        int start = src.indexOf("{");
        int end = src.lastIndexOf("}")+1;
        return src.substring(start,end);
    }

    //json字符串转换为java对象
    public Map jsonToMap(String src){
        return JSON.parseObject(src, HashMap.class);
    }

    //新闻数据转换为新闻对象
    public List mapToBean(List src) throws Exception{

        SimpleDateFormat format = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");

        List list = new ArrayList();

        for(Map map:src){

            //获取url的值
            String url = map.get("vurl").toString();
            if(!checkUrl(url)){
                continue;
            }

            News news = new News();
            news.setTitle(map.get("title").toString());
            news.setIntro(map.get("intro").toString());
            news.setSource(map.get("source").toString());
            news.setVurl(url);
            String publish_time = map.get("publish_time").toString();
            news.setPublishTime(format.parse(publish_time));
            list.add(news);
        }
        return list;
    }

    //保存新闻的数据
    public int saveNews(List list){

        SqlSession session = MyBatisUtils.getSession();
        NewsMapper mapper = session.getMapper(NewsMapper.class);
        Integer res = mapper.batchSave(list);
        session.commit();
        session.close();
        return res;
    }

    //判断url是否已经在redis中保存
    public Boolean checkUrl (String url){
        Jedis jedis = new Jedis("localhost", 6379);
        Long count = jedis.sadd("spider:news:url", url);//保存成功=1,不成功=0
        jedis.close();
        return  count>0 ? true : false;
    }

}

9.java的定时任务

添加一个计时的类,调用上面执行的main方法

public class App {
    public static void main(String[] args) {

        final EntertainmentSpider spider = new EntertainmentSpider();

        //创建定时器
        Timer timer = new Timer();

        //启动时延迟x秒钟执行方法
        //每隔两秒执行x次
        timer.schedule(
                new TimerTask() {
                    @Override
                    public void run() {
                        try {
                            spider.main();
                        } catch (Exception e) {
                            e.printStackTrace();
                        }
                    }
                },0,
                  120000L
        );
    }
}

 

你可能感兴趣的:(大数据)