采集淘宝商品列表和商品详情及淘宝实时销量遇到滑块验证码的解决方法(带SKU和商品描述,可高并发),主要是解决了高频情况下的阿里系滑块和必须要N多小号才能解决的反扒问题,以后都可以使用以下的方法:
大家知道,淘宝的反爬虫机制十分严,而很多时候,没办法高效的拿到数据内容响应终端需求,而依赖爬虫就会造成动不动就出现滑块验证,让人很无解,正好,公司有这样的需求,让我负责解决这个问题,刚开始各种尝试,始终没有绕过淘宝的滑块验证码,搞了好几天,都没有进展;
然后各种网上资料查询,最终还是不负努力,找到更好的解决方案,让淘宝不再出现任何滑块验证码,完全解密通过,实现更好的用户体验。下面就说说封装好的接口说明(基于手淘的x-sign实现获得的淘宝天猫商品详情介绍和店铺信息API,不会出滑块,和出现挤爆了等异常):
3:我已经把该方法封装成接口,只需要把要得到的商品ID,传给我就可以,然后及时的响应你的数据内容 需求,可满足多种常见场景操作,可获取淘宝详情、商品原价、促销价、实时销量、库存、视频主图,sku属性,sku图片等页面上可以查看的数据均可以拿到。
4. 公共参数
名称 | 类型 | 必须 | 描述 |
---|---|---|---|
key | String | 是 | 调用key(必须以GET方式拼接在URL中,点击获取测试key和secret) |
secret | String | 是 | 调用密钥 |
api_name | String | 是 | API接口名称(包括在请求地址中)[item_search,item_get,item_search_shop等] |
cache | String | 否 | [yes,no]默认yes,将调用缓存的数据,速度比较快 |
result_type | String | 否 | [json,jsonu,xml,serialize,var_export]返回数据格式,默认为json,jsonu输出的内容中文可以直接阅读 |
lang | String | 否 | [cn,en,ru]翻译语言,默认cn简体中文 |
version | String | 否 | API版本 |
5.请求参数
请求参数:num_iid=520813250866&is_promotion=1
参数说明:num_iid:淘宝商品ID
is_promotion:是否获取取促销价
6.响应参数
7.请求示例(CURL、PHP 、PHPsdk 、Java 、C# 、Python…)
import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.io.Reader;
import java.net.URL;
import java.nio.charset.Charset;
import org.json.JSONException;
import org.json.JSONObject;
import java.io.PrintWriter;
import java.net.URLConnection;
public class Example {
private static String readAll(Reader rd) throws IOException {
StringBuilder sb = new StringBuilder();
int cp;
while ((cp = rd.read()) != -1) {
sb.append((char) cp);
}
return sb.toString();
}
public static JSONObject postRequestFromUrl(String url, String body) throws IOException, JSONException {
URL realUrl = new URL(url);
URLConnection conn = realUrl.openConnection();
conn.setDoOutput(true);
conn.setDoInput(true);
PrintWriter out = new PrintWriter(conn.getOutputStream());
out.print(body);
out.flush();
InputStream instream = conn.getInputStream();
try {
BufferedReader rd = new BufferedReader(new InputStreamReader(instream, Charset.forName("UTF-8")));
String jsonText = readAll(rd);
JSONObject json = new JSONObject(jsonText);
return json;
} finally {
instream.close();
}
}
public static JSONObject getRequestFromUrl(String url) throws IOException, JSONException {
URL realUrl = new URL(url);
URLConnection conn = realUrl.openConnection();
InputStream instream = conn.getInputStream();
try {
BufferedReader rd = new BufferedReader(new InputStreamReader(instream, Charset.forName("UTF-8")));
String jsonText = readAll(rd);
JSONObject json = new JSONObject(jsonText);
return json;
} finally {
instream.close();
}
}
public static void main(String[] args) throws IOException, JSONException {
// 请求示例 url 默认请求参数已经URL编码处理
String url = "https://vx19970108018/taobao/item_get/?key=<您自己的apiKey>&secret=<您自己的apiSecret>&num_iid=520813250866&is_promotion=1";
JSONObject json = getRequestFromUrl(url);
System.out.println(json.toString());
}
}
8.响应示例
{
"item": {
"num_iid": "520813250866",
"title": "三刃木折叠刀过安检创意迷你钥匙扣钥匙刀军刀随身多功能小刀包邮",
"desc_short": "",
"price": 25.8,
"total_price": 0,
"suggestive_price": 0,
"orginal_price": "25.80",
"nick": "欢乐购客栈",
"num": "832",
"min_num": 0,
"detail_url": "http://item.taobao.com/item.htm?id=520813250866",
"pic_url": "//img.alicdn.com/imgextra/i4/2596264565/TB2p30elFXXXXXQXpXXXXXXXXXX_!!2596264565.jpg",
"brand": "三刃木",
"brandId": "4036703",
"rootCatId": "50013886",
"cid": "50014822",
"favcount": "4824",
"fanscount": "1469",
"crumbs": [],
"created_time": "",
"modified_time": "",
"delist_time": "",
"desc": "小店所有产品都支持刻字,如需刻字,拍之前联系客服即可。
炎炎夏日来临,一把随身携带便携式的折叠小刀,带开瓶器功能,喝酒不用愁。(钥匙刀不带开瓶器功能)
可以当吊牌项链装饰,也可当钥匙扣挂饰, 水果刀 开瓶器 户外防身.
部分客户跟我们反映链子质量还不够好,因此小店已重新订购一批质量更好的链子赠送,加量不加价,只为让你买的更舒心,戴的更放心。
购买就送工具刀卡和链子一条
璀璨钻石套餐包含【SK016D钥匙扣+GJ019C折叠刀+GJ017D工具卡】
超凡大师套餐包括【304不锈钢钥匙扣+GJ019C折叠刀+GJ017D工具卡】
最强王者套餐包括【钛钢钥匙扣+GJ019C折叠刀+GJ017D工具卡】
",
"item_imgs": [
{
"url": "//img.alicdn.com/imgextra/i4/2596264565/TB2p30elFXXXXXQXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"url": "//img.alicdn.com/imgextra/i2/2596264565/TB2onxRlVXXXXcDXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"url": "//img.alicdn.com/imgextra/i1/2596264565/TB2a.x.lVXXXXXPXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"url": "//img.alicdn.com/imgextra/i2/2596264565/TB2iWE6bKZkyKJjSszbXXblwFXa_!!2596264565.jpg"
},
{
"url": "//img.alicdn.com/imgextra/i4/2596264565/TB2j2cTXib_F1JjSZFzXXc6KXXa_!!2596264565.jpg"
}
],
"item_weight": "0",
"item_size": "",
"location": "广东深圳",
"post_fee": "",
"express_fee": "0.00",
"ems_fee": "",
"shipping_to": "广东广州白云区",
"has_discount": "false",
"video": [],
"is_virtual": "",
"sample_id": "",
"is_promotion": "false",
"props_name": "1627207:1347647754:颜色分类:长方形带开瓶器+送工具刀卡+链子;1627207:1347647753:颜色分类:椭圆形带开瓶器+送工具刀卡+链子;1627207:1195392087:颜色分类:GJ018X钥匙刀+送工具刀卡+链子;1627207:1331112595:颜色分类:超凡大师套餐【送工具卡+链子】;1627207:1331112594:颜色分类:最强王者套餐【送工具卡+链子】;1627207:1331264247:颜色分类:璀璨钻石套餐【送工具卡+链子】",
"prop_imgs": {
"prop_img": [
{
"properties": "1627207:1347647754",
"url": "//img.alicdn.com/imgextra/i3/2596264565/TB2.XeblVXXXXXkXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"properties": "1627207:1347647753",
"url": "//img.alicdn.com/imgextra/i4/2596264565/TB2dTrjdVXXXXXBXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"properties": "1627207:1195392087",
"url": "//img.alicdn.com/imgextra/i2/2596264565/TB2j22kdVXXXXXdXpXXXXXXXXXX_!!2596264565.jpg"
},
{
"properties": "1627207:1331112595",
"url": "//img.alicdn.com/imgextra/i4/2596264565/TB2_uiXnFXXXXXBXXXXXXXXXXXX_!!2596264565.jpg"
},
{
"properties": "1627207:1331112594",
"url": "//img.alicdn.com/imgextra/i4/2596264565/TB2Gm9xnFXXXXbmXXXXXXXXXXXX_!!2596264565.jpg"
},
{
"properties": "1627207:1331264247",
"url": "//img.alicdn.com/imgextra/i3/2596264565/TB2wWohmXXXXXX8XXXXXXXXXXXX_!!2596264565.jpg"
}
]
},
"property_alias": "1627207:1347647754:长方形带开瓶器+送工具刀卡+链子;1627207:1347647753:椭圆形带开瓶器+送工具刀卡+链子;1627207:1195392087:GJ018X钥匙刀+送工具刀卡+链子;1627207:1331112595:超凡大师套餐【送工具卡+链子】;1627207:1331112594:最强王者套餐【送工具卡+链子】;1627207:1331264247:璀璨钻石套餐【送工具卡+链子】",
"props": [
{
"name": "品牌",
"value": "三刃木"
},
{
"name": "产地",
"value": "中国"
},
{
"name": "颜色分类",
"value": "长方形带开瓶器+送工具刀卡+链子,椭圆形带开瓶器+送工具刀卡+链子,GJ018X钥匙刀+送工具刀卡+链子,超凡大师套餐【送工具卡+链子】,最强王者套餐【送工具卡+链子】,璀璨钻石套餐【送工具卡+链子】"
},
{
"name": "吊牌价",
"value": "46"
},
{
"name": "功能数量",
"value": "5个及以下"
},
{
"name": "货号",
"value": "GJ019C"
},
{
"name": "附加功能",
"value": "开瓶器,刀,螺丝刀,钥匙圈,其他"
}
],
"total_sold": "1",
"skus": {
"sku": [
{
"price": "39",
"orginal_price": "39.00",
"properties": "1627207:1347647754",
"properties_name": "1627207:1347647754:颜色分类:长方形带开瓶器+送工具刀卡+链子",
"quantity": "104",
"sku_id": "3166598625985"
},
{
"price": "39",
"orginal_price": "39.00",
"properties": "1627207:1347647753",
"properties_name": "1627207:1347647753:颜色分类:椭圆形带开瓶器+送工具刀卡+链子",
"quantity": "370",
"sku_id": "3166598625984"
},
{
"price": "25.8",
"orginal_price": "25.80",
"properties": "1627207:1195392087",
"properties_name": "1627207:1195392087:颜色分类:GJ018X钥匙刀+送工具刀卡+链子",
"quantity": "34",
"sku_id": "3144644292458"
},
{
"price": "73.8",
"orginal_price": "73.80",
"properties": "1627207:1331112595",
"properties_name": "1627207:1331112595:颜色分类:超凡大师套餐【送工具卡+链子】",
"quantity": "157",
"sku_id": "3161300228970"
},
{
"price": "91.8",
"orginal_price": "91.80",
"properties": "1627207:1331112594",
"properties_name": "1627207:1331112594:颜色分类:最强王者套餐【送工具卡+链子】",
"quantity": "0",
"sku_id": "3161300228969"
},
{
"price": "63.8",
"orginal_price": "63.80",
"properties": "1627207:1331264247",
"properties_name": "1627207:1331264247:颜色分类:璀璨钻石套餐【送工具卡+链子】",
"quantity": "167",
"sku_id": "3161107666655"
}
]
},
"seller_id": "2596264565",
"sales": "1",
"shop_id": "127203758",
"props_list": {
"1627207:1347647754": "颜色分类:长方形带开瓶器+送工具刀卡+链子",
"1627207:1347647753": "颜色分类:椭圆形带开瓶器+送工具刀卡+链子",
"1627207:1195392087": "颜色分类:GJ018X钥匙刀+送工具刀卡+链子",
"1627207:1331112595": "颜色分类:超凡大师套餐【送工具卡+链子】",
"1627207:1331112594": "颜色分类:最强王者套餐【送工具卡+链子】",
"1627207:1331264247": "颜色分类:璀璨钻石套餐【送工具卡+链子】"
},
"seller_info": {
"title": "欢乐购客栈",
"shop_name": "欢乐购客栈",
"sid": "127203758",
"zhuy": "//shop127203758.taobao.com",
"level": "12",
"shop_type": "C",
"user_num_id": "2596264565",
"nick": "欢乐购客栈",
"cid": null,
"delivery_score": "4.8 ",
"item_score": "4.8 ",
"score_p": "4.8 "
},
"tmall": "false",
"error": "",
"warning": "",
"url_log": [],
"stuff_status": "",
"shopinfo": {
"shop_name": "欢乐购客栈",
"shop_id": "127203758"
},
"data_from": "mtop",
"method": "item_mtop:item_get",
"promo_type": null,
"props_img": {
"1627207:1347647754": "//img.alicdn.com/imgextra/i3/2596264565/TB2.XeblVXXXXXkXpXXXXXXXXXX_!!2596264565.jpg",
"1627207:1347647753": "//img.alicdn.com/imgextra/i4/2596264565/TB2dTrjdVXXXXXBXpXXXXXXXXXX_!!2596264565.jpg",
"1627207:1195392087": "//img.alicdn.com/imgextra/i2/2596264565/TB2j22kdVXXXXXdXpXXXXXXXXXX_!!2596264565.jpg",
"1627207:1331112595": "//img.alicdn.com/imgextra/i4/2596264565/TB2_uiXnFXXXXXBXXXXXXXXXXXX_!!2596264565.jpg",
"1627207:1331112594": "//img.alicdn.com/imgextra/i4/2596264565/TB2Gm9xnFXXXXbmXXXXXXXXXXXX_!!2596264565.jpg",
"1627207:1331264247": "//img.alicdn.com/imgextra/i3/2596264565/TB2wWohmXXXXXX8XXXXXXXXXXXX_!!2596264565.jpg"
},
"rate_grade": "",
"shop_item": [],
"relate_items": []
},
"secache": "d8bd20b8f0d9df02dd030dd374110240",
"secache_time": 1591841298,
"secache_date": "2020-06-11 10:08:18",
"translate_status": "error",
"translate_time": 0.001,
"language": {
"current_lang": "zh-CN",
"source_lang": "cn"
},
"error": "",
"reason": "",
"error_code": "0000",
"cache": 1,
"api_info": "today:7033 max:10000",
"execution_time": 0.211,
"server_time": "Beijing/2020-06-11 10:12:27",
"call_args": {
"num_iid": "520813250866",
"area_id": "440111"
},
"api_type": "taobao",
"translate_language": "zh-CN",
"translate_engine": "google_cn",
"server_memory": "8.26MB",
"request_id": "15ee1930b4e098"
}