抖音数据采集之x-gorgon算法,核心加密技术
分析
-
xgorgon生成算法主要在libcms.so中，在JNI_Onload中动态注册jni函数。
-
算法用ollvm混淆了，主要是流程平坦化，流程混淆和运算替换。
-
主要是X-Gorgon和X-SS-STUB.之后经过抓包抖音接口，查看Java层,so层代码。
-
X-SS-STUB是post请求时body部分的md5值，但是在为空的情况下，有时候不参与加密，有时候参与加密，具体接口需要具体分析
-
X-Khronos比较简单就是一个unix时间戳
-
X-Gorgon是对cookie,X-SS-STUB,X-Khronos,Url进行混合加密之后的参数。这里也区分情况，有些接口只有url和X-Khronos参与接口加密，有些是url，X-Khronos，X-SS-STUB参与接口加密，有些则是所有都进行接口加密。
部分代码(Python版)
请求URL(作品列表):
https://aweme.snssdk.com/aweme/v1/aweme/post/?source=0&publish_video_strategy_type=2&max_cursor=0&sec_user_id=MS4wLjABAAAAsGjRWGYusfR_J3_8LVoawsdIjtioJ79ARPREyJudBrgnSxR7sJRo_Xgg4qGhjA_6&count=20&os_api=22&device_type=TAS-AN00&ssmix=a&manifest_version_code=110901&dpi=192&uuid=867442437834290&app_name=aweme&version_name=11.9.0&ts=1595736375&cpu_support64=false&storage_type=2&app_type=normal&ac=wifi&host_abi=armeabi&update_version_code=11909900&channel=update&_rticket=1595736377033&device_platform=android&iid=xxxx&version_code=110900&mac_address=3a%3Acc%3A48%3Aa4%3A28%3A13&cdid=199cee7c-8043-4dda-ae72-9b49fdc6fe22&openudid=2bd6cb49171f4110&device_id=xxxxxx&resolution=720*1280&os_version=5.1.1&language=zh&device_brand=HUAWEI&aid=1128&mcc_mnc=46000
返回的数据包:
{
'status_code': 0,
'min_cursor': 1596165008000,
'max_cursor': 1595493457000,
'has_more': 1,
'aweme_list': [
{
'aweme_id': '6853385491778145550',
'desc': '职业S手的基本操作 #北野武 #影视剪辑 @DOU+小助手 #热门',
'create_time': 1595678177,
'author': {
'uid': '2449349262191459',
'short_id': '2248140459',
'nickname': '老男孩剪影',
'signature': '原创剪辑 请多指教✨\n你的关注 我的动力✨\n感谢官方 感谢抖音✨\n☕️剪辑教学Yn19800128\n ＋请注明来意',
'avatar_larger': {
'uri': '1080x1080/31504000801252d20600e',
'url_list': [
'https://p9-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p29-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'avatar_thumb': {
'uri': '100x100/31504000801252d20600e',
'url_list': [
'https://p3-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p29-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'avatar_medium': {
'uri': '720x720/31504000801252d20600e',
'url_list': [
'https://p26-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p9-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'is_verified': True,
'follow_status': 0,
'is_block': False,
'location': '',
'hide_location': False,
'custom_verify': '',
'unique_id': 'My116118',
'story_count': 0,
'room_id': 0,
'authority_status': 0,
'verify_info': '',
'share_info': {
'share_url': '',
'share_weibo_desc': '',
'share_desc': '',
'share_title': '',
'share_qrcode_url': {
'uri': '209e2000313907c918160',
'url_list': [
'https://p3-dy.byteimg.com/obj/209e2000313907c918160?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/obj/209e2000313907c918160?from=2563711402',
'https://p9-dy.byteimg.com/obj/209e2000313907c918160?from=2563711402'
],
'width': 720,
'height': 720
},
'share_title_myself': '',
'share_title_other': '',
'share_desc_info': ''
},
'with_commerce_entry': False,
'verification_type': 1,
'original_musician': {
'music_count': 0,
'music_used_count': 0,
'digg_count': 0
},
'enterprise_verify_reason': '',
'is_ad_fake': False,
'followers_detail': None,
'region': 'CN',
'sync_to_toutiao': 0,
'commerce_user_level': 0,
'is_discipline_member': False,
'secret': 0,
'video_icon': {
'uri': '',
'url_list': [],
'width': 720,
'height': 720
},
'is_gov_media_vip': False,
'follower_status': 0,
'cover_url': [
{
'uri': 'c8510002be9a3a61aad2',
'url_list': [
'https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402',
'https://p26-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402'
],
'width': 720,
'height': 720
}
],
'language': 'zh-Hans',
'has_unread_story': False,
'is_star': False,
'ad_cover_url': None,
'avatar_168x168': {
'uri': '168x168/31504000801252d20600e',
'url_list': [
'https://p29-dy.byteimg.com/img/31504000801252d20600e~c5_168x168.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/img/31504000801252d20600e~c5_168x168.webp?from=2563711402',
'https://p9-dy.byteimg.com/img/31504000801252d20600e~c5_168x168.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'avatar_300x300': {
'uri': '300x300/31504000801252d20600e',
'url_list': [
'https://p6-dy-ipv6.byteimg.com/img/31504000801252d20600e~c5_300x300.webp?from=2563711402',
'https://p26-dy.byteimg.com/img/31504000801252d20600e~c5_300x300.webp?from=2563711402',
'https://p1-dy.byteimg.com/img/31504000801252d20600e~c5_300x300.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'relative_users': None,
'cha_list': None,
'sec_uid': 'MS4wLjABAAAAsGjRWGYusfR_J3_8LVoawsdIjtioJ79ARPREyJudBrgnSxR7sJRo_Xgg4qGhjA_6',
'prevent_download': False,
'comment_setting': 0,
'duet_setting': 0,
'download_setting': -1,
'comment_filter_status': 0
},
'music': {
'id': 6853385918674373383,
'id_str': '6853385918674373383',
'title': '@老男孩剪影创作的原声',
'author': '老男孩剪影',
'album': '',
'cover_hd': {
'uri': '1080x1080/31504000801252d20600e',
'url_list': [
'https://p3-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p26-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'cover_large': {
'uri': '1080x1080/31504000801252d20600e',
'url_list': [
'https://p3-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p26-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'cover_medium': {
'uri': '720x720/31504000801252d20600e',
'url_list': [
'https://p9-dy-ipv6.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p3-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p26-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'cover_thumb': {
'uri': '100x100/31504000801252d20600e',
'url_list': [
'https://p26-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p29-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'play_url': {
'uri': 'http://p1-dy.byteimg.com/obj/ies-music/6853385885868854030.mp3',
'url_list': [
'http://p1-dy.byteimg.com/obj/ies-music/6853385885868854030.mp3',
'http://p3-dy.byteimg.com/obj/ies-music/6853385885868854030.mp3'
],
'width': 720,
'height': 720
},
'schema_url': '',
'source_platform': 23,
'start_time': 0,
'end_time': 0,
'duration': 171,
'extra': '{"has_edited":0,"reviewed":1,"review_unshelve_reason":0,"beats":{},"douyin_beats_info":{},"schedule_search_time":0,"hotsoon_review_time":-1}',
'user_count': 0,
'position': None,
'collect_stat': 0,
'status': 1,
'offline_desc': '',
'owner_id': '2449349262191459',
'owner_nickname': '老男孩剪影',
'is_original': False,
'mid': '6853385918674373383',
'binded_challenge_id': 0,
'redirect': False,
'is_restricted': False,
'author_deleted': False,
'is_del_video': False,
'is_video_self_see': False,
'owner_handle': 'My116118',
'author_position': None,
'prevent_download': False,
'unshelve_countries': None,
'prevent_item_download_status': 0,
'external_song_info': [],
'sec_uid': 'MS4wLjABAAAAsGjRWGYusfR_J3_8LVoawsdIjtioJ79ARPREyJudBrgnSxR7sJRo_Xgg4qGhjA_6',
'avatar_thumb': {
'uri': '100x100/31504000801252d20600e',
'url_list': [
'https://p26-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p29-dy.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/100x100/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'avatar_medium': {
'uri': '720x720/31504000801252d20600e',
'url_list': [
'https://p9-dy-ipv6.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p3-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402',
'https://p26-dy.byteimg.com/aweme/720x720/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'avatar_large': {
'uri': '1080x1080/31504000801252d20600e',
'url_list': [
'https://p3-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402',
'https://p26-dy.byteimg.com/aweme/1080x1080/31504000801252d20600e.webp?from=2563711402'
],
'width': 720,
'height': 720
},
'preview_start_time': 0,
'preview_end_time': 0,
'is_commerce_music': False,
'is_original_sound': True,
'audition_duration': 171,
'shoot_duration': 171,
'reason_type': 0,
'artists': [],
'lyric_short_position': None,
'mute_share': False,
'tag_list': None,
'dmv_auto_show': False,
'is_pgc': False,
'is_matched_metadata': False,
'is_audio_url_with_cookie': False
},
'cha_list': [
{
'cid': '1586907146728461',
'cha_name': '北野武',
'desc': '',
'schema': 'aweme://aweme/challenge/detail?cid=1586907146728461',
'author': {
'followers_detail': None,
'platform_sync_info': None,
'geofencing': None,
'cover_url': None,
'item_list': None,
'new_story_cover': None,
'type_label': None,
'ad_cover_url': None,
'relative_users': None,
'cha_list': None,
'need_points': None,
'homepage_bottom_toast': None,
'can_set_geofencing': None,
'white_cover_url': None,
'user_tags': None
},
'user_count': 0,
'share_info': {
'share_url': 'https://www.iesdouyin.com/share/challenge/1586907146728461/?u_code=0',
'share_weibo_desc': '我在抖音参加#北野武 ',
'share_desc': '在抖音，记录美好生活',
'share_title': '我在抖音参加#北野武 ',
'bool_persist': 0,
'share_title_myself': '',
'share_title_other': '',
'share_signature_url': '',
'share_signature_desc': '',
'share_quote': '',
'share_desc_info': '我在抖音参加#北野武 '
},
'connect_music': [],
'type': 0,
'sub_type': 0,
'is_pgcshow': False,
'collect_stat': 0,
'is_challenge': 0,
'view_count': 0,
'is_commerce': False,
'hashtag_profile': '16dc5000fb378b78418b3',
'cha_attrs': None,
'banner_list': None,
'extra_attr': {
'is_live': False
}
}
],
'video': {
'play_addr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/861b10c6e3e21ad090c9901b8ab7e8fe/5f23d610/video/tos/cn/tos-cn-ve-15/743cdeba27d142959d90a5456da51031/?a=1128&br=5334&bt=1778&cr=3&cs=0&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApM2Y3NGZmZmVlN2VkZjY7OmcwbmI1ZzEzbWJfLS1iLS9zc2NfMmBfY2FjNTM1MTJgNWM6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/910bb57d760c8de1ec6a82c48c0d6f5a/5f23d610/video/tos/cn/tos-cn-ve-15/743cdeba27d142959d90a5456da51031/?a=1128&br=5334&bt=1778&cr=3&cs=0&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApM2Y3NGZmZmVlN2VkZjY7OmcwbmI1ZzEzbWJfLS1iLS9zc2NfMmBfY2FjNTM1MTJgNWM6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h264_540p_1820803',
'data_size': 39107905,
'file_cs': 'c:0-276141-0be7'
},
'cover': {
'uri': 'tos-cn-p-0015/3694493c92834df5bd982a9ed30e2700',
'url_list': [
'https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/3694493c92834df5bd982a9ed30e2700~c5_300x400.jpeg?from=2563711402_large',
'https://p26-dy.byteimg.com/img/tos-cn-p-0015/3694493c92834df5bd982a9ed30e2700~c5_300x400.jpeg?from=2563711402_large',
'https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/3694493c92834df5bd982a9ed30e2700~c5_300x400.jpeg?from=2563711402_large'
],
'width': 720,
'height': 720
},
'height': 1038,
'width': 1920,
'dynamic_cover': {
'uri': 'tos-cn-p-0015/eb68cf6887be48b397330019074bd6d2_1595678183',
'url_list': [
'https://p9-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/eb68cf6887be48b397330019074bd6d2_1595678183?from=2563711402_large',
'https://p1-dy.byteimg.com/obj/tos-cn-p-0015/eb68cf6887be48b397330019074bd6d2_1595678183?from=2563711402_large',
'https://p3-dy.byteimg.com/obj/tos-cn-p-0015/eb68cf6887be48b397330019074bd6d2_1595678183?from=2563711402_large'
],
'width': 720,
'height': 720
},
'origin_cover': {
'uri': 'tos-cn-p-0015/8645bcc2830e4f199b2bba74518d0abb_1595678180',
'url_list': [
'https://p6-dy-ipv6.byteimg.com/tos-cn-p-0015/8645bcc2830e4f199b2bba74518d0abb_1595678180~tplv-dy-360p.jpeg?from=2563711402',
'https://p29-dy.byteimg.com/tos-cn-p-0015/8645bcc2830e4f199b2bba74518d0abb_1595678180~tplv-dy-360p.jpeg?from=2563711402',
'https://p3-dy.byteimg.com/tos-cn-p-0015/8645bcc2830e4f199b2bba74518d0abb_1595678180~tplv-dy-360p.jpeg?from=2563711402'
],
'width': 720,
'height': 720
},
'ratio': '540p',
'download_addr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/14629fb171694fe8d79e24962141fe6c/5f23d610/video/tos/cn/tos-cn-ve-15/74a70acd16a5471882deba044948faeb/?a=1128&br=7527&bt=2509&cr=3&cs=0&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApZGVkaGk3ODtlNzc0PDY4OWcwbmI1ZzEzbWJfLS1iLS9zczUwMV41MjIxLy1jLmMtXmI6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/b47c3cbdc7552b07fac634a01f64f986/5f23d610/video/tos/cn/tos-cn-ve-15/74a70acd16a5471882deba044948faeb/?a=1128&br=7527&bt=2509&cr=3&cs=0&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApZGVkaGk3ODtlNzc0PDY4OWcwbmI1ZzEzbWJfLS1iLS9zczUwMV41MjIxLy1jLmMtXmI6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'data_size': 56154237
},
'has_watermark': True,
'play_addr_lowbr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/861b10c6e3e21ad090c9901b8ab7e8fe/5f23d610/video/tos/cn/tos-cn-ve-15/743cdeba27d142959d90a5456da51031/?a=1128&br=5334&bt=1778&cr=3&cs=0&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApM2Y3NGZmZmVlN2VkZjY7OmcwbmI1ZzEzbWJfLS1iLS9zc2NfMmBfY2FjNTM1MTJgNWM6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/910bb57d760c8de1ec6a82c48c0d6f5a/5f23d610/video/tos/cn/tos-cn-ve-15/743cdeba27d142959d90a5456da51031/?a=1128&br=5334&bt=1778&cr=3&cs=0&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApM2Y3NGZmZmVlN2VkZjY7OmcwbmI1ZzEzbWJfLS1iLS9zc2NfMmBfY2FjNTM1MTJgNWM6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h264_540p_1820803',
'data_size': 39107905,
'file_cs': 'c:0-276141-0be7'
},
'bit_rate': [
{
'gear_name': 'adapt_lowest_720',
'quality_type': 15,
'bit_rate': 1501236,
'play_addr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/2b1a06becde33f8f32944296f9418437/5f23d610/video/tos/cn/tos-cn-ve-15/cd07bafe9d92411cac7e063e55c673d1/?a=1128&br=4398&bt=1466&cr=3&cs=2&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=15&rc=M2s8OHRzeGg0djMzaGkzM0ApNWg1NDU6PGQ4NzQ0aDVoNmcwbmI1ZzEzbWJfLS1iLS9zc2M1YmAwNDRgXmMuNmIwYi06Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/f8a159986f764469c9f2e71c68bc4f71/5f23d610/video/tos/cn/tos-cn-ve-15/cd07bafe9d92411cac7e063e55c673d1/?a=1128&br=4398&bt=1466&cr=3&cs=2&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=15&rc=M2s8OHRzeGg0djMzaGkzM0ApNWg1NDU6PGQ4NzQ0aDVoNmcwbmI1ZzEzbWJfLS1iLS9zc2M1YmAwNDRgXmMuNmIwYi06Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=14&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=14&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h265_720p_1501236',
'data_size': 32244127,
'file_cs': 'c:0-284269-a5aa'
},
'is_h265': 1,
'play_addr_265': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/2b1a06becde33f8f32944296f9418437/5f23d610/video/tos/cn/tos-cn-ve-15/cd07bafe9d92411cac7e063e55c673d1/?a=1128&br=4398&bt=1466&cr=3&cs=2&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=15&rc=M2s8OHRzeGg0djMzaGkzM0ApNWg1NDU6PGQ4NzQ0aDVoNmcwbmI1ZzEzbWJfLS1iLS9zc2M1YmAwNDRgXmMuNmIwYi06Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/f8a159986f764469c9f2e71c68bc4f71/5f23d610/video/tos/cn/tos-cn-ve-15/cd07bafe9d92411cac7e063e55c673d1/?a=1128&br=4398&bt=1466&cr=3&cs=2&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=15&rc=M2s8OHRzeGg0djMzaGkzM0ApNWg1NDU6PGQ4NzQ0aDVoNmcwbmI1ZzEzbWJfLS1iLS9zc2M1YmAwNDRgXmMuNmIwYi06Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=14&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=14&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h265_720p_1501236',
'data_size': 32244127,
'file_cs': 'c:0-284269-a5aa'
}
},
{
'gear_name': 'adapt_540',
'quality_type': 28,
'bit_rate': 1494925,
'play_addr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/ea2f49ef1bc8116f72769b862a186731/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/c4659c6b85a452886e498ac2eb607cbb/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h265_540p_1494925',
'data_size': 32108579,
'file_cs': 'c:0-284245-0381'
},
'is_h265': 1,
'play_addr_265': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/ea2f49ef1bc8116f72769b862a186731/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/c4659c6b85a452886e498ac2eb607cbb/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h265_540p_1494925',
'data_size': 32108579,
'file_cs': 'c:0-284245-0381'
}
}
],
'duration': 171827,
'download_suffix_logo_addr': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/14629fb171694fe8d79e24962141fe6c/5f23d610/video/tos/cn/tos-cn-ve-15/74a70acd16a5471882deba044948faeb/?a=1128&br=7527&bt=2509&cr=3&cs=0&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApZGVkaGk3ODtlNzc0PDY4OWcwbmI1ZzEzbWJfLS1iLS9zczUwMV41MjIxLy1jLmMtXmI6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/b47c3cbdc7552b07fac634a01f64f986/5f23d610/video/tos/cn/tos-cn-ve-15/74a70acd16a5471882deba044948faeb/?a=1128&br=7527&bt=2509&cr=3&cs=0&dr=0&ds=3&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=0&rc=M2s8OHRzeGg0djMzaGkzM0ApZGVkaGk3ODtlNzc0PDY4OWcwbmI1ZzEzbWJfLS1iLS9zczUwMV41MjIxLy1jLmMtXmI6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'data_size': 56154237
},
'has_download_suffix_logo_addr': True,
'play_addr_265': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'http://v1-dy.ixigua.com/ea2f49ef1bc8116f72769b862a186731/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'http://v5-dy.ixigua.com/c4659c6b85a452886e498ac2eb607cbb/5f23d610/video/tos/cn/tos-cn-ve-15/ea940ddf1f064f42bb43ba749a5fd0fa/?a=1128&br=5836&bt=1459&cr=3&cs=2&dr=0&ds=6&er=&l=20200731152509010010023023060948FA&lr=all&mime_type=video_mp4&qs=11&rc=M2s8OHRzeGg0djMzaGkzM0ApN2c7Nzw2NjtkNzo3OWk8O2cwbmI1ZzEzbWJfLS1iLS9zczVjNTI0MjYxYjAzXzQyYTM6Yw%3D%3D&vl=&vr=',
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&h265=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h265_540p_1494925',
'data_size': 32108579,
'file_cs': 'c:0-284245-0381'
},
'is_h265': 0,
'play_addr_h264': {
'uri': 'v0200fee0000bse1pe6u4pjq85e9qh30',
'url_list': [
'https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_PUBLISH',
'https://api.amemv.com/aweme/v1/play/?video_id=v0200fee0000bse1pe6u4pjq85e9qh30&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_PUBLISH'
],
'width': 720,
'height': 720,
'url_key': 'v0200fee0000bse1pe6u4pjq85e9qh30_h264_540p_1820803',
'data_size': 39107905,
'file_cs': 'c:0-276141-0be7'
},
'cdn_url_expired': 0,
'is_long_video': 1,
'animated_cover': {
'uri': 'tos-cn-p-0015/ff2700e4d4a34a2994ab2a2d2c43be9e_1595678181',
'url_list': [
'https://p3-dy.byteimg.com/obj/tos-cn-p-0015/ff2700e4d4a34a2994ab2a2d2c43be9e_1595678181?from=2563711402_large',
'https://p1-dy.byteimg.com/obj/tos-cn-p-0015/ff2700e4d4a34a2994ab2a2d2c43be9e_1595678181?from=2563711402_large',
'https://p29-dy.byteimg.com/obj/tos-cn-p-0015/ff2700e4d4a34a2994ab2a2d2c43be9e_1595678181?from=2563711402_large'
]
},
'need_set_token': False,
'is_callback': True,
'video_model': '',
'tags': None,
'big_thumbs': None
},
'share_url': 'https://www.iesdouyin.com/share/video/6853385491778145550/?region=CN&mid=6853385918674373383&u_code=0&titleType=title',
'user_digged': 0,
'statistics': {
'aweme_id': '6853385491778145550',
'comment_count': 6513,
'digg_count': 284553,
'download_count': 2834,
'play_count': 0,
'share_count': 3036,
'forward_count': 109,
'lose_count': 0,
'lose_comment_count': 0,
'whatsapp_share_count': 0
},
'status': {
'aweme_id': '6853385491778145550',
'is_delete': False,
'allow_share': True,
'allow_comment': True,
'is_private': False,
'with_goods': False,
'private_status': 0,
'with_fusion_goods': False,
'in_reviewing': False,
'reviewed': 1,
'self_see': False,
'is_prohibited': False,
'download_status': 0,
'review_result': {
'review_status': 0
},
'dont_share_status': -1,
'video_hide_search': 0
},
'rate': 12,
'text_extra': [
{
'start': 10,
'end': 14,
'type': 1,
'hashtag_name': '北野武',
'hashtag_id': '1586907146728461',
'is_commerce': False
},
{
'start': 15,
'end': 20,
'type': 1,
'hashtag_name': '影视剪辑',
'hashtag_id': '1585347546644558',
'is_commerce': False
},
{
'start': 21,
'end': 29,
'user_id': '70258503077',
'type': 0,
'sec_uid': 'MS4wLjABAAAAfLsItSD2WiJrsji1g_iZv-it6W2CcvBFkdUwMjTeSD4'
},
{
'start': 30,
'end': 33,
'type': 1,
'hashtag_name': '热门',
'hashtag_id': '1588489879306259',
'is_commerce': False
}
],
'is_top': 1,
'label_top': {
'uri': '729f0000ef991e85fccf',
'url_list': [
'https://p3-dy.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402',
'https://p6-dy-ipv6.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402',
'https://p26-dy.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402'
],
'width': 720,
'height': 720
},
'share_info': {
'share_url': 'https://www.iesdouyin.com/share/video/6853385491778145550/?region=CN&mid=6853385918674373383&u_code=0&titleType=title',
'share_weibo_desc': '#在抖音，记录美好生活#职业S手的基本操作 #北野武 #影视剪辑 @DOU+小助手 #热门',
'share_desc': '在抖音，记录美好生活',
'share_title': '职业S手的基本操作 #北野武 #影视剪辑 @DOU+小助手 #热门',
'bool_persist': 0,
'share_title_myself': '',
'share_title_other': '',
'share_link_desc': '职业S手的基本操作 #北野武 #影视剪辑 @DOU+小助手 #热门 %s 复制此链接，打开【抖音短视频】，直接观看视频！',
'share_signature_url': '',
'share_signature_desc': '',
'share_quote': '',
'share_desc_info': '#在抖音，记录美好生活#职业S手的基本操作 #北野武 #影视剪辑 @DOU+小助手 #热门'
},
'distance': '',
'video_labels': [],
'is_vr': False,
'duration': 171827,
'aweme_type': 0,
'is_fantasy': False,
'cmt_swt': False,
'image_infos': None,
'risk_infos': {
'vote': False,
'warn': False,
'risk_sink': False,
'type': 0,
'content': ''
},
'is_relieve': False,
'sort_label': '',
'position': None,
'uniqid_position': None,
'comment_list': None,
'author_user_id': 2449349262191459,
'bodydance_score': 0,
'geofencing': [],
'is_hash_tag': 1,
'is_pgcshow': False,
'region': '',
'video_text': [],
'vr_type': 0,
'collect_stat': 0,
'label_top_text': None,
'promotions': [],
'group_id': '6853385491778145550',
'prevent_download': False,
'nickname_position': None,
'challenge_position': None,
'item_comment_settings': 0,
'with_promotional_music': False,
'xigua_task': {
'is_xigua_task': False
},
'long_video': None,
'item_duet': 0,
'item_react': 0,
'without_watermark': False,
'desc_language': 'zh',
'interaction_stickers': None,
'ad_link_type': 0,
'origin_comment_ids': None,
'commerce_config_data': None,
'distribute_type': 2,
'video_control': {
'allow_download': True,
'share_type': 1,
'show_progress_bar': 1,
'draft_progress_bar': 1,
'allow_duet': False,
'allow_react': False,
'prevent_download_type': 0,
'allow_dynamic_wallpaper': False,
'timer_status': 1,
'allow_music': True
},
'aweme_control': {
'can_forward': True,
'can_share': True,
'can_comment': True,
'can_show_comment': True
},
'has_vs_entry': False,
'mix_info': {
'mix_id': '6852946217467381773',
'mix_name': '北野武《狂想曲》',
'cover_url': {
'uri': 'tos-cn-i-0813/ef56bbdbeb5b466891fc523ce1786d1b',
'url_list': [
'https://p3-dy-ipv6.byteimg.com/obj/tos-cn-i-0813/ef56bbdbeb5b466891fc523ce1786d1b?from=2563711402',
'https://p9-dy.byteimg.com/obj/tos-cn-i-0813/ef56bbdbeb5b466891fc523ce1786d1b?from=2563711402',
'https://p26-dy.byteimg.com/obj/tos-cn-i-0813/ef56bbdbeb5b466891fc523ce1786d1b?from=2563711402'
],
'width': 720,
'height': 720
},
'status': {
'status': 2,
'is_collected': 0
},
'statis': {
'play_vv': 0,
'collect_vv': 0,
'current_episode': 6,
'updated_to_episode': 9
},
'desc': '脑洞大开一个憨憨',
'extra': '{"first_reviewed":1,"is_quality_mix":0,"next_info":{"cover":"tos-cn-i-0813/ef56bbdbeb5b466891fc523ce1786d1b","desc":"脑洞大开一个憨憨","name":"北野武《狂想曲》"}}',
'share_info': {
'share_url': 'https://www.iesdouyin.com/share/mix/detail/6852946217467381773/?schema_type=24&object_id=6852946217467381773',
'share_weibo_desc': '这么有趣的合集，不能只有我一个人知道吧',
'share_desc': '在抖音，记录美好生活',
'share_title': '这么有趣的合集，不能只有我一个人知道吧',
'share_title_myself': '',
'share_title_other': '',
'share_desc_info': '这么有趣的合集，不能只有我一个人知道吧'
},
'mix_type': 0,
'create_time': 1595575879,
'update_time': 1595756574
},
'commerce_info': {
},
'need_vs_entry': False,
'is_preview': 0,
'anchors': None,
'hybrid_label': None,
'geofencing_regions': None,
'have_dashboard': False,
'poi_patch_info': {
'item_patch_poi_prompt_mark': 0
},
'is_story': 0
},...
],
'extra': {
'now': 1596180309000,
'logid': '20200731152509010010023023060948FA',
'fatal_item_ids': []
},
'log_pb': {
'impr_id': '20200731152509010010023023060948FA'
}
}
提炼数据:
aweme_list.author
‘uid’: 用户user_id
‘short_id’: 搜索ID
‘nickname’: 用户昵称
‘signature’: 用户简介
‘sec_uid’ : sec_uid回调作品列表参数
aweme_list.statistics
‘aweme_id’: 作品id
‘comment_count’: 评论数,
‘digg_count’: 点赞数,
‘download_count’: 下载数,
‘play_count’: 播放数,
‘share_count’: 分享数,
‘forward_count’: 转发数,
其他 字段自行发掘, 有任何问题可私信交流, q: 848434978, 或加扣交流学习
下篇博客: 抖音数据采集之获取抖音cookies(CK), 核心加密技术
总结:
免责声明
请勿使用本服务于商用
请勿使用本服务大量抓取
若因使用本服务与抖音官方造成不必要的纠纷，本人盖不负责
本人纯粹技术爱好，若侵犯抖音贵公司的权益，请告知