本文共 1445 字，大约阅读时间需要 4 分钟。

我已拿到从16年至今此网站能提供的城市迁徙大数据，请自行确认自己想要的城市此网站是否提供，部分三四线城市不提供

爬取简单思路：

import osfrom datetime import datetime, timedeltaimport requestsfrom utils.read_write import writeOneJsonfrom utils.time_change import getBetweenDayos.chdir(r'D:\data\高德迁徙\迁徙意愿json\\')headers = {
   "User-agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 "                         "(KHTML, like Gecko) Chrome/49.0.2623.221 Safari/537.36 SE 2.X MetaSr 1.0"}# 发送请求def requerts_url(url, riqi):    try:        response = requests.get(url, timeout=1000, headers=headers)        json = eval(response.text)        writeOneJson(json, riqi + ".json")    except Exception as e:        print(datetime.now())        print(e)        print(url)        begin_date = datetime.strptime(riqi, "%Y-%m-%d")        begin_date += timedelta(days=1)        date_change(riqi)city_list = []# 先将数据下载为Json文件def city_range(riqi):    file = "城市迁徙意愿_" + "_" + riqi + ".json"    if not os.path.exists(file):        firsturl = "https://trp.autonavi.com/cityTravel/line.do?adcode=100000&dt={}&willReal=WILL&size=200".format(riqi)        requerts_url(firsturl, riqi)def date_change(date):    date_list = getBetweenDay(date)    for riqi in date_list:        print(riqi)        city_range(riqi)if __name__ == '__main__':    date_change('2019-01-01')

喜欢请一键三连

转载地址：https://data-mining.blog.csdn.net/article/details/111573389 如侵犯您的版权，请留言回复原文章的地址，我们会给您删除此文章，给您带来不便请您谅解！