爬取 x 夕夕数据时,得到解码错误如何解决

2021-03-06 15:47:39 +08:00
 iscurry

Traceback (most recent call last): File "E:\soft\py\lib\site-packages\urllib3\response.py", line 326, in _decode data = self._decoder.decompress(data) File "E:\soft\py\lib\site-packages\urllib3\response.py", line 77, in decompress ret += self._obj.decompress(data) zlib.error: Error -3 while decompressing data: incorrect header check

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "E:\soft\py\lib\site-packages\requests\models.py", line 750, in generate for chunk in self.raw.stream(chunk_size, decode_content=True): File "E:\soft\py\lib\site-packages\urllib3\response.py", line 492, in stream for line in self.read_chunked(amt, decode_content=decode_content): File "E:\soft\py\lib\site-packages\urllib3\response.py", line 672, in read_chunked decoded = self._decode(chunk, decode_content=decode_content, File "E:\soft\py\lib\site-packages\urllib3\response.py", line 329, in _decode raise DecodeError( urllib3.exceptions.DecodeError: ('Received response with content-encoding: gzip, but failed to decode it.', error('Error -3 while decompressing data: incorrect header check'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:/Users/Administrator/Desktop/tb/tmaddress/pdd/pdd_rate.py", line 44, in <module> zlib.decompress(requests.post(url=url, headers=headers, data=d), 16 + zlib.MAX_WBITS); File "E:\soft\py\lib\site-packages\requests\api.py", line 116, in post return request('post', url, data=data, json=json, **kwargs) File "E:\soft\py\lib\site-packages\requests\api.py", line 60, in request return session.request(method=method, url=url, **kwargs) File "E:\soft\py\lib\site-packages\requests\sessions.py", line 524, in request resp = self.send(prep, **send_kwargs) File "E:\soft\py\lib\site-packages\requests\sessions.py", line 677, in send r.content File "E:\soft\py\lib\site-packages\requests\models.py", line 828, in content self._content = b''.join(self.iter_content(CONTENT_CHUNK_SIZE)) or b'' File "E:\soft\py\lib\site-packages\requests\models.py", line 755, in generate raise ContentDecodingError(e) requests.exceptions.ContentDecodingError: ('Received response with content-encoding: gzip, but failed to decode it.', error('Error -3 while decompressing data: incorrect header check'))

1524 次点击
所在节点    程序员
1 条回复
dvaknheo
2021-03-07 08:58:44 +08:00
标准回答:学爬虫前先学法律

这是一个专为移动设备优化的页面(即为了让你能够在 Google 搜索结果里秒开这个页面),如果你希望参与 V2EX 社区的讨论,你可以继续到 V2EX 上打开本讨论主题的完整版本。

https://www.v2ex.com/t/759063

V2EX 是创意工作者们的社区,是一个分享自己正在做的有趣事物、交流想法,可以遇见新朋友甚至新机会的地方。

V2EX is a community of developers, designers and creative people.

© 2021 V2EX