Requests06.设置超时时间

如果服务器响应时间过长,导致requests长时间持续请求。可以使用timeout来指定超时时间,当响应超过指定的时间后,将抛出Timeout异常。
requests设置超时时间包括两部分:

  1. 连接超时时间
    连接时间指的是在requests请求服务器,并与服务器相连接所花费的时间。
  2. 读取超时时间
    读取时间指的是在请求与服务器连接后,服务器处理业务逻辑并将数据返回至客户端所花费的时间。

requests的timeout参数有三种传入方式:

  1. 单值传入
    单纯地传入一个数字,用于指定总的超时时间(单位:秒),该超时时间包括连接超时时间和读取超时时间。若在指定的超时时间内,requests在连接阶段,将抛出requests.exceptions.ConnectTimeout异常;requests在读取阶段,将抛出requests.exceptions.ReadTimeout异常。
  • 连接超时异常:
import requests

if __name__ == '__main__':
    r = requests.post("http://httpbin.org/post", timeout=0.3)

设置超时时间为0.3秒,若在0.3秒内请求未能与服务器连接成功,将输出:

Traceback (most recent call last):
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connection.py", line 160, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\util\connection.py", line 80, in create_connection
    raise err
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\util\connection.py", line 70, in create_connection
    sock.connect(sa)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 603, in urlopen
    chunked=chunked)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 355, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "D:\DevSoftware\python\lib\http\client.py", line 1244, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "D:\DevSoftware\python\lib\http\client.py", line 1290, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "D:\DevSoftware\python\lib\http\client.py", line 1239, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "D:\DevSoftware\python\lib\http\client.py", line 1026, in _send_output
    self.send(msg)
  File "D:\DevSoftware\python\lib\http\client.py", line 966, in send
    self.connect()
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connection.py", line 183, in connect
    conn = self._new_conn()
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connection.py", line 165, in _new_conn
    (self.host, self.timeout))
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x000001A621139E08>, 'Connection to httpbin.org timed out. (connect timeout=0.3)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\adapters.py", line 449, in send
    timeout=timeout
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 641, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\util\retry.py", line 399, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='httpbin.org', port=80): Max retries exceeded with url: /post (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x000001A621139E08>, 'Connection to httpbin.org timed out. (connect timeout=0.3)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:/git_res/autotest/requests_easy/getweb.py", line 4, in <module>
    r = requests.post("http://httpbin.org/post", timeout=0.3)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\api.py", line 116, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\adapters.py", line 504, in send
    raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='httpbin.org', port=80): Max retries exceeded with url: /post (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x000001A621139E08>, 'Connection to httpbin.org timed out. (connect timeout=0.3)'))

Process finished with exit code 1

可以看到最后抛出requests.exceptions.ConnectTimeout异常。

  • 读取超时异常
import requests

if __name__ == '__main__':
    r = requests.post("http://httpbin.org/post", timeout=0.35)

设置超时时间为0.35秒,若在此时间内已完成与服务器的连接,但未完成服务器的响应,将输出:

Traceback (most recent call last):
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 387, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 383, in _make_request
    httplib_response = conn.getresponse()
  File "D:\DevSoftware\python\lib\http\client.py", line 1336, in getresponse
    response.begin()
  File "D:\DevSoftware\python\lib\http\client.py", line 306, in begin
    version, status, reason = self._read_status()
  File "D:\DevSoftware\python\lib\http\client.py", line 267, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "D:\DevSoftware\python\lib\socket.py", line 589, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\adapters.py", line 449, in send
    timeout=timeout
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 641, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\util\retry.py", line 368, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\packages\six.py", line 686, in reraise
    raise value
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 603, in urlopen
    chunked=chunked)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 389, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\urllib3\connectionpool.py", line 307, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='httpbin.org', port=80): Read timed out. (read timeout=0.35)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:/git_res/autotest/requests_easy/getweb.py", line 4, in <module>
    r = requests.post("http://httpbin.org/post", timeout=0.35)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\api.py", line 116, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "D:\git_res\autotest\requests_easy\venv\lib\site-packages\requests\adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPConnectionPool(host='httpbin.org', port=80): Read timed out. (read timeout=0.35)

Process finished with exit code 1

可以看到,若在读取阶段超时,会抛出requests.exceptions.ReadTimeout异常。
2.元组传入
元组方式是对单值方式的一种细化,能够分别针对连接和读取阶段设置超时时间。如timeout=(0.3, 0.1),元组内第一个值为连接超时时间,第二个值为读取超时时间:

import requests

if __name__ == '__main__':
    r = requests.post("http://httpbin.org/post", timeout=(0.3, 0.1))

requests在连接阶段若超出连接超时时间,将抛出requests.exceptions.ConnectTimeout异常;requests在读取阶段若超出读取超时时间,将抛出requests.exceptions.ReadTimeout异常。

3.None
默认的传入方式。当不设置timeout参数,或者指定timeout=None,request将不限制超时时间,直到服务器响应数据,requests会持续等待。传入方式:

import requests

if __name__ == '__main__':
    r = requests.post("http://httpbin.org/post", timeout=None)
最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
  • 序言:七十年代末,一起剥皮案震惊了整个滨河市,随后出现的几起案子,更是在滨河造成了极大的恐慌,老刑警刘岩,带你破解...
    沈念sama阅读 218,386评论 6 506
  • 序言:滨河连续发生了三起死亡事件,死亡现场离奇诡异,居然都是意外死亡,警方通过查阅死者的电脑和手机,发现死者居然都...
    沈念sama阅读 93,142评论 3 394
  • 文/潘晓璐 我一进店门,熙熙楼的掌柜王于贵愁眉苦脸地迎上来,“玉大人,你说我怎么就摊上这事。” “怎么了?”我有些...
    开封第一讲书人阅读 164,704评论 0 353
  • 文/不坏的土叔 我叫张陵,是天一观的道长。 经常有香客问我,道长,这世上最难降的妖魔是什么? 我笑而不...
    开封第一讲书人阅读 58,702评论 1 294
  • 正文 为了忘掉前任,我火速办了婚礼,结果婚礼上,老公的妹妹穿的比我还像新娘。我一直安慰自己,他们只是感情好,可当我...
    茶点故事阅读 67,716评论 6 392
  • 文/花漫 我一把揭开白布。 她就那样静静地躺着,像睡着了一般。 火红的嫁衣衬着肌肤如雪。 梳的纹丝不乱的头发上,一...
    开封第一讲书人阅读 51,573评论 1 305
  • 那天,我揣着相机与录音,去河边找鬼。 笑死,一个胖子当着我的面吹牛,可吹牛的内容都是我干的。 我是一名探鬼主播,决...
    沈念sama阅读 40,314评论 3 418
  • 文/苍兰香墨 我猛地睁开眼,长吁一口气:“原来是场噩梦啊……” “哼!你这毒妇竟也来了?” 一声冷哼从身侧响起,我...
    开封第一讲书人阅读 39,230评论 0 276
  • 序言:老挝万荣一对情侣失踪,失踪者是张志新(化名)和其女友刘颖,没想到半个月后,有当地人在树林里发现了一具尸体,经...
    沈念sama阅读 45,680评论 1 314
  • 正文 独居荒郊野岭守林人离奇死亡,尸身上长有42处带血的脓包…… 初始之章·张勋 以下内容为张勋视角 年9月15日...
    茶点故事阅读 37,873评论 3 336
  • 正文 我和宋清朗相恋三年,在试婚纱的时候发现自己被绿了。 大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
    茶点故事阅读 39,991评论 1 348
  • 序言:一个原本活蹦乱跳的男人离奇死亡,死状恐怖,灵堂内的尸体忽然破棺而出,到底是诈尸还是另有隐情,我是刑警宁泽,带...
    沈念sama阅读 35,706评论 5 346
  • 正文 年R本政府宣布,位于F岛的核电站,受9级特大地震影响,放射性物质发生泄漏。R本人自食恶果不足惜,却给世界环境...
    茶点故事阅读 41,329评论 3 330
  • 文/蒙蒙 一、第九天 我趴在偏房一处隐蔽的房顶上张望。 院中可真热闹,春花似锦、人声如沸。这庄子的主人今日做“春日...
    开封第一讲书人阅读 31,910评论 0 22
  • 文/苍兰香墨 我抬头看了看天上的太阳。三九已至,却和暖如春,着一层夹袄步出监牢的瞬间,已是汗流浃背。 一阵脚步声响...
    开封第一讲书人阅读 33,038评论 1 270
  • 我被黑心中介骗来泰国打工, 没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留,地道东北人。 一个月前我还...
    沈念sama阅读 48,158评论 3 370
  • 正文 我出身青楼,却偏偏与公主长得像,于是被迫代替她去往敌国和亲。 传闻我的和亲对象是个残疾皇子,可洞房花烛夜当晚...
    茶点故事阅读 44,941评论 2 355

推荐阅读更多精彩内容