^Yc@@sdZddlmZddlZddlmZddlmZdZddlmZm Z ddl m Z m Z m Z mZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZyddlZWnek rHeZn Xej Zdd l!m"Z"dd l#m$Z$dd l%m&Z&dd l'm(Z(ydd l)m*Z*Wn!ek rddl)m+Z*nXddl,m-Z-ddl.m/Z/ddl.m0Z0ddl.m1Z1ddl.m2Z2ddl.m3Z3ddl.m4Z4ddl5m6Z6ej7e8Z9ddZ:dZ;dZ<dZ=dZ>dZ?defdYZ@d efd!YZAd"efd#YZBd$eBfd%YZCd&eCfd'YZDd(eCfd)YZEd*efd+YZFd,efd-YZGd.efd/YZHd0efd1YZId2efd3YZJd4efd5YZKd6efd7YZLd8efd9YZMd:ZNd;ZOd<ZPdS(=sClasses to encapsulate a single HTTP request. The classes implement a command pattern, with every object supporting an execute() method that does the actuall HTTP request. i(tabsolute_importN(t http_client(tranges$jcgregorio@google.com (Joe Gregorio)(tBytesIOtStringIO(turlparset urlunparsetquotetunquote(t Generator(t MIMEMultipart(tMIMENonMultipart(t FeedParser(tutil(t_helpers(t mimeparse(t BatchError(t HttpError(tInvalidChunkSizeError(tResumableUploadError(tUnexpectedBodyError(tUnexpectedMethodError(t JsonModeliiiii<cC@s|dkrtS|tkr tS|tjjjkr|s?tSy2tj|j d}|dddd}Wn+t t t fk rt jd|tSXt jd||d krtSntS( sDetermines whether a response should be retried. Args: resp_status: The response status received. content: The response content body. Returns: True if the response should be retried, otherwise False. isutf-8terrorterrorsitreasons&Invalid JSON content from response: %ss*Encountered 403 Forbidden with reason "%s"tuserRateLimitExceededtrateLimitExceeded(RR(tTruet_TOO_MANY_REQUESTStsixtmovesRt FORBIDDENtFalsetjsontloadstdecodetUnicodeDecodeErrort ValueErrortKeyErrortLOGGERtwarning(t resp_statustcontenttdataR((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt_should_retry_responseVs"   c O@sFd } d } x-t|dD]} | dkr~|d| } tjd| | ||||| rj| jn| || ny(d } |j||||\} } WnXtk r}|} n@tjk r}tj j j |j d krn|} nX| r"| |kr| q"qnt | j| sPqqW| | fS( sRetries an HTTP request multiple times while handling errors. If after all retries the request still fails, last error is either returned as return value (for HTTP 5xx errors) or thrown (for ssl.SSLError). Args: http: Http object to be used to execute request. num_retries: Maximum number of retries. req_type: Type of the request (used for logging retries). sleep, rand: Functions to sleep for random time between retries. uri: URI to be requested. method: HTTP method to be used. args, kwargs: Additional arguments passed to http.request. Returns: resp, content - Response from the http request (may be HTTP 5xx). iiisCSleeping %.2f seconds before retry %d of %d for %s: %s %s, after %st WSAETIMEDOUTt ETIMEDOUTtEPIPEt ECONNABORTEDN(R.R/sEPIPEs ECONNABORTED( tNoneRR(R)tstatustrequestt _ssl_SSLErrortsocketRterrnot errorcodetgetR-(thttpt num_retriestreq_typetsleeptrandturitmethodtargstkwargstrespR+t retry_numt sleep_timet exceptiont ssl_errort socket_error((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt_retry_requests6  "     tMediaUploadProgresscB@s eZdZdZdZRS(sStatus of a resumable upload.cC@s||_||_dS(sConstructor. Args: resumable_progress: int, bytes sent so far. total_size: int, total bytes in complete upload, or None if the total upload size isn't known ahead of time. N(tresumable_progresst total_size(tselfRKRL((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt__init__s cC@s1|jdk r)t|jt|jSdSdS(sPercent of upload completed, as a float. Returns: the percentage complete as a float, returning 0.0 if the total size of the upload is unknown. gN(RLR2tfloatRK(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytprogresss(t__name__t __module__t__doc__RNRP(((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRJs tMediaDownloadProgresscB@s eZdZdZdZRS(sStatus of a resumable download.cC@s||_||_dS(sConstructor. Args: resumable_progress: int, bytes received so far. total_size: int, total bytes in complete download. N(RKRL(RMRKRL((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRNs cC@s1|jdk r)t|jt|jSdSdS(sPercent of download completed, as a float. Returns: the percentage complete as a float, returning 0.0 if the total size of the download is unknown. gN(RLR2RORK(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRPs(RQRRRSRNRP(((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRTs t MediaUploadcB@seZdZdZdZdZdZdZdZdZ e j dd d Z d Zed ZRS( sDescribes a media object to upload. Base class that defines the interface of MediaUpload subclasses. Note that subclasses of MediaUpload may allow you to control the chunksize when uploading a media object. It is important to keep the size of the chunk as large as possible to keep the upload efficient. Other factors may influence the size of the chunk you use, particularly if you are working in an environment where individual HTTP requests may have a hardcoded time limit, such as under certain classes of requests under Google App Engine. Streams are io.Base compatible objects that support seek(). Some MediaUpload subclasses support using streams directly to upload data. Support for streaming may be indicated by a MediaUpload sub-class and if appropriate for a platform that stream will be used for uploading the media object. The support for streaming is indicated by has_stream() returning True. The stream() method should return an io.Base object that supports seek(). On platforms where the underlying httplib module supports streaming, for example Python 2.6 and later, the stream will be passed into the http library which will result in less memory being used and possibly faster uploads. If you need to upload media that can't be uploaded using any of the existing MediaUpload sub-class then you can sub-class MediaUpload for your particular needs. cC@s tdS(sOChunk size for resumable uploads. Returns: Chunk size in bytes. N(tNotImplementedError(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt chunksize scC@sdS(s:Mime type of the body. Returns: Mime type. sapplication/octet-stream((RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytmimetypescC@sdS(sZSize of upload. Returns: Size of the body, or None of the size is unknown. N(R2(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytsizescC@stS(s]Whether this upload is resumable. Returns: True if resumable upload or False. (R!(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt resumable!scC@s tdS(sGet bytes from the media. Args: begin: int, offset from beginning of file. length: int, number of bytes to read, starting at begin. Returns: A string of bytes read. May be shorter than length if EOF was reached first. N(RV(RMtbegintend((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytgetbytes)s cC@stS(sDoes the underlying upload support a streaming interface. Streaming means it is an io.IOBase subclass that supports seek, i.e. seekable() returns True. Returns: True if the call to stream() will return an instance of a seekable io.Base subclass. (R!(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt has_stream6s cC@s tdS(sA stream interface to the data being uploaded. Returns: The returned value is an io.IOBase subclass that supports seek, i.e. seekable() returns True. N(RV(RM((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytstreamBsicC@slt|}tj|j}|dk rEx|D] }||=q1Wn|j|d<|j|dReturns an HttpRequest populated with info from a JSON object.RZR?R@RRRN(R"R#R2RURwR(RsR:RRh((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRns     N(RQRRRSR RxR2RNRRRRRkRRn(((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRs + 8 } " tBatchHttpRequestcB@seZdZejdd d dZdZdZdZ dZ dZ dZ ejd d d d Z d Zejdd d ZRS(sjBatches multiple HttpRequest objects into a single HTTP request. Example: from googleapiclient.http import BatchHttpRequest def list_animals(request_id, response, exception): """Do something with the animals list response.""" if exception is not None: # Do something with the exception. pass else: # Do something with the response. pass def list_farmers(request_id, response, exception): """Do something with the farmers list response.""" if exception is not None: # Do something with the exception. pass else: # Do something with the response. pass service = build('farm', 'v2') batch = BatchHttpRequest() batch.add(service.animals().list(), list_animals) batch.add(service.farmers().list(), list_farmers) batch.execute(http=http) icC@sj|dkrd}n||_||_i|_i|_g|_d|_d|_i|_i|_ dS(sConstructor for a BatchHttpRequest. Args: callback: callable, A callback to be called for each response, of the form callback(id, response, exception). The first parameter is the request id, and the second is the deserialized response object. The third is an googleapiclient.errors.HttpError exception object if an HTTP error occurred while processing the request, or None if no error occurred. batch_uri: string, URI to send batch requests to. s https://www.googleapis.com/batchiN( R2t _batch_urit _callbackt _requestst _callbackst_ordert _last_auto_idt_base_idt _responsest_refreshed_credentials(RMRt batch_uri((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyRN5s          cC@sd}|jdk r<t|jjdr<|jjj}n-|dk rit|jdri|jj}n|dk rt||jkr|j|d|jt|N(RR2tuuidtuuid4R(RMtid_((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt _id_to_headerxs cC@s{|ddks |ddkr3td|nd|krRtd|n|dd!jdd\}}t|S(s>Convert a Content-ID header value to an id. Presumes the Content-ID header conforms to the format that _id_to_header() returns. Args: header: string, Content-ID header value. Returns: The extracted id value. Raises: BatchError if the header is not in the expected format. its Invalid value for Content-ID: %st+i(RRR(RMtheadertbaseR((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt _header_to_ids   cC@st|j}tdd|j|j|jdf}|jd|d}|jjddj d\}}t ||}|jj }|j d k rt|j jdr|j jjj|nd|kr|d=nx'tj|D]\} } | || +st applicationR:tbinarysContent-Transfer-Encodings Content-IDt mangle_from_Rsmultipart/mixed; boundary="%s"s content-typeR@RRRi,R?scontent-type: %s sutf-8s'Response not in multipart/mixed format.RCR+N( R tsetattrR RRRtattachRR R!RRt get_boundaryR4RR3RRtPY3R$R RRt is_multipartRt get_payloadRRt isinstancet text_typetencodeR(RMR:tordertrequeststmessageRR4RRRRRRCR+Rt for_parserRt mime_responsetparttresponse((sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pyt_executesJ              c C@svt|jdkrd S|d krbx:|jD],}|j|}|d k r/|j}Pq/q/Wn|d kr}tdnt|jdd d k r|jj}t|dd st j d|j |qn|j ||j|ji}g}xk|jD]`}|j |\}}|ddkr|j||j|}|j|||||R?((R=R>sF/tmp/pip-build-kpPAdC/google-api-python-client/googleapiclient/http.pytset_user_agentzs    c@s7|jdddtjdfd}||_|S(sTunnel PATCH requests over POST. Args: http - An instance of httplib2.Http or something that acts like it. Returns: A modified instance of http that was passed in. Example: h = httplib2.Http() h = tunnel_patch(h, "my-app-name/6.0") Useful if you are running on a platform that doesn't support PATCH. Apply this last if you are using OAuth 1.0, as changing the method will result in a different signature. Rc@s|dkri}n|dkr\d|jddkrItjdnd|ds "                   + 8}C\(7 I&7 ( )