ProPeler
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
opt
/
cpanel-ccs
/
txweb2
/
Filename :
stream.pyc
back
Copy
� �t�ac @ s� d Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z m Z d d l m Z d d l m Z m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z e � Z e j d d !dC k r&y d d l Z Wq,e k r"d Z q,Xn d Z d e f d � � YZ" d e" f d � � YZ# d e f d � � YZ$ d e% f d � � YZ& dE Z' dF Z( d Z) d Z* d � Z+ d e& f d � � YZ, e j- e, e. e# � d e& f d � � YZ/ e j- e/ e0 e# � e j- e/ e j1 e# � d e% f d! � � YZ2 d" e% f d# � � YZ3 d$ � Z4 d% � Z5 d& � Z6 d' � Z7 d( � Z8 d) e% f d* � � YZ9 d+ e% f d, � � YZ: d- e% f d. � � YZ; d/ e% f d0 � � YZ< d1 e j= f d2 � � YZ> d3 e% f d4 � � YZ? d5 e% f d6 � � YZ@ d7 e% f d8 � � YZA d9 � ZB d: e% f d; � � YZC d< e& f d= � � YZD d d d d d d> d? d- d/ d: d< d@ d3 dA dB g ZE d S(G s� The stream module provides a simple abstraction of streaming data. While Twisted already has some provisions for handling this in its Producer/Consumer model, the rather complex interactions between producer and consumer makes it difficult to implement something like the CompoundStream object. Thus, this API. The IStream interface is very simple. It consists of two methods: read, and close. The read method should either return some data, None if there is no data left to read, or a Deferred. Close frees up any underlying resources and causes read to return None forevermore. IByteStream adds a bit more to the API: 1) read is required to return objects conforming to the buffer interface. 2) .length, which may either an integer number of bytes remaining, or None if unknown 3) .split(position). Split takes a position, and splits the stream in two pieces, returning the two new streams. Using the original stream after calling split is not allowed. There are two builtin source stream classes: FileStream and MemoryStream. The first produces data from a file object, the second from a buffer in memory. Any number of these can be combined into one stream with the CompoundStream object. Then, to interface with other parts of Twisted, there are two transcievers: StreamProducer and ProducerStream. The first takes a stream and turns it into an IPushProducer, which will write to a consumer. The second is a consumer which is a stream, so that other producers can write to it. i����( t generatorsN( t Interfacet Attributet implements( t Deferred( t interfacest defert reactort protocolt error( t components( t Failure( t md5( t Loggeri i i i t IStreamc B s e Z d Z d � Z d � Z RS( s A stream of arbitrary data.c C s d S( s Read some data. Returns some object representing the data. If there is no more data available, returns None. Can also return a Deferred resulting in one of the above. Errors may be indicated by exception or by a Deferred of a Failure. N( ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyt read[ t c C s d S( sJ Prematurely close. Should also cause further reads to return None.N( ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyt closee R ( t __name__t __module__t __doc__R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR X s t IByteStreamc B s5 e Z d Z e d � Z d � Z d � Z d � Z RS( s A stream which is of bytes.s8 How much data is in this stream. Can be None if unknown.c C s d S( s# Read some data. Returns an object conforming to the buffer interface, or if there is no more data available, returns None. Can also return a Deferred resulting in one of the above. Errors may be indicated by exception or by a Deferred of a Failure. N( ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR o R c C s d S( sa Split this stream into two, at byte position 'point'. Returns a tuple of (before, after). After calling split, no other methods should be called on this stream. Doing so will have undefined behavior. If you cannot implement split easily, you may implement it as:: return fallbackSplit(self, point) N( ( t point( ( s /opt/cpanel-ccs/txweb2/stream.pyt splitx R c C s d S( s� Prematurely close this stream. Should also cause further reads to return None. Additionally, .length should be set to 0. N( ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � R ( R R R R t lengthR R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR j s t ISendfileableStreamc B s e Z e d � Z RS( c C s d S( s� Read some data. If sendfile == False, returns an object conforming to the buffer interface, or else a Deferred. If sendfile == True, returns either the above, or a SendfileBuffer. N( ( t sendfile( ( s /opt/cpanel-ccs/txweb2/stream.pyR � R ( R R t FalseR ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s t SimpleStreamc B s? e Z d Z e e � d Z d Z d � Z d � Z d � Z RS( s_ Superclass of simple streams with a single buffer and a offset and length into that buffer.c C s d S( N( t None( t self( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s d | _ d S( Ni ( R ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s� | j d k r= | | j k r= t d | | j f � � q= n t j | � } | | _ | j d k rv | j | 8_ n | j | 7_ | | f S( Ns split point (%d) > length (%d)( R R t ValueErrort copyt start( R R t b( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s N( R R R R R R R R! R R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s i i i i c O sV | j d d � } | d k r7 d | k rF | d =qF n t j d � � t j | | � S( s� Python's mmap call sucks and ommitted the "offset" argument for no discernable reason. Replace this with a mmap module that has offset. t offseti s/ mmap: Python sucks and does not support offset.N( Ni ( t getR t mmapR ( t argst kwargsR# ( ( s /opt/cpanel-ccs/txweb2/stream.pyt mmapwrapper� s t FileStreamc B sW e Z e e � d d d d Z d Z d d e e � d � Z e d � Z d � Z RS( i i i c C sR | | _ | | _ | d k r< t j | j � � j | _ n | | _ | | _ d S( s| Create the stream from file f. If you specify start and length, use only that portion of the file. N( t fR! R t ost fstatt filenot st_sizeR t useMMap( R R* R! R R/ ( ( s /opt/cpanel-ccs/txweb2/stream.pyt __init__� s c C sN | j d k r d S| j } | d k r5 d | _ d S| j r� | t k r� t | t � } yP t | j j � | d t j d | j �} | j | 8_ | j | 7_ | SWq� t j k r� q� Xn t | | j � } | j j | j � | j j | � } t | � } | s(t d | j | f � � n" | j | 8_ | j | 7_ | Sd S( Ni t accessR# s7 Ran out of data reading file %r, expected %d more bytes( R* R R R/ t MMAP_THRESHOLDt mint MMAP_LIMITR( R- R% t ACCESS_READR! R t CHUNK_SIZEt seekR t lent RuntimeError( R R R t readSizet resR" t bytesRead( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s2 c C s d | _ t j | � d S( N( R R* R R ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR s i N( R R R R R6 R R* t boolR% R0 R R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR) � s ,t MemoryStreamc B s/ e Z d Z d d d � Z d � Z d � Z RS( s. A stream that reads data from a buffer object.i c C sb | | _ | | _ | d k r4 t | � | | _ n* t | � | k rU t d � � n | | _ d S( s� Create the stream from buffer object mem. If you specify start and length, use only that portion of the buffer. s len(mem) < start + lengthN( t memR! R R8 R R ( R R? R! R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 s c C s\ | j d k r d S| j d k r+ d } n t | j | j | j � } d | _ d | _ | S( Ni ( R? R R t bufferR! ( R t result( ( s /opt/cpanel-ccs/txweb2/stream.pyR + s c C s d | _ t j | � d S( N( R R? R R ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR 6 s N( R R R R R0 R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR> s t CompoundStreamc B sl e Z d Z e e e � d Z d Z d d � Z d � Z e d � Z d � Z d � Z d � Z d � Z RS( s] A stream which is composed of many other streams. Call addStream to add substreams. i c C s& g | D] } t | � ^ q | _ d S( N( R t buckets( R RC t s( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 L s c C s_ t | � } | j j | � | j d k r[ | j d k rF d | _ q[ | j | j 7_ n d S( s Add a stream to the outputN( R RC t appendR R ( R t bucket( ( s /opt/cpanel-ccs/txweb2/stream.pyt addStreamO s c C s� | j d k r t d � � n | j s+ d S| r{ t j | j d � r{ y | j d j | � } Wq� | j t � � SXn. y | j d j � } Wn | j t � � SXt | t � r� | | _ | j | j | j | f � | S| j | | � S( Ns. Call to read while read is already outstandingi ( t deferredR R9 RC R t providedByR t _gotFailureR t isinstanceR t addCallbackst _gotRead( R R RA ( ( s /opt/cpanel-ccs/txweb2/stream.pyR Y s$ c C s! d | _ | j d =| j � | S( Ni ( R RH RC R ( R R* ( ( s /opt/cpanel-ccs/txweb2/stream.pyRJ r s c C sW d | _ | d k r, | j d =| j | � S| j d k rS | j t | � 8_ n | S( Ni ( R RH RC R R R8 ( R RA R ( ( s /opt/cpanel-ccs/txweb2/stream.pyRM x s c C s� d } | } x� | j D]� } | d 7} | d k r_ t � } | j | | _ | j | 3| | f S| j d k r{ t | | � S| | j k r� | j | � \ } } t � } | j | | _ | | j d <| j | d 3| | j | <| | f S| | j 8} q Wd S( Ni i ( RC RB R R t fallbackSplitR ( R R t numt origPointRF R" t beforet after( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s( c C s4 x | j D] } | j � q Wg | _ d | _ d S( Ni ( RC R R ( R RF ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s N( ( R R R R R R R RH R R0 RG R R RJ RM R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyRB B s t _StreamReaderc B s; e Z d Z d � Z d � Z d � Z d � Z d � Z RS( sC Process a stream's data using callbacks for data and stream finish.c C s" | | _ | | _ t � | _ d S( N( t streamt gotDataCallbackR RA ( R RT RU ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 � s c C s | j } | j � | S( N( RA t _read( R RA ( ( s /opt/cpanel-ccs/txweb2/stream.pyt run� s c C sg y | j j � } Wn | j t � � d SXt | t � rV | j | j | j � n | j | � d S( N( RT R t _gotErrorR RK R RL t _gotData( R RA ( ( s /opt/cpanel-ccs/txweb2/stream.pyRV � s c C s, | j } | ` | ` | ` | j | � d S( N( RA RU RT t errback( R t failureRA ( ( s /opt/cpanel-ccs/txweb2/stream.pyRX � s c C s{ | d k r8 | j } | ` | ` | ` | j d � d Sy | j | � Wn | j t � � d SXt j d | j � d S( Ni ( R RA RU RT t callbackRX R R t callLaterRV ( R t dataRA ( ( s /opt/cpanel-ccs/txweb2/stream.pyRY � s ( R R R R0 RW RV RX RY ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyRS � s c C s t | | � j � S( s� Pass a stream's data to a callback. Returns Deferred which will be triggered on finish. Errors in reading the stream or in processing it will be returned via this Deferred. ( RS RW ( RT RU ( ( s /opt/cpanel-ccs/txweb2/stream.pyt readStream� s c C s t | d � � S( sx Read all the data from the given stream, and throw it out. Returns Deferred which will be triggered on finish. c S s d S( N( R ( t _( ( s /opt/cpanel-ccs/txweb2/stream.pyt <lambda>� R ( R_ ( RT ( ( s /opt/cpanel-ccs/txweb2/stream.pyt readAndDiscard� s c s( � f d � } t | � j � j | � S( se Read a stream and write it into a file. Returns Deferred which will be triggered on finish. c s � j � | S( N( R ( R` ( t outFile( s /opt/cpanel-ccs/txweb2/stream.pyt done� s ( R_ t writet addBoth( RT Rc Rd ( ( Rc s /opt/cpanel-ccs/txweb2/stream.pyt readIntoFile� s c sf | j d � � t � } t | _ � j | � t | � f d � � j � f d � � f d � � | S( s� Connect a protocol constructed from a factory to stream. Returns an output stream from the protocol. The protocol's transport will have a finish() method it should call when done writing. c s � j | � S( N( t dataReceived( R` ( t p( s /opt/cpanel-ccs/txweb2/stream.pyRa R c s � j t j � � S( N( t connectionLostt ti_errort ConnectionDone( R` ( Ri ( s /opt/cpanel-ccs/txweb2/stream.pyRa R c s � j | � S( N( Rj ( R` ( Ri ( s /opt/cpanel-ccs/txweb2/stream.pyRa R N( t buildProtocolR t ProducerStreamR t disconnectingt makeConnectionR_ RL ( t inputStreamt factoryt out( ( Ri s /opt/cpanel-ccs/txweb2/stream.pyt connectStream� s c C s+ t | | � } t | | | � } | | f S( N( t PostTruncaterStreamt TruncaterStream( RT R RR RQ ( ( s /opt/cpanel-ccs/txweb2/stream.pyRN s Rv c B s5 e Z d � Z d � Z d � Z d � Z d � Z RS( c C s | | _ | | _ | | _ d S( N( RT R t postTruncater( R RT R Rw ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 s c C s� | j d k rV | j d k rI | j } d | _ | j | j j � � n d | _ d S| j j � } t | t � r� | j | j � S| j | � Sd S( Ni ( R Rw R t sendInitialSegmentRT R RK R t addCallbackRM ( R Rw RA ( ( s /opt/cpanel-ccs/txweb2/stream.pyR s c C s� | d k r t d � � n | j t | � k rI | j t | � 8_ | St | d | j � } t | | j � } d | _ | j d k r� | j } d | _ | j | � d | _ n | Sd S( Ns< Ran out of data for a split of a indeterminate length sourcei ( R R R R8 R@ Rw Rx RT ( R R^ RQ RR Rw ( ( s /opt/cpanel-ccs/txweb2/stream.pyRM & s c C su | | j k r+ t d | | j f � � n t | j | � } t | | j | | j � } | | _ | | _ | | f S( Ns split point (%d) > length (%d)( R R Ru RT Rv Rw ( R R t postt trunc( ( s /opt/cpanel-ccs/txweb2/stream.pyR 7 s c C sE | j d k r" | j j | � n | j j � d | _ d | _ d S( Ni ( Rw R t notifyClosedRT R R ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR A s ( R R R0 R RM R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyRv s Ru c B s\ e Z d Z e Z d Z e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z RS( c C s; | | _ t � | _ | j d k r7 | j | | _ n d S( N( RT R RH R R ( R RT R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 S s c C sN | j sA t | _ | j d k r: t | j � d | _ n | j S| j j � S( N( t sentInitialSegmentt Truet truncaterClosedR Rb RH RT R ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR Y s c C s t | | � S( N( RN ( R R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR c s c C sZ t | _ | j d k r4 d | j _ | j j � n | j rM | j j � n d | _ d S( N( R~ t closedR R Rw R R} RT RH ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR f s c C sj | j r" | j j � d | _ n | j d k rf t | t � rS | j | j � qf | j j | � n d S( N( R� RT R R RH RK R t chainDeferredR\ ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyRx s s c C sB | j r d | _ | j � n | j r5 t | � n | | _ d S( N( R� R Rw R R} Rb R ( R t truncater( ( s /opt/cpanel-ccs/txweb2/stream.pyR| ~ s N( R R R RH R R} R R� R R0 R R R Rx R| ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyRu K s Rn c B s� e Z d Z e e e j � d Z e Z e Z d Z e Z d Z d Z d d � Z d � Z d � Z d � Z d � Z d d � Z d � Z d � Z RS( sS Turns producers into a IByteStream. Thus, implements IConsumer and IByteStream.i c C s g | _ | | _ d S( N( R@ R ( R R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 � s c C s� | j r | j j d � S| j rT d | _ | j rP | j } | ` t j | � Sd St � } | _ | j d k r� | j s� | j r� t | _ | j j � n | Sd S( Ni ( R@ t popR� R t failedR[ R t failR R RH t producert streamingProducert producerPausedR t resumeProducing( R R* RH ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s " c C s t | | � S( N( RN ( R R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C sG g | _ t | _ | j d k r: | j j � d | _ n d | _ d S( s3 Called by reader of stream when it is done reading.N( R@ R~ R� R� R t stopProducingRH ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s� | j r d S| j r8 | j } d | _ | j | � nY | j j | � | j d k r� | j r� t | j � | j k r� | j j � t | _ n d S( N( R� RH R R\ R@ RE R� R� R8 t bufferSizet pauseProducingR~ R� ( R R^ RH ( ( s /opt/cpanel-ccs/txweb2/stream.pyRe � s 0 c C s� t | _ | j s d | _ n | j d k rt | j } d | _ | d k rd t | _ | j | � q� | j d � n! | d k r� t | _ | | _ n d S( s� Called by producer when it is done. If the optional failure argument is passed a Failure instance, the stream will return it as errback on next Deferred. i N( R~ R� R@ R RH R R� RZ R\ R[ ( R R[ RH ( ( s /opt/cpanel-ccs/txweb2/stream.pyt finish� s c C sj | j d k r+ t d | | j f � � n | j rA | j � n% | | _ | | _ | sf | j � n d S( NsH Cannot register producer %s, because producer %s was never unregistered.( R� R R9 R� R� R� R� ( R R� t streaming( ( s /opt/cpanel-ccs/txweb2/stream.pyt registerProducer� s c C s d | _ d S( N( R R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt unregisterProducer� s N( R R R R R t ti_interfacest IConsumerR R R R� R� R� R� RH R� R0 R R R Re R� R� R� ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyRn � s" t StreamProducerc B su e Z d Z e e j � d Z d Z e Z d Z e d � Z d � Z d � Z d � Z d � Z e j � d � Z RS( s8 A push producer which gets its data by reading a stream.c C s | | _ | | _ d S( N( RT t enforceStr( R RT R� ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 � s c C sV | j d k r t j d � S| | _ t � } | _ | j j | t � | j � | S( N( RT R R t succeedt consumerR t finishedCallbackR� R~ R� ( R R� R� ( ( s /opt/cpanel-ccs/txweb2/stream.pyt beginProducing s c C s� t | _ | j d k r d Sy | j j � } Wn | j t � � d SXt | t � r~ | | _ | j j | j | j � n | j | � d S( N( R t pausedRH R RT R R� R RK R RL t _doWrite( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� s c C s� | j d k r d S| d k r� | j d k r> | j j � n | j d k r` | j j d � n d | _ | _ | _ | _ d Sd | _ | j r� t t | � � } n | j j | � | j s� | j � n d S( N( R� R R� R� R\ RH RT R� t strR@ Re R� R� ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� s c C s t | _ d S( N( R~ R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� 2 s c C s� | j d k r | j j � n | j d k ri | d k rM | j j | � n | j j d � d | _ n t | _ | j d k r� | j j � n d | _ | _ | _ | _ d S( N( R� R R� R� RZ R\ R~ R� RT R RH ( R R[ ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� 5 s N( R R R R R� t IPushProducerR RH R� R R� R� R~ R0 R� R� R� R� Rk t ConnectionLostR� ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� � s t _ProcessStreamerProtocolc B sP e Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( c C s. | | _ | | _ | | _ t j � | _ d S( N( Rq t outStreamt errStreamR R t resultDeferred( R Rq R� R� ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 K s c sV t � j � � d � f d � � _ � j � j � } | j � f d � � j � d S( Nc s t j � | � S( N( R� R� ( t err( Ri ( s /opt/cpanel-ccs/txweb2/stream.pyRa V R c s � j j � S( N( t transportt closeStdin( R` ( R ( s /opt/cpanel-ccs/txweb2/stream.pyRa Y R ( R� Rq R R� R� R� RL t _inputError( R t d( ( Ri R s /opt/cpanel-ccs/txweb2/stream.pyt connectionMadeQ s c C s* t j d | d | j �| j j � d S( Ns/ Error in input stream for transport {transport}R� ( t logR[ R� R� ( R R* ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� \ s c C s | j j | � d S( N( R� Re ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyt outReceived` s c C s | j j | � d S( N( R� Re ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyt errReceivedc s c C s | j j � d S( N( R� R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt outConnectionLostf s c C s | j j � d S( N( R� R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt errConnectionLosti s c C s | j j | � | ` d S( N( R� RZ ( R t reason( ( s /opt/cpanel-ccs/txweb2/stream.pyt processEndedl s ( R R R0 R� R� R� R� R� R� R� ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� I s t ProcessStreamerc B s# e Z d Z i d � Z d � Z RS( s� Runs a process hooked up to streams. Requires an input stream, has attributes 'outStream' and 'errStream' for stdout and stderr. outStream and errStream are public attributes providing streams for stdout and stderr of the process. c C sX t � | _ t � | _ t t | � | j | j � | _ | | _ | | _ | | _ d S( N( Rn R� R� R� R t _protocolt _programt _argst _env( R Rq t programR& t env( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 { s ! c C sA t j | j | j | j d | j �| ` | j j j d � � S( s� Run the process. Returns Deferred which will eventually have errback for non-clean (exit code > 0) exit, with ProcessTerminated, or callback with None on exit code 0. R� c S s | j t j � S( N( t trapRk t ProcessDone( R` ( ( s /opt/cpanel-ccs/txweb2/stream.pyRa � R ( R t spawnProcessR� R� R� R� R� t addErrback( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyRW � s %( R R R R0 RW ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� q s t _StreamIteratorc B s) e Z e Z d � Z d � Z e � Z RS( c C s | S( N( ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt __iter__� s c C s | j r t � n | j S( N( Rd t StopIterationt value( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt next� s ( R R R Rd R� R� t objectt wait( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� � s t _IteratorStreamc B s; e Z d Z d � Z d � Z d � Z d � Z d � Z RS( c C s1 | | _ t � | _ | | j | | � | _ d S( N( t _streamR� t _streamIteratort _gen( R t funRT R& R' ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 � s c C s� y | j j � } Wn t k r' d SX| t j k rx | j j � } t | t j � rh | j | j � S| j | � Sn | Sd S( N( R� R� R� R R� R� R� R RK R R Ry RM ( R t valt newdata( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s1 | d k r t | j _ n | | j _ | j � S( N( R R~ R� Rd R� R ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyRM � s c C s# | j j � | ` | ` | ` d S( N( R� R R� R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s t | � S( N( RN ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s N( R R R R R0 R RM R R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� � s c s � f d � } | S( s� Converts a generator function into a stream. The function should take an iterator as its first argument, which will be converted *from* a stream by this wrapper, and yield items which are turned *into* the results from the stream's 'read' call. One important point: before every call to input.next(), you *MUST* do a "yield input.wait" first. Yielding this magic value takes care of ensuring that the input is not a deferred before you see it. >>> from txweb2 import stream >>> from string import maketrans >>> alphabet = 'abcdefghijklmnopqrstuvwxyz' >>> >>> def encrypt(input, key): ... code = alphabet[key:] + alphabet[:key] ... translator = maketrans(alphabet+alphabet.upper(), code+code.upper()) ... yield input.wait ... for s in input: ... yield str(s).translate(translator) ... yield input.wait ... >>> encrypt = stream.generatorToStream(encrypt) >>> >>> plaintextStream = stream.MemoryStream('SampleSampleSample') >>> encryptedStream = encrypt(plaintextStream, 13) >>> encryptedStream.read() 'FnzcyrFnzcyrFnzcyr' >>> >>> plaintextStream = stream.MemoryStream('SampleSampleSample') >>> encryptedStream = encrypt(plaintextStream, 13) >>> evenMoreEncryptedStream = encrypt(encryptedStream, 13) >>> evenMoreEncryptedStream.read() 'SampleSampleSample' c s t � | | | � S( N( R� ( RT R& R' ( R� ( s /opt/cpanel-ccs/txweb2/stream.pyt generatorToStream_inner� s ( ( R� R� ( ( R� s /opt/cpanel-ccs/txweb2/stream.pyt generatorToStream� s 't BufferedStreamc B s� e Z d Z d Z d � Z d � Z e j e � Z d d � Z d d d � Z d � Z d � Z d � Z e e � Z d � Z RS( sX A stream which buffers its data to provide operations like readline and readExactly.R c C s | | _ d S( N( RT ( R RT ( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 � s c c s� x� t r� | � } | d k r' | Vd S| j j � } t | t j � rk t j | � } | V| j � } n | d k r� | j } d | _ | Vd S| j t | � 7_ q Wd S( s� Internal helper function which repeatedly calls f each time after more data has been received, until it returns non-None.NR ( R~ R RT R RK R R t waitForDeferredt getResultR^ R� ( R R* t rR� ( ( s /opt/cpanel-ccs/txweb2/stream.pyt _readUntil� s c sI � d k r* � d k r* t d � � � n � � f d � } � j | � S( sc Read exactly size bytes of data, or, if size is None, read the entire stream into a string.i s( readExactly: size cannot be negative: %sc sM � j } � d k rI t | � � k rI | � | � } } | � _ | Sd S( N( R^ R R8 ( R^ t preRz ( R t size( s /opt/cpanel-ccs/txweb2/stream.pyt gotdata s N( R R R� ( R R� R� ( ( R R� s /opt/cpanel-ccs/txweb2/stream.pyt readExactly s s c sP � d k r. � d k r. t d � f � � n � � � f d � } � j | � S( s� Read a line of data from the string, bounded by delimiter. The delimiter is included in the return value. If size is specified, read and return at most that many bytes, even if the delimiter has not yet been reached. If the size limit falls within a delimiter, the rest of the delimiter, and the next line will be returned together. i s% readline: size cannot be negative: %sc s� � j } � d k rg | j � d � � } | d k rT t | � � k rd � } qd q� | t � � 7} n. | j � � } | d k r� | t � � 7} n | d k r� | | } | | � _ | Sd S( Ni i����( R^ R t findR8 ( R^ t splitpointR� ( t delimiterR R� ( s /opt/cpanel-ccs/txweb2/stream.pyR� 1 s N( R R R� ( R R� R� R� ( ( R� R R� s /opt/cpanel-ccs/txweb2/stream.pyt readline$ s c C s | | j | _ d S( s Push data back into the buffer.N( R^ ( R t pushed( ( s /opt/cpanel-ccs/txweb2/stream.pyt pushbackE s c C s) | j } | r d | _ | S| j j � S( NR ( R^ RT R ( R R^ ( ( s /opt/cpanel-ccs/txweb2/stream.pyR J s c C s- | j j } | d k r d S| t | j � S( N( RT R R R8 R^ ( R t l( ( s /opt/cpanel-ccs/txweb2/stream.pyt _lenQ s c C s� | t | j � } | j j t d | � � \ } } t | � } t | � } | d k r} | j | | _ | j | | _ n | j | _ | | f S( Ni ( R8 R^ RT R t maxR� ( R R# t offR� Rz ( ( s /opt/cpanel-ccs/txweb2/stream.pyR Y s ! N( R R R R^ R0 R� R t deferredGeneratorR R� R� R� R R� t propertyR R ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� � s ! t MD5Streamc B s; e Z d Z d � Z d � Z d � Z d � Z d � Z RS( s^ An wrapper which computes the MD5 hash of the data read from the wrapped stream. c C s4 | d k r t d � � n | | _ t � | _ d S( Ns Stream to wrap must be provided( R R R� R t _md5( R t wrap( ( s /opt/cpanel-ccs/txweb2/stream.pyR0 r s c C s# | d k r | j j | � n | S( s� Update the MD5 hash object. @param value: L{None} or a L{str} with which to update the MD5 hash object. @return: C{value} N( R R� t update( R R� ( ( s /opt/cpanel-ccs/txweb2/stream.pyt _updatex s c C s` | j d k r t d � � n | j j � } t | t � rO | j | j � n | j | � | S( sN Read from the wrapped stream and update the MD5 hash object. s" Cannot read after stream is closedN( R� R R9 R RK R Ry R� ( R R" ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s5 t j | � | j j � | _ d | _ d | _ d S( sU Compute the final hex digest of the contents of the wrapped stream. N( R R R� t hexdigestt _md5valueR R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyR � s c C s% | j d k r t d � � n | j S( s� Return the hex encoded MD5 digest of the contents of the wrapped stream. This may only be called after C{close}. @rtype: C{str} @raise RuntimeError: If C{close} has not yet been called. s+ Cannot get MD5 value until stream is closedN( R� R R9 R� ( R ( ( s /opt/cpanel-ccs/txweb2/stream.pyt getMD5� s ( R R R R0 R� R R R� ( ( ( s /opt/cpanel-ccs/txweb2/stream.pyR� l s Rb RN R_ Rg R� ( i i i i i @ i (F R t __future__R R R+ t typest syst zope.interfaceR R R t twisted.internet.deferR t twisted.internetR R� R R R R Rk t twisted.pythonR t twisted.python.failureR t hashlibR t twext.python.logR R� t version_infoR% t ImportErrorR R R R R� R R4 R2 t SENDFILE_LIMITt SENDFILE_THRESHOLDR( R) t registerAdaptert fileR> R� t BufferTypeRB RS R_ Rb Rg Rt RN Rv Ru Rn R� t ProcessProtocolR� R� R� R� R� R� R� t __all__( ( ( s /opt/cpanel-ccs/txweb2/stream.pyt <module>6 sn ( F i, ;DfT(" % 0w=