VCc ? @ s d Z d Z d Z d Z d d d d d g Z d Z d
e Z d Z d g Z d Z d
d g Z
d d k Z d d k Z d d k
Z
d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z y d d k l Z Wn d d k l Z n Xy d d k Z Wn
e Z n Xy d d k Z Wn
e Z n Xy6 d d k Z e i i e d d k l! Z" d Z# Wn d Z# d Z" n Xy d d k$ Z$ d d k% Z% Wn e Z$ Z% n Xy d d k& Z' Wn n Xy d d k( Z( Wn n Xy3 d d k) Z) e o d d k* Z) d e) i+ _ n Wn
e Z) n Xd e, f d YZ- d e- f d YZ. d e- f d YZ/ d e- f d YZ0 d e, f d YZ1 e i2 d e _3 e i2 d e _4 e i2 d! e _5 h d" d# 6d$ d% 6d& d' 6d( d) 6d* d+ 6d, d- 6d. d/ 6d0 d1 6d2 d3 6d4 d5 6d6 d7 6d8 d9 6d: d; 6d< d= 6d> d? 6d@ dA 6dB dC 6Z6 y
e7 Z8 Wn, e9 j
o d dD k8 l8 Z8 dE Z7 n XdF e8 f dG Ya: dH Z; e a< dI Z= e i2 dJ Z> dK Z? dL f dM YZ@ e# o& dN e@ e i iA iB f dO YZC n dP e iD f dQ YZE dR e@ eE f dS YZF dT eE f dU YZG dV ZH dW eE f dX YZI dY ZJ dZ e iK e iL e iM f d[ YZN d\ ZO g ZP d] ZQ d^ d_ d` da db dc dd de df dg dh di dj d# g ZR g ZS eR D]a ZT eS eT iU dc dk iU dl dm iU dn do iU dp dq iU dr ds iU dj dt du dv dw q[S ZV [T g ZW eV D] ZX eW e i2 eX iY q[W ZZ [X dx Z[ eQ e[ dy Z\ dz Z] d{ Z^ d| Z_ d} Z` e i2 d~ e\ e] e^ f Za e i2 d e_ e` f Zb d Zc eQ ec d Zd eQ ed e i2 d Ze d Zf eQ ef h d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6Zg h d d 6d d 6d d 6d d 6d d 6d d 6d d 6Zh e i2 d Zi d Zj eQ ej h d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6Zk e i2 d Zl d Zm eQ em d Zn eQ en d Zo h d d 6d d 6d d 6d d 6d d 6Zp e iq ir ep eQ eo d Zs d Zt d Zu d Zv e e e e g d Zw ex d j o{ e
iy d o e GHe
iz d n e
iy d Z{ e; d d k| l| Z| x+ e{ D]# Z} e} GHHew e} Z~ e| e~ HqWn d S( sU Universal feed parser
Handles RSS 0.9x, RSS 1.0, RSS 2.0, CDF, Atom 0.3, and Atom 1.0 feeds
Visit http://feedparser.org/ for the latest version
Visit http://feedparser.org/docs/ for the latest documentation
Required: Python 2.1 or later
Recommended: Python 2.3 or later
Recommended: CJKCodecs and iconv_codec
s 4.1s Copyright (c) 2002-2006, Mark Pilgrim, All rights reserved.
Redistribution and use in source and binary forms, with or without modification,
are permitted provided that the following conditions are met:
* Redistributions of source code must retain the above copyright notice,
this list of conditions and the following disclaimer.
* Redistributions in binary form must reproduce the above copyright notice,
this list of conditions and the following disclaimer in the documentation
and/or other materials provided with the distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS 'AS IS'
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE
LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
POSSIBILITY OF SUCH DAMAGE.s' Mark Pilgrim s% Jason Diamond s' John Beimler s1 Fazal Majid s" Aaron Swartz s( Kevin Marks i s. UniversalFeedParser/%s +http://feedparser.org/s application/atom+xml,application/rdf+xml,application/rss+xml,application/x-netcdf,application/xml;q=0.9,text/xml;q=0.2,*/*;q=0.1t drv_libxml2t uTidyt mxTidyiN( t StringIO( t escapei c C s: | i d d } | i d d } | i d d } | S( Nt &s &t >s >t i? i i i i i i i i i i` i: i# i@ i' i= i" i ia ib ic id ie if ig ih ii i i i i i i i ij ik il im in io ip iq ir i i i i i i i i~ is it iu iv iw ix iy iz i i i i i i i i i i i i i i i i i i i i i i i{ iA iB iC iD iE iF iG iH iI i i i i i i i} iJ iK iL iM iN iO iP iQ iR i i i i i i i\ i iS iT iU iV iW iX iY iZ i i i i i i i0 i1 i2 i3 i4 i5 i6 i7 i8 i9 i i i i i i iR i ( i i i i i i i i i i i i i i
i i i i i i i i i i i i i i i i i i i i i i i i
i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i[ i. i< i( i+ i! i& i i i i i i i i i i] i$ i* i) i; i^ i- i/ i i i i i i i i i| i, i% i_ i> i? i i i i i i i i i i` i: i# i@ i' i= i" i ia ib ic id ie if ig ih ii i i i i i i i ij ik il im in io ip iq ir i i i i i i i i~ is it iu iv iw ix iy iz i i i i i i i i i i i i i i i i i i i i i i i{ iA iB iC iD iE iF iG iH iI i i i i i i i} iJ iK iL iM iN iO iP iQ iR i i i i i i i\ i iS iT iU iV iW iX iY iZ i i i i i i i0 i1 i2 i3 i4 i5 i6 i7 i8 i9 i i i i i i ( t _ebcdic_to_ascii_mapt stringt maketranst joint mapt chrt ranget translate( t st emapRn ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _ebcdic_to_ascii s* :s& ^([A-Za-z][A-Za-z0-9+-.]*://)(/*)(.*?)c C s" t i d | } t i | | S( Ns \1\3( t _urifixert subt urlparset urljoin( t baset uri( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _urljoin s t _FeedParserMixinc B s e Z h; d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d
6d d 6d d 6d
d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d! d" 6d# d$ 6d% d& 6d' d( 6d) d* 6d+ d, 6d- d. 6d/ d0 6d1 d2 6d3 d4 6d5 d6 6d5 d7 6d8 d9 6d: d; 6d< d= 6d> d? 6d@ dA 6dB dC 6dD dE 6dF dG 6dH dI 6dJ dK 6dL dM 6dN dO 6dP dQ 6dR dS 6dT dU 6dV dW 6dX dY 6dZ d[ 6d\ d] 6d^ d_ 6d` da 6db dc 6dd de 6df dg 6Z h Z dh di dj dk dl dm dn do dp dq dr g Z d ds dt du dv dw dx dy dz g Z d ds dt du dv dw dx dy dz g Z d{ d| g Z d d d} d~ Z d Z
d Z d Z d Z
d d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z! d Z" e" Z# d Z$ d Z% d Z& e& Z' d Z( d Z) d Z* e* Z+ d Z, e, Z- d Z. e. Z/ e. Z0 e. Z1 e. Z2 d Z3 e3 Z4 e3 Z5 e3 Z6 e3 Z7 d Z8 d Z9 d Z: d Z; d Z< d Z= d Z> e> Z? d Z@ e@ ZA d ZB d ZC d ZD d ZE d ZF eF ZG eF ZH d ZI eI ZJ eI ZK d ZL eL ZM d ZN eN ZO d ZP d d ZQ d ZR d d ZS d ZT eT ZU eT ZV d ZW eW ZX eW ZY d ZZ eZ Z[ eZ Z\ d Z] e] Z^ e] Z_ d Z` e` Za e` Zb d Zc ec Zd d Ze ee Zf d Zg eg Zh d Zi ei Zj d Zk ek Zl d Zm em Zn em Zo d Zp ep Zq ep Zr d Zs es Zt es Zu es Zv es Zw d Zx ex Zy ex Zz ex Z{ ex Z| d Z} e} Z~ d Z e Z d Z d Z d Z d Z d Z d Z d Z e Z e Z d Z d Z d Z e Z e Z e Z d Z d Z e Z d Z e Z d Z d Z d Z e Z e Z d Z e Z e Z d Z d Z d Z e Z d Z e Z d Z e Z d Z d Z d Z d Z d Z e Z d Z e Z d Z d Z d Z d Z d Z d Z e Z d Z e Z d Z e Z e Z e Z e Z e Z d Z e Z d Z d Z RS( R s http://backend.userland.com/rsss% http://blogs.law.harvard.edu/tech/rsss http://purl.org/rss/1.0/s& http://my.netscape.com/rdf/simple/0.9/s http://example.com/newformat#s http://example.com/nechos http://purl.org/echo/s uri/of/echo/namespace#s http://purl.org/pie/s http://purl.org/atom/ns#s http://www.w3.org/2005/Atoms' http://purl.org/rss/1.0/modules/rss091#t admins http://webns.net/mvcb/t ags, http://purl.org/rss/1.0/modules/aggregation/t annotates) http://purl.org/rss/1.0/modules/annotate/t audios! http://media.tangent.org/rss/1.0/t blogChannels- http://backend.userland.com/blogChannelModulet ccs http://web.resource.org/cc/t creativeCommonss4 http://backend.userland.com/creativeCommonsRssModulet cos' http://purl.org/rss/1.0/modules/companyt contents( http://purl.org/rss/1.0/modules/content/t cps& http://my.theinfo.org/changed/1.0/rss/t dcs http://purl.org/dc/elements/1.1/t dctermss http://purl.org/dc/terms/t emails& http://purl.org/rss/1.0/modules/email/t evs& http://purl.org/rss/1.0/modules/event/t
feedburners* http://rssnamespace.org/feedburner/ext/1.0t fms http://freshmeat.net/rss/fm/t foafs http://xmlns.com/foaf/0.1/t geos( http://www.w3.org/2003/01/geo/wgs84_pos#t icbms http://postneo.com/icbm/t images& http://purl.org/rss/1.0/modules/image/t ituness* http://www.itunes.com/DTDs/PodCast-1.0.dtds' http://example.com/DTDs/PodCast-1.0.dtdt ls% http://purl.org/rss/1.0/modules/link/t medias http://search.yahoo.com/mrsst pingbacks4 http://madskills.com/public/xml/rss/module/pingback/t prisms. http://prismstandard.org/namespaces/1.2/basic/t rdfs+ http://www.w3.org/1999/02/22-rdf-syntax-ns#t rdfss% http://www.w3.org/2000/01/rdf-schema#t refs* http://purl.org/rss/1.0/modules/reference/t reqvs* http://purl.org/rss/1.0/modules/richequiv/t searchs' http://purl.org/rss/1.0/modules/search/t slashs& http://purl.org/rss/1.0/modules/slash/t soaps) http://schemas.xmlsoap.org/soap/envelope/t sss. http://purl.org/rss/1.0/modules/servicestatus/t strs- http://hacks.benhammersley.com/rss/streaming/Ry s- http://purl.org/rss/1.0/modules/subscription/t sys, http://purl.org/rss/1.0/modules/syndication/t taxos) http://purl.org/rss/1.0/modules/taxonomy/t thrs* http://purl.org/rss/1.0/modules/threading/t tis* http://purl.org/rss/1.0/modules/textinput/t trackbacks5 http://madskills.com/public/xml/rss/module/trackback/t wfws$ http://wellformedweb.org/commentAPI/t wikis% http://purl.org/rss/1.0/modules/wiki/t xhtmls http://www.w3.org/1999/xhtmlt xmls$ http://www.w3.org/XML/1998/namespacet szfs/ http://schemas.pocketsoap.com/rss/myDescModule/t linkR0 t wfw_commentt wfw_commentrsst docsR: R9 t commentst licenset icont logot titleR7 t infoRE R6 RB RA R8 s text/htmls application/xhtml+xmls utf-8c C s^ t o t i i d n | i p7 x4 | i i D] \ } } | | i | i
c C s t o t i i d | | f n g } | D] \ } } | | i | f q0 ~ } g } | D]3 \ } } | | | d# j o
| i p | f qc ~ } t | } | i d | i d p | i } t | i | | _ | i d | i d } | d j o
d } n | d j o
| i
} n | o" | d$ j o | | i d s %s="%s"R i i Ra R R R8 t nameR: R9 t widtht heightt _start_( R s type( s feedR s rdf:RDF( s titles links descriptions name( s titles links descriptions urls hrefs widthR ( R R R R R R* RO R R~ Ri R R R t appendR Rd t trackNamespaceR R RS t endswitht splitt handle_dataRp t findR R R t getattrR_ t push( RT RW t attrsRV R( R) t _[2]t attrsDR R t prefixR} t _[3]t tt suffixt
methodnamet method( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt unknown_starttag sZ 3G %
=# F
c C s t o t i i d | n | i d d j o | i d d \ } } n d | } } | i i | | } | o | d } n d | | } y t | | } | Wn$ t j
o | i
| | n X| i oD | i i
d o1 | i i d d i d o d
| i d R i ( R R R R R R R RO R R_ t popR R RS R R R R R R ( RT RW R R R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt unknown_endtag s6
=#
c C s | i p d S| i } | d j o d | } nJ | d d
j o t | d d } n
t | } t | i d } | i d d i | d S( Nt 34t 38t 39t 60t 62t x22t x26t x27t x3ct x3es &#%s;i t xi i s utf-8ii (
R R R R R R R R R R ( R R t intt unichrt encodeR ( RT R t textt c( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt handle_charref s
c C s | i p d St o t i i d | n | d j o d | } nS d } y | | Wn t j
o d | } n Xt | | i d } | i d
d i | d S(
Ns" entering handle_entityref with %s
t ltt gtt quott ampt aposs &%s;c S sq d d k } t | d o | i | S| i | } | i d o" | i d o t | d d ! St | S( Nit name2codepoints &#t ;i ( t htmlentitydefsR^ R t
entitydefsRd R R t ord( R( R
( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt name2cp s
s utf-8ii ( R R R R R ( R R R R R Rc R R R ( RT R R R
( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt handle_entityref s
i c C s[ | i p d S| o) | i i d d j o t | } n | i d d i | d S( NRP s application/xhtml+xmlii ( R R RO R
R ( RT R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s
c C s d S( N( ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt handle_comment s c C s d S( N( ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt handle_pi! s c C s d S( N( ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt handle_decl% s c C s t o t i i d n | i | | d !d j ob | i i d | } | d j o t | i } n | i t | i | d | ! d | d S| i i d | } | d Sd S(
Ns entering parse_declaration
i s ii i R i ( R R R R t rawdataR t lenR R
( RT t iR( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt parse_declaration( s
$ c C sU | i } | d j o
d } n/ | d j o
d } n | d j o
d } n | S( NR s
text/plaint htmls text/htmlR s application/xhtml+xml( R ( RT t contentType( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt mapContentType4 s
c C s | i } | | f d j o | i o
d | _ n | d j o | i o
d | _ n | d j o | i o
d | _ n | i d d j o d } | } n | i i | o, | i | | i | <| | i | i | s
c C s t | i p d | S( NR ( R~ R ( RT R} ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt
resolveURIP s c C s | S( N( ( RT t elementR ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt decodeEntitiesS s c C s | i i | | g g d S( N( R R ( RT R t
expectingText( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR V s c C sU | i p d S| i d d | j o d S| i i \ } } } d i | } | o | i } n | p | St o[ | i i d d oE y t i | } Wq t i j
o q t i
j
o q Xn | | i j o | o | i | } n | i i d d p | i
| | } n y | i d =Wn t j
o n Xy | i d =Wn t j
o n X| i | i i d d | i j o0 | | i j o t | | i | i } qn | i | i i d d | i j o* | | i j o t | | i } q n | i o= t | t d j o$ y t | | i } WqgqgXn | d j o | S| i o| i o
| d
j oO | i d i | g t i | i } | | d <| i d | i | qQ| d j o9 | | i d | <| o | | i d d
d d t _parse_date( RT R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_published s c C s | i d d d S( NR2 i ( R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_updated$ s c C s/ | i d } t | } | i d | d S( NR2 R4 ( R R} R> ( RT R[ t parsed_value( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_updated+ s c C s | i d d d S( Nt createdi ( R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_created4 s c C s) | i d } | i d t | d S( NR t created_parsed( R R> R} ( RT R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_created8 s c C s | i d d d S( Nt expiredi ( R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_expirationdate= s c C s# | i d t | i d d S( Nt expired_parsedR ( R> R} R ( RT ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_expirationdate@ s c C sV | i d d | i | d } | o | i d d i | n | i d d S( NR i s rdf:resourceii ( R R< R R R ( RT R R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_cc_licenseC s
c C s | i d d d S( NR i ( R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_creativecommons_licenseJ s c C s | i d d S( NR ( R ( RT ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_creativecommons_licenseM s c C s | i } | i d g } | o | o
| o d St h | d 6| d 6| d 6 } | | j o, | i t h | d 6| d 6| d 6 n d S( NRI RJ RL t label( R0 R] R+ R ( RT RJ RL R R4 RI R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _addTagP s !
c C s t o t i i d t | n | i d } | i d | i d } | i d } | i | | | | i d d d S( Ns! entering _start_category with %s
RJ RL t domainR RH i ( R R R R t reprRO R R ( RT R RJ RL R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_categoryX s c C s7 x0 | i d i D] } | i | d d q Wd S( Nt itunes_keywordss http://www.itunes.com/( R R R Ri ( RT RJ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_itunes_keywordsb s c C s0 | i | i d d d | i d d d S( NR s http://www.itunes.com/RH i ( R RO Ri R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_itunes_categoryf s c C s~ | i d } | p d S| i } | d } | o/ t | o" | d d o | | d d Ru R0 RS ( RT R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _end_guid s *
c C s1 | i d | d | i p | i p | i d S( NR s
text/plain( R7 R R R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _start_title s c C sW | i d } | i } | i o | | d d | i | } | i d o | i | d | d ( RT t copyToDescriptionR[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR $ s +c C s: | i d d t h | i d d 6 | i d RA RB RD t _start_feedinfoRC RJ RK t _end_feedRL RM RO t _start_textInputRP t _end_textInputRR t _start_managingeditort _start_dc_authort _start_dc_creatort _start_itunes_authorRT t _end_managingeditort _end_dc_authort _end_dc_creatort _end_itunes_authorRV RW RZ R[ R\ R^ R_ t _start_itunes_nameR] t _end_itunes_nameRb Rc Rd Re Rf t _start_homepaget
_start_uriRg t
_end_homepaget _end_uriRh t _start_itunes_emailRi t _end_itunes_emailR0 R` Ra RS Rp t _start_taglinet _start_itunes_subtitleRq t _end_taglinet _end_itunes_subtitleRr t _start_dc_rightst _start_copyrightRs t _end_dc_rightst _end_copyrightRv t _start_entryt _start_productRw t
_end_entryRx t _start_languageRy t
_end_languageRz t _start_webmasterR{ t _end_webmasterR| t _start_dcterms_issuedt
_start_issuedR~ t _end_dcterms_issuedt _end_issuedR RF t _start_dcterms_modifiedt _start_pubdatet _start_dc_dateR RG t _end_dcterms_modifiedt _end_pubdatet _end_dc_dateR t _start_dcterms_createdR t _end_dcterms_createdR R R R R R R t _start_dc_subjectt _start_keywordsR R R t _end_dc_subjectt
_end_keywordst _end_itunes_categoryR RH t _start_producturlRI t _end_producturlR R R t _start_dc_titlet _start_media_titleR t
_end_dc_titlet _end_media_titleR R R t
_end_abstractR t! _start_feedburner_browserfriendlyR t _end_feedburner_browserfriendlyR R R R R t _start_itunes_summaryR t _end_itunes_summaryR R R R R R t _start_xhtml_bodyR t _start_fullitemR t _end_bodyt _end_xhtml_bodyt _end_content_encodedt
_end_fullitemt
_end_prodlinkR t _start_itunes_linkR R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s
'!! " F %
Y
t _StrictFeedParserc B sG e Z d Z d Z d Z d Z d Z d Z d Z RS( c C s] t o t i i d n t i i i i | t i | | | | d | _
d | _ d S( Ns trying StrictFeedParser
i (
R R R R R t saxt handlert ContentHandlerR R t bozoRi t exc( RT R R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR > s c C s | i | | d S( N( R ( RT R R} ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt startPrefixMappingE s c C s" | \ } } t | p d i } | i d d j o d } | } n | o- | i d d j o | i d d } n d } | i i | | } | oL | d j p | d j o | d j o% | i i | o t d | n | o | d | } n t | i } t
o0 t i i
d | | | | | i | f n h } xz | i i D]i \ \ } }
} | p d i } | i i | d } | o | d |
}
n | | t |
i s >s 't 's "t "u ( Rl t compilet
IGNORECASERy R/ R R RP R R* R+ R, ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR, s !#c C s~ g } | D] \ } } | | i | f q ~ } g } | D]3 \ } } | | | d j o
| i p | f q> ~ } | S( NR RP ( s rels type( R ( RT R RV R( R) R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt normalize_attrs s 3Gc C s t o t i i d | n g } xb | D]Z \ } } t | t d j o t | | i } n | i t | | i | f q, Wd i g } | D] \ } } | d | | f q ~ i | i } | | i
j o | i i d t n | i i d t d S( Ns- _BaseHTMLProcessor, unknown_starttag, tag=%s
u u %s="%s"s <%(tag)s%(strattrs)s />s <%(tag)s%(strattrs)s>(
R R R R RP R- R R Rp R R- R2 t locals( RT RW R t uattrsRU R[ RV t strattrs( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s #Fc C s/ | | i j o | i i d t n d S( Ns
( R- R2 R R5 ( RT RW ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s | i i d t d S( Ns
&#%(ref)s;( R2 R R5 ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s | i i d t d S( Ns &%(ref)s;( R2 R R5 ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s3 t o t i i d | n | i i | d S( Ns) _BaseHTMLProcessor, handle_text, text=%s
( R R R R R2 R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s | i i d t d S( Ns ( R2 R R5 ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s | i i d t d S( Ns ( R2 R R5 ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s | i i d t d S( Ns ( R2 R R5 ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s s [a-zA-Z][-_.a-zA-Z0-9:]*\s*c C s | i } t | } | | j o d S| i | | } | oK | i } | i } | t | | j o d S| i | i f S| i | d Sd S( Ni( Ni( Ni( Ni( R R Ri t _new_declname_matchRm R" R t endR ( RT R t declstartposR t nt mRu R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt
_scan_name s
c C s1 d i g } | i D] } | t | q ~ S( s( Return processed HTML as a single stringR ( Rp R2 R ( RT RV t p( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR3 s ( R R
R- R R, R/ R, R4 R R R R R R R R Rl R2 R. R8 R= R3 ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s$
t _LooseFeedParserc B s e Z d Z d Z RS( c C s* t i i | t i | | | | d S( N( R* R+ R R ( RT R R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C sI | i d d } | i d d } | i d d } | i d d } | i d d } | i d d } | i d
d } | i d d } | i d
d } | i d d } | i i d o~ | i i d d i d o^ | i d d } | i d d } | i d d } | i d d } | i d d } n | S( Ns <s <s <s >s >s >s &s &s &s "s "s "s 's 's 'RP R R R R R1 R0 ( R R RS RO R ( RT R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s" 3( R R
R R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR? s t _RelativeURIResolverc B st e Z d d d! d" d# d$ d% d& d' d( d) d* d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 d7 g Z d Z d Z d Z RS(8 t aR9 t applett codebaseR t
blockquotet citet bodyt
backgroundt delt formt actionR# t longdescR t iframet headt profileR% t usemapR& t insR t objectt classidR t qt scriptc C s t i | | | | _ d S( N( R R R ( RT R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR + s c C s t | i | S( N( R~ R ( RT R} ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR / s c C sy | i | } g } | D]? \ } } | | | | f | i j o | i | p | f q ~ } t i | | | d S( N( R4 t
relative_urisR R R ( RT RW R RV RU R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR 2 s S( RA s href( RB RC ( s areas href( RD RE ( RF RG ( RH RE ( RI s action( s frameRK ( s frames src( RL RK ( RL s src( s headRN ( s imgRK ( s imgs src( s imgRO ( s inputs src( s inputRO ( RP RE ( s links href( s objectRR ( s objectRC ( s objects data( s objectRO ( RS RE ( RT s src( R R
RU R R R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR@ s8 c C sA t o t i i d n t | | } | i | | i S( Ns entering _resolveRelativeURIs
( R R R R R@ R, R3 ( t
htmlSourcet baseURIR R> ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR* 7 s
t _HTMLSanitizerc G B s e Z d d d d d d d d d d d
d d d
d d d d d d d d d d d d d d d d d d d d! d" d# d$ d% d& d' d( d) d* d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 d7 d8 d9 d: d; d< d= d> d? d@ dA dB dC dD dE dF gG Z d dG dH dI dJ dK dL dM dN dO dP dQ dR dS dT d dU dV dW dX dY dZ d[ d\ d d] d^ d_ d` da db dc dd de df dg d' dh di dj dk dl dm dn do dp dq dr ds dt du dv dw dx dy dz d{ d| d6 d} d~ d d d d d d d d d d gG Z d d g Z d Z d Z d Z d Z d Z d Z
RS( RA t abbrt acronymt addressR t bt bigRD R! t buttont captiont centerRE t codeR" t colgroupt ddRH t dfnt dirt divt dlt dtt emt fieldsett fontRI t h1t h2t h3t h4t h5t h6R$ R R% R& RP t kbdR t legendt liRq t menut olt optgroupt optionR> t preRS Ru t sampt selectt smallt spant striket strongRy t supt tablet tbodyt tdt textareat tfoott tht theadt trt ttt ut ult vart accepts accept-charsett accesskeyRJ t alignt altt axist bordert cellpaddingt cellspacingt chart charofft charsett checkedt classR8 t colst colspant colort compactt coordst datetimet disabledt enctypet forR# t headersR R9 t hreflangt hspaceR0 t ismapR RK t maxlengthR R t multipleR t nohreft noshadet nowrapt promptt readonlyR t revt rowst rowspant rulest scopet selectedt shapet sizeR t startR7 t tabindext targetR RP RO t valignR[ t vspaceR RT RB c C s t i | d | _ d S( Ni ( R R, t unacceptablestack( RT ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR, T s
c C s | | i j o( | | i j o | i d 7_ n d S| i | } g } | D]- \ } } | | i j o | | | f qR qR ~ } t i | | | d S( Ni ( t acceptable_elementst" unacceptable_elements_with_end_tagR R4 t acceptable_attributesR R ( RT RW R RV RU R[ ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR X s Ac C sL | | i j o( | | i j o | i d 8_ n d St i | | d S( Ni ( R R R R R ( RT RW ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR a s
c C s d S( N( ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR h s c C s d S( N( ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR k s c C s" | i p t i | | n d S( N( R R R ( RT R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR n s
( R R
R R R R, R R R R R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyRX = s2 $ c s t | } | i | | i } t od } x~ t D]v } yf | d j o$ d d k l f d } Pn2 | d j o$ d d k l f d } Pn Wq9 q9 Xq9 W| o t
| t
d j } | o | i d } n | | d
d d d d
d d d } | o t | d } n | i
d oD | i d d d } | i
d o | i d d d } q~n | i
d o | i d d d } qqn | i i d d } | S( NR i( t parseStringc s t | | S( N( R ( R t kwargs( t _utidy( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _tidy~ s R ( t Tidyc s" i | | \ } } } } | S( N( t tidy( R R t nerrorst nwarningst errordata( t _mxtidy( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s u s utf-8t output_xhtmli t numeric_entitiest wrapi t
char_encodingt utf8s R R t tidy_interfaceR ( ( R R sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR, r sB
$ "t _FeedURLHandlerc B s> e Z d Z d Z d Z e Z e Z e Z d Z RS( c C s` | d d j o' | d j o | i | | | | | St i | | | i } | | _ | S( Nid i i0 ( t http_error_302t urllibt
addinfourlt get_full_urlt status( RT t reqt fpRa t msgR t infourl( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt http_error_default s
c C st | i i d o% t i i | | | | | | } n t i | | | i } t | d p
| | _ n | S( Nt locationR (
R* RS t urllib2t HTTPRedirectHandlerR R R R R^ R ( RT R R Ra R R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s %
c C st | i i d o% t i i | | | | | | } n t i | | | i } t | d p
| | _ n | S( NR R (
R* RS R R t http_error_301R R R R^ R ( RT R R Ra R R R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s %
c C s t i | i d } y t i i d d j p t t d j p t t i | i d i d d i d \ } } t
i d | d d } | i | | | | | i
d | | | }
| i |
SWn | i | | | | | SXd S(
Ni i s 2.3.3t
Authorizationt R s realm="([^"]*)"s WWW-Authenticates www-authenticate( Rz R R R R Re R Ri R# R Rl t findallt add_passwordt http_error_auth_reqedt reset_retry_countR ( RT R R Ra R R t hostt usert passwt realmt retry( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt http_error_401 s !2
( R R
R R R t http_error_300t http_error_303t http_error_307R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s c C s t | d o | S| d j o t i St i | d d1 j o| p
t } n d0 } t o t i | \ } } t i | \ } } | oL t i
| \ }
} |
o, d | | | f } t i |
i } q q n t
i | } | i d | | o | i d | n | o d
d d d
d d d g } d d d d d d d d d d d d g }
| i d d | | d | d |
| d! d! | d | d" | d# | d$ f n | o | i d% | n t o t o | i d& d' nG t o | i d& d( n, t o | i d& d) n | i d& d* | o | i d+ d, | n t o | i d- t n | i d. d/ t t
i t t g | } g | _ z | i | SWd0 | i Xn y t | SWn n Xt t | S(2 s8 URL, filename, or string --> stream
This function lets you define parsers that take any input source
(URL, pathname to local or network file, or actual data as a string)
and deal with it in a uniform manner. Returned object is guaranteed
to have all the basic stdio read methods (read, readline, readlines).
Just .close() the object when you're done with it.
If the etag argument is supplied, it will be used as the value of an
If-None-Match request header.
If the modified argument is supplied, it must be a tuple of 9 integers
as returned by gmtime() in the standard Python time module. This MUST
be in GMT (Greenwich Mean Time). The formatted date/time will be used
as the value of an If-Modified-Since request header.
If the agent argument is supplied, it will be used as the value of a
User-Agent request header.
If the referrer argument is supplied, it will be used as the value of a
Referer[sic] request header.
If handlers is supplied, it is a list of handlers used to build a
urllib2 opener.
t readt -i t httpt httpst ftps %s://%s%ss
User-Agents
If-None-Matcht Mont Tuet Wedt Thut Frit Satt Sunt Jant Febt Mart Aprt Mayt Junt Jult Augt Sept Octt Novt Decs If-Modified-Sinces# %s, %02d %s %04d %02d:%02d:%02d GMTi i i i i i t Referers Accept-encodings
gzip, deflatet gzipt deflateR R s Basic %st Accepts A-IMR, N( R R R ( R^ R t stdinRz t
USER_AGENTRi R R t splittypet splithostt splitusert encodestringR" R t Requestt
add_headerR
t zlibt
ACCEPT_HEADERt applyt build_openert tupleR t
addheaderst opent closet _StringIOR ( t url_file_stream_or_stringt etagR; t agentt referrert handlerst autht urltypet restt realhostt user_passwdt requestt short_weekdayst monthst opener( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _open_resource s`
!*U" c C s t i d | d S( sL Register a date handler function (takes string, returns 9-tuple date in GMT)i N( t _date_handlerst insert( t func( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt registerDateHandler* s s YYYY-?MM-?DDs YYYY-MMs YYYY-?OOOs
YY-?MM-?DDs YY-?OOOt YYYYs -YY-?MMs -OOOs -YYs --MM-?DDs --MMs ---DDt CCs (?P\d{4})t YYs (?P\d\d)t MMs (?P[01]\d)t DDs (?P[0123]\d)t OOOs (?P[0123]\d\d)s (?P\d\d$)s$ (T?(?P\d{2}):(?P\d{2})s (:(?P\d{2}))?s6 (?P[+-](?P\d{2})(:(?P\d{2}))?|Z)?)?c
C s d } x& t D] } | | } | o Pq
q
W| p d S| i d j o d S| i } | i d d } | o t | } n d } | i d d } | p
| d j o t i d } nL t | d j o, d t t i d d t | } n
t | } | i d d } | p
| d j o% | o
d
} q`t i d
} n t | } | i d d } | ph | o
| } q| i d d p& | i d d p | i d d o
d
} qt i d } n
t | } d | i j o t | d d
d d
} n x> d
d d d d g D]' } | i | d p d | | t weekdayt daylight_savings_flagt tmRA ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_iso8601L sv ,
&
"&"&u 년u 월u 일u 오전u 오후s; (\d{4})%s\s+(\d{2})%s\s+(\d{2})%s\s+(\d{2}):(\d{2}):(\d{2})u> (\d{4})-(\d{2})-(\d{2})\s+(%s|%s)\s+(\d{,2}):(\d{,2}):(\d{,2})c C s t i | } | p d Sd h | i d d 6| i d d 6| i d d 6| i d d
6| i d d 6| i d
d 6d d 6} t o t i i d | n t | S( s8 Parse a string according to the OnBlog 8-bit date formatNsE %(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)si R8 i R9 i R: i R< i R= i R> s +09:00t zonediffs OnBlog date parsed as: %s
( t _korean_onblog_date_reR. Rm R R R R t _parse_date_w3dtf( RJ R< t w3dtfdate( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_onblog s 30 c C s t i | } | p d St | i d } | i d } | t j o | d 7} n t | } t | d j o d | } n d h | i d d 6| i d d
6| i d d 6| d
6| i d d 6| i d d 6d d 6} t o t i i
d | n t | S( s6 Parse a string according to the Nate 8-bit date formatNi i i i t 0sE %(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)sR8 i R9 i R: R< i R= i R> s +09:00RR s Nate date parsed as: %s
( t _korean_nate_date_reR. R Rm t
_korean_pmR R R R R R RT ( RJ R< R< t ampmRU ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_nate s"
3' s9 (\d{4})-(\d{2})-(\d{2})\s+(\d{2}):(\d{2}):(\d{2})(\.\d+)?c C s t i | } | p d Sd h | i d d 6| i d d 6| i d d 6| i d d
6| i d d 6| i d
d 6d d 6} t o t i i d | n t | S( s2 Parse a string according to the MS SQL date formatNsE %(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)si R8 i R9 i R: i R< i R= i R> s +09:00RR s MS SQL date parsed as: %s
( t _mssql_date_reR. Rm R R R R RT ( RJ R< RU ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_mssql s 30 u Janu Ιανu Febu Φεβu Maru Μάώu Μαώu Apru Απρu Mayu Μάιu Μαϊu Μαιu Junu Ιούνu Ιονu Julu Ιούλu Ιολu Augu Αύγu Αυγu Sepu Σεπu Octu Οκτu Novu Νοέu Νοεu Decu Δεκu Sunu Κυρu Monu Δευu Tueu Τριu Wedu Τετu Thuu Πεμu Friu Παρu Satu ΣαβuL ([^,]+),\s+(\d{2})\s+([^\s]+)\s+(\d{4})\s+(\d{2}):(\d{2}):(\d{2})\s+([^\s]+)c C s t i | } | p d Sy* t | i d } t | i d } Wn d SXd h | d 6| i d d 6| d 6| i d d
6| i d d 6| i d
d 6| i d d 6| i d d 6} t o t i i d | n t | S( s6 Parse a string according to a Greek 8-bit date format.Ni i sP %(wday)s, %(day)s %(month)s %(year)s %(hour)s:%(minute)s:%(second)s %(zonediff)st wdayi R: R9 i R8 i R< i R= i R> i RR s Greek date parsed as: %s
(
t _greek_date_format_reR. t _greek_wdaysRm t
_greek_monthsR R R R t _parse_date_rfc822( RJ R< R^ R9 t
rfc822date( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_greek s 10 u 01u januáru 02u februáriu 03u márciusu 04u áprilisu 05u máujusu 06u júniusu 07u júliusu 08u augusztusu 09u
szeptemberu 10u októberu 11u novemberu 12u decemberu? (\d{4})-([^-]+)-(\d{,2})T(\d{,2}):(\d{2})((\+|-)(\d{,2}:\d{2}))c C s t i | } | p d Syw t | i d } | i d } t | d j o d | } n | i d } t | d j o d | } n Wn d SXd h | i d d 6| d 6| d
6| d 6| i d d
6| i d d 6} t o t i i d | n t | S( s: Parse a string according to a Hungarian 8-bit date format.Ni i i RW i s: %(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s%(zonediff)sR8 R9 R: R< i R= i RR s Hungarian date parsed as: %s
(
t _hungarian_date_format_reR. t _hungarian_monthsRm R R R R R RT ( RJ R< R9 R: R< RU ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parse_date_hungarian! s( ! c C s d } d } d } d } d } t i | } d | } d | | f } t i | } | i | }
|
d j p |
i | j o d S| |
| |
d } | d d j o d St i t i | | |
t i S(
Nc
S s t | i d } | d j o, d t t i d d t | } n | d j o d
S| i d } | ot | } | d d } | d d } d } x | | j o t i | | | d d d d d d f } t i | d } t | | } | | j o/ | | j o | | } qw| d } d } q | | j o- | | d
j o | | } qw| d } q q W| | | f S| i d } d } | d j o
d } n9 t | } | i d } | o t | } n d } | | | f S( NR8 id i i t juliani i ii i R9 R: ( i i i ( R Rm RF RG Ri RI t abs( R< R8 Rh R9 R: t jdayR t diff( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt __extract_date< sH
,
*
c S s | p d S| i d } | p d St | } t | i d } | i d } | o t | } n d } | | | f S( Ni t hourst minutest seconds( i i i ( i i i ( Rm R ( R< Rm Rn Ro ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt __extract_timee s c S s | p d S| i d } | p d S| d j o d St | i d } | i d } | o t | } n d } | d | d } | d d j o | S| S( sA Return the Time Zone Designator as an offset in seconds from UTC.i t tzdRB t tzdhourst
tzdminutesi< RC ( Rm R ( R< Rq Rm Rn t offset( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt
__extract_tzdt s
sd (?P\d\d\d\d)(?:(?P-|)(?:(?P\d\d\d)|(?P\d\d)(?:(?P=dsep)(?P\d\d))?))?s; (?P[-+](?P\d\d)(?::?(?P\d\d))|Z)sW (?P\d\d)(?P:|)(?P\d\d)(?:(?P=tsep)(?P\d\d(?:[.,]\d+)?))?s
%s(?:T%s)?i ( i i i ( Rl R2 R. Ri Rm RF RG RI t timezone( RJ Rl Rp Ru t __date_ret __tzd_ret __tzd_rxt __time_ret
__datetime_ret
__datetime_rxR< t gmt( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyRT ; s" ) c C s | i } | d d d j p | d i t i j o | d =n t | d j of | d } | i d } | d j o | | | | d g | d )n | i d d
i | } n t | d j o | d 7} n t i | } | o t i
t i | Sd
S( s8 Parse an RFC822, RFC1123, RFC2822, or asctime-style datei it ,t .i i RC i R R i s
00:00:00 GMTN( R~ R ( R R t rfc822t _daynamesR R R Rp t parsedate_tzRF RG t mktime_tz( RJ R Ru R RP ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyRb s /
ipt ATi t ETit CTiDt MTit PTc C s x t D] } yg | | } | p w n t | d j o% t o t i i d n t n t t | | SWq t j
o7 } t o' t i i d | i
t | f q q Xq Wd S( s6 Parses a variety of date formats into a 9-tuple in GMTi s* date handler function must return 9-tuple
s
%s raised %s
N(
R- R R R R R t
ValueErrorRq R t ExceptionR R Ri ( RJ R
t
date9tuplet e( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR} s"
' c C s d } d } d } d } | | i d \ } } yj| d d j o t | } n.| d d j o" d } t | d i d } nt | d j oK | d d
j o: | d d !d j o& d } t | d d i d } n| d d j o" d
} t | d
i d } njt | d j oK | d d j o: | d d !d j o& d
} t | d d
i d } n | d d j o" d } t | d i d } n | d d j o" d } t | d i d } n | d d j o& d } t | d d i d } no | d d j o& d } t | d d i d } n8 | d d j o& d } t | d d i d } n t i d i | } Wn
d0 } n X| o8 | i d i
} | o | d1 j o
| } qn d } d2 }
d3 } | |
j p | i d* o. | i d+ o d, } | p | p d } n | | j p | i d- o' | i d+ o d, } | p d. } nX | i d- o | p d. } n7 | o" | i
d o | p d/ } n | p d } | | | | | f S(4 s Get the character encoding of the XML document
http_headers is a dictionary
xml_data is a raw string (not Unicode)
This is so much trickier than it sounds, it's not even funny.
According to RFC 3023 ('XML Media Types'), if the HTTP Content-Type
is application/xml, application/*+xml,
application/xml-external-parsed-entity, or application/xml-dtd,
the encoding given in the charset parameter of the HTTP Content-Type
takes precedence over the encoding given in the XML prefix within the
document, and defaults to 'utf-8' if neither are specified. But, if
the HTTP Content-Type is text/xml, text/*+xml, or
text/xml-external-parsed-entity, the encoding given in the XML prefix
within the document is ALWAYS IGNORED and only the encoding given in
the charset parameter of the HTTP Content-Type header should be
respected, and it defaults to 'us-ascii' if not specified.
Furthermore, discussion on the atom-syntax mailing list with the
author of RFC 3023 leads me to the conclusion that any document
served with a Content-Type of text/* and no charset parameter
must be treated as us-ascii. (We now do this.) And also that it
must always be flagged as non-well-formed. (We now do this too.)
If Content-Type is unspecified (input was local file or non-HTTP source)
or unrecognized (server just got it totally wrong), then go by the
encoding given in the XML prefix of the document and default to
'iso-8859-1' as per the HTTP specification (RFC 2616).
Then, assuming we didn't find a character encoding in the HTTP headers
(and the HTTP Content-type allowed us to look in the body), we need
to sniff the first few bytes of the XML data and try to determine
whether the encoding is ASCII-compatible. Section F of the XML
specification shows the way here:
http://www.w3.org/TR/REC-xml/#sec-guessing-no-ext-info
If the sniffed encoding is not ASCII-compatible, we need to make it
ASCII compatible so that we can sniff further into the XML declaration
to find the encoding attribute, which will tell us the true encoding.
Of course, none of this guarantees that we will be able to parse the
feed in the declared character encoding (assuming it was declared
correctly, which many are not). CJKCodecs and iconv_codec help a lot;
you should definitely install them if you can.
http://cjkpython.i18n.org/
c S sD | p d } t i | \ } } | | i d d i d d f S( s takes HTTP Content-Type header and returns (content type, charset)
If no charset is specified, returns (content type, '')
If no content type is specified, returns ('', '')
Both return parameters are guaranteed to be lowercase strings
R R R0 ( t cgit parse_headerRO R ( t content_typeRL ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _parseHTTPContentType s
R s content-typei s Lot < ?s utf-16bes utf-8i s t s < ? s utf-16les t i s iso-10646-ucs-2s ucs-2t csunicodes iso-10646-ucs-4s ucs-4t csucs4s utf-16s utf-32t utf_16t utf_32t utf16t u16s application/xmls application/xml-dtds& application/xml-external-parsed-entitys text/xmls text/xml-external-parsed-entitys application/s +xmli s text/s us-asciis
iso-8859-1N( s iso-10646-ucs-2s ucs-2R s iso-10646-ucs-4s ucs-4R s utf-16s utf-32s utf_16s utf_32s utf16s u16( s application/xmls application/xml-dtds& application/xml-external-parsed-entity( s text/xmls text/xml-external-parsed-entity( RO Rw R- R R Rl R2 R. Ri t groupsR Rd R RS ( t http_headerst xml_dataR t sniffed_xml_encodingt xml_encodingt
true_encodingt http_content_typet
http_encodingt xml_encoding_matcht acceptable_content_typet application_content_typest text_content_types( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _getCharacterEncoding sv 0 8 8
c C s t o t i i d | n t | d j ou | d d j od | d d !d j oP t o5 t i i d | d j o t i i d q n d } | d } nt | d j ou | d d j od | d d !d j oP t o5 t i i d | d
j o t i i d qn d
} | d } n$| d d
j oP t o5 t i i d | d j o t i i d q|n d } | d } n | d d j oP t o5 t i i d | d j o t i i d qn d } | d } nb | d d j oP t o5 t i i d | d j o t i i d q>n d } | d } n t | | } t o t i i d | n t i d } d } | i | o | i | | } n | d | } | i
d S( s Changes an XML data stream on the fly to specify a new encoding
data is a raw sequence of bytes (not Unicode) that is presumed to be in %encoding already
encoding is a string recognized by encodings.aliases
s% entering _toUTF8, trying encoding %s
i i s R s stripping BOM
s utf-16bes trying utf-16be instead
s s utf-16les trying utf-16le instead
i s s utf-8s trying utf-8 instead
R s utf-32bes trying utf-32be instead
s s utf-32les trying utf-32le instead
s* successfully converted %s data to unicode
s ^<\?xml[^>]*?>s& u
( R R R R R R- Rl R2 R Ry R ( R R t newdatat declmatcht newdecl( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt _toUTF8J s\ 8
8
c C s t i d t i } | i d | } t i d t i } | i | } | o | d p d } | i i d o
d } n d } | i d | } | | f S( s Strips DOCTYPE from XML document, returns (rss_version, stripped_data)
rss_version may be 'rss091n' or None
stripped_data is the same XML document, minus the DOCTYPE
s ]*?)>R s ]*?)>i t netscapeR N( Rl R2 t MULTILINERy R R R Ri ( R t entity_patternt doctype_patternt doctype_resultst doctypeR ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt
_stripDoctype s
c C s t } t | d y0 d" } | i | t | | } d } } WqqXn | oK d# | j o> y0 d# } | i | t | | } d } } WqcqcXn | p: d | d | d <| i? | d- <| S(. s0 Parse a feed from a URL, file, stream, or stringR, R. i R i t bozo_exceptionR R s content-encodingR
t fileobjR R t ETagR s
Last-ModifiedR; R: R9 i R R R s content-types %s is not an XML media types no Content-type specifiedR s content-locations content-languagei0 s1 The feed has not changed since you last checked, s: so the server sent no data. This is a feature, not a bug!t
debug_messages utf-8s windows-1252s# document encoding unknown, I tried s2 %s, %s, utf-8, and windows-1252 but nothing workeds+ documented declared as %s, but parsed as %st _ns_stackR s$ http://www.w3.org/XML/1998/namespaceiNs xml parsing failed
R (@ R+ t _XML_AVAILABLERP RQ t InstanceTypeR, R R Ri R^ R
R RO t GzipFileR R t
decompresst MAX_WBITSR t getheaderR} R: R R* R R RS R R R R t chardett detectR R R R R t make_parsert PREFERRED_XML_PARSERSt
setFeatureR
t feature_namespacest setContentHandlert setErrorHandlert xmlreadert InputSourcet
setByteStreamR t parseR t tracebackt print_stackt print_excR R R R
R? R, R R. R R ( R R R; R R! R" t resultt fR R R t
last_modifiedR R R R R t bozo_messageR R t use_strict_parsert known_encodingt tried_encodingst proposed_encodingt
feedparsert saxparserR R ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyR s(
#"
#
"
t __main__( t pprint( t __doc__t __version__t __license__t
__author__t __contributors__R R R R R R R* Rl R R. Rz RF R RQ R R R t cStringIOR R R
Ri R t xml.saxR R R t xml.sax.saxutilsR R
R R R$ t cjkcodecs.aliasest cjkcodecst iconv_codecR t chardet.constantst constantsR R R R R R R2 t tagfindt specialt charreft SUPPORTED_VERSIONSR* R% t NameErrorR+ Rl Rm Rw Rx R~ R R
R R R+ R R? R@ R* RX R, t HTTPDigestAuthHandlerR t HTTPDefaultErrorHandlerR R, R- R0 t
_iso8601_tmplRV t tmplR t _iso8601_reR t regexR. RD RQ t _korean_yeart
_korean_montht _korean_dayt
_korean_amRY RS RX RV R[ R\ R] Ra R` R_ Rd Rf Re Rg RT Rb t _additional_timezonest
_timezonesRj R} R R R R R t argvt exitt urlsR R: R ( ( ( sB /afs/athena.mit.edu/user/w/d/wdaher/Public/rssZephyr/feedparser.pyt s
K &Hs' 5 '%6 Z
n- N
]
)
5