/usr/lib/python3/dist-packages/bs4/__pycache__
Edit: /usr/lib/python3/dist-packages/bs4/__pycache__/diagnose.cpython-310.pyc (8298B)
o
7aK @ s d Z dZddlZddlmZ ddlmZ ddlZddlmZm Z ddl
m Z ddl Z ddl
Z
ddlZddlZddlZddlZddlZddlZdd Zd#d d ZG d
d deZdd ZdZdZd$ddZd%ddZd&ddZd'd d Z d(d d!Z e d"kreej dS dS ))z=Diagnostic functions, mainly for use when doing tech support.MIT N)StringIO)
HTMLParser)
BeautifulSoup __version__)builder_registryc C sR t dt t dtj g d}|D ]}tjD ] }||jv r! n q|| t d| qd|v rc|d zddl m
} t d d
t t
|j W n tyb } z
t d W Y d }~nd }~ww d
|v rz
dd l}t d|j W n ty } z
t d W Y d }~nd }~ww t| dr| } nJ| ds| drt d| t d d S z&tj| rt d| t| }| } W d n1 sw Y W n ty Y nw t d |D ]E}t d| d} z
t| |d}
d} W n ty } zt d| t W Y d }~nd }~ww | r"t d | t |
t d qd S ) zDiagnostic suite for isolating common problems.
:param data: A string containing markup that needs to be explained.
:return: None; diagnostics are printed to standard output.
z'Diagnostic running on Beautiful Soup %szPython version %s) html.parserhtml5liblxmlz;I noticed that %s is not installed. Installing it may help.r
zlxml-xmlr etreezFound lxml version %s.z.lxml is not installed or couldn't be imported.Nr zFound html5lib version %sz2html5lib is not installed or couldn't be imported.readzhttp:zhttps:z<"%s" looks like a URL. Beautiful Soup is not an HTTP client.zpYou need to use some other library to get the document behind the URL, and feed that document to Beautiful Soup.z7"%s" looks like a filename. Reading data from the file. z#Trying to parse your markup with %sF)featuresT %s could not parse the markup.z#Here's what %s did with the markup:zP--------------------------------------------------------------------------------) printr sysversionr buildersr removeappendr
r joinmapstr LXML_VERSION ImportErrorr hasattrr
startswithospathexistsopen
ValueErrorr Exception traceback print_excprettify) data
basic_parsersnamebuilderr er fpparsersuccesssoup r1 ./usr/lib/python3/dist-packages/bs4/diagnose.pydiagnose s
r3 Tc K sJ ddl m} |jt| fd|i|D ]\}}td||j|jf qdS )a Print out the lxml events that occur during parsing.
This lets you see how lxml parses a document when no Beautiful
Soup code is running. You can use this to determine whether
an lxml-specific problem is in Beautiful Soup's lxml tree builders
or in lxml itself.
:param data: Some markup.
:param html: If True, markup will be parsed with lxml's HTML parser.
if False, lxml's XML parser will be used.
r r htmlz %s, %4s, %sN)r
r iterparser r tagtext)r( r4 kwargsr eventelementr1 r1 r2
lxml_trace] s "r; c @ s` e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd d
Z dd Z
dd Z dd Z dd Z
dS )AnnouncingParserzSubclass of HTMLParser that announces parse events, without doing
anything else.
You can use this to get a picture of how html.parser sees a given
document. The easiest way to do this is to call `htmlparser_trace`.
c C s t | d S )N)r )selfsr1 r1 r2 _pu s zAnnouncingParser._pc C | d| d S )Nz%s STARTr? )r= r* attrsr1 r1 r2 handle_starttagx z AnnouncingParser.handle_starttagc C r@ )Nz%s ENDrA r= r* r1 r1 r2
handle_endtag{ rD z AnnouncingParser.handle_endtagc C r@ )Nz%s DATArA r= r( r1 r1 r2 handle_data~ rD z AnnouncingParser.handle_datac C r@ )Nz
%s CHARREFrA rE r1 r1 r2 handle_charref rD z AnnouncingParser.handle_charrefc C r@ )Nz %s ENTITYREFrA rE r1 r1 r2 handle_entityref rD z!AnnouncingParser.handle_entityrefc C r@ )Nz
%s COMMENTrA rG r1 r1 r2 handle_comment rD z AnnouncingParser.handle_commentc C r@ )Nz%s DECLrA rG r1 r1 r2 handle_decl rD z AnnouncingParser.handle_declc C r@ )Nz%s UNKNOWN-DECLrA rG r1 r1 r2 unknown_decl rD z AnnouncingParser.unknown_declc C r@ )Nz%s PIrA rG r1 r1 r2 handle_pi rD zAnnouncingParser.handle_piN)__name__
__module__ __qualname____doc__r? rC rF rH rI rJ rK rL rM rN r1 r1 r1 r2 r< m s r< c C s t }|| dS )zPrint out the HTMLParser events that occur during parsing.
This lets you see how HTMLParser parses a document when no
Beautiful Soup code is running.
:param data: Some markup.
N)r< feed)r( r. r1 r1 r2 htmlparser_trace s rT aeioubcdfghjklmnpqrstvwxyz c C s: d}t | D ]}|d dkrt}nt}|t|7 }q|S )z#Generate a random word-like string.r r )range _consonants_vowelsrandomchoice)lengthr> itr1 r1 r2 rword s ra c C s d dd t| D S )z'Generate a random sentence-like string. c s s | ] }t td dV qdS )rb N)ra r\ randint).0r_ r1 r1 r2
s z rsentence..)r rY )r^ r1 r1 r2 rsentence s rh c C s g d}g }t | D ]9}tdd}|dkr#t|}|d| q
|dkr3|ttdd q
|dkrCt|}|d| q
d d
| d S ) z+Randomly generate an invalid HTML document.)pdivspanr_ bscripttabler z<%s> rb rX zz
z)rY r\ re r] r rh r ) num_elements tag_nameselementsr_ r] tag_namer1 r1 r2 rdoc s
rw 順 c
C s& t dt t| }t dt| dddgddfD ]>}d}zt }t||}t }d}W n tyK } zt d | t W Y d
}~nd
}~ww |rXt d ||| f qd d
l m
} t }| | t }t d|| d d
l } |
}t }|| t }t d|| d
S )z.Very basic head-to-head performance benchmark.z1Comparative parser benchmark on Beautiful Soup %sz3Generated a large invalid HTML document (%d bytes).r
r4 r r FTr Nz"BS4+%s parsed the markup in %.2fs.r r z$Raw lxml parsed the markup in %.2fs.z(Raw html5lib parsed the markup in %.2fs.)r r rw lentimer r$ r% r& r
r HTMLr r parse)
rs r( r. r/ ar0 rm r, r r r1 r1 r2 benchmark_parsers s:
r~ r
c C sX t }|j}t| }tt||d}td||| t |}|
d | dd dS )z7Use Python's profiler on a randomly generated document.)bs4r( r. z bs4.BeautifulSoup(data, parser)
cumulativez
_html5lib|bs42 N) tempfileNamedTemporaryFiler* rw dictr cProfilerunctxpstatsStats
sort_stats print_stats)rs r.
filehandlefilenamer( varsstatsr1 r1 r2 profile s
r __main__)T)rW )rb )ri )rx )rx r
)!rR __license__r ior html.parserr r r r bs4.builderr r r r\ r rz r% r r3 r; r< rT r[ rZ ra rh rw r~ r rO stdinr r1 r1 r1 r2 s<
G&