yIfD ddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z m Z mZmZddlmZmZmZddlmZmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(ddl)m*Z*ddl+m,Z,dd l-m.Z.m/Z/e d Z0e1Z2e1Z3ee.e/fZ4eGd d Z5eGd dZ6eGddZ7eGddZ8de e0dee e2e0ffdZ9 d+de5de5de e.de:ddf dZ;ddde5ded ed#e6d$e1de:fd%Z?de5d&e.d$e1de:fd'Z@de5d(e.d$e1de:fd)ZAde5derrK)rLr7r8s rN append_safezLine.append_safehs  &! + +#::<< , I !GHHH{ ty,>>> K D| 44444rOcht|jdko|jdjtkS)z"Is this line a standalone comment?r)lenr1r>rrLs rNrSzLine.is_comment|s-4;1$RQ)<@R)RRrOc`t|o|jdjtjkS)zIs this line a decorator?r)r@r1r>r&ATrYs rN is_decoratorzLine.is_decorators%Dzz=dk!n1UX==rOcTt|ot|jdS)zIs this an import line?r)r@rr1rYs rNrzLine.is_imports#Dzz7i A777rOcTt|ot|jdS)zIs this a with_stmt line?r)r@r r1rYs rNr zLine.is_with_or_async_with_stmts$DzzH8QHHHrOct|o5|jdjtjko|jdjdkS)z Is this line a class definition?rclass)r@r1r>r&NAMErArYs rNis_classz Line.is_classs@ JJ 0 A#uz1 0 A$/ rOcd|jo)|jdddtdDkS)zEIs this line a class definition with a body consisting only of "..."?NcBg|]}ttjdS.r'r&DOT.0_s rN z&Line.is_stub_class..s16 6 6 %&DC 6 6 6 rO)rbr1rangerYs rN is_stub_classzLine.is_stub_classsG} RSS!16 6 */((6 6 6 "  rOc6 |jd}n#t$rYdSwxYw |jd}n#t$rd}YnwxYw|jtjkr |jdkp8|jtjko#|duo|jtjko |jdkS)zBIs this a function definition? (Also returns True for async defs.)rFrWNdef)r1 IndexErrorr>r&rarAASYNC)rL first_leaf second_leafs rNis_defz Line.is_defs QJJ   55  *.+a.KK   KKK 5:-K*2Be2K Ou{ * +4' + EJ. +!U*  s   0 ??c|joE|jddttjdgdt dDzkS)zHIs this line a function definition with a body consisting only of "..."?N:cBg|]}ttjdSrfrhrjs rNrmz$Line.is_stub_def..s7O O O %&DC O O O rOrn)rwr1r'r&rCrorYs rN is_stub_defzLine.is_stub_defsb{ t{233/Dc4J4J3KO O */((O O O 4   rOc6t|ot|jdkor|jok|jdjt jkoK|jdjdko5|jdjt jko|jdjdkS)zzIs this a class with no base classes but using parentheses? Those are unnecessary and should be removed. (rn)) r@rXr1rbr>r&LPARrARPARrYs rNrDzLine.is_class_paren_emptys JJ ,DK  A% ,  , A#uz1 , A$+  ,  A#uz1  ,  A$+ rOc|r |jdjtjkrdS|jdj}|drdS|drdSdS)z#Is the line a triple quoted string?rF)z"""z'''T)zr'''zr"""zR'''zR""")r1r>r&STRINGrA startswith)rLrAs rN_is_triple_quoted_stringzLine._is_triple_quoted_stringsp t{1~*el::5 A$   N + + 4   < = = 4urOctj|jvr|jSt |ot |jd|jS)zIs the line a docstring?r)runify_docstring_detectionr-rr@rr1rYs rNrzLine.is_docstrings@  ,DI = =0 0DzzEl4;q>49EEErOcfd|jDtjdkS)z Is the line a chained assignmentcg|] }|j Sr>rkr7s rNrmz.Line.is_chained_assignment..s222d 222rOrW)r1countr&EQUALrYs rNis_chained_assignmentzLine.is_chained_assignments/32dk22288EEIIrOcvt|jdkrdS|jdjtjkS)z/Does this line open a new level of indentation.rF)rXr1r>r&rCrYs rN opens_blockzLine.opens_blocks4 t{  q 5{2#u{22rOfirst_leaf_matchesrct|jdkrdS|jd}|jtks|jdS|dup||jS)zIs this line converted from fmt off/skip code? If first_leaf_matches is not None, it only returns True if the first leaf of converted code matches. rWFrN)rXr1r>rfmt_pass_converted_first_leaf)rLrr7s rNis_fmt_pass_convertedzLine.is_fmt_pass_convertedsm t{  q 5{1~ I+ + +195!T) -?-?  .. .  rOc@|jD]}|jtkrdSdS)z)If so, needs to be split before emitting.TF)r1r>rrLr7s rNcontains_standalone_commentsz!Line.contains_standalone_commentss4K  Dy...tt/urOctj|jdD]W\}}|tjkrt |}t |dkr9|D]}||rdSXdS)zFChck if we have an implicit multiline string with comments on the linec|jSNr)r7s rNzGLine.contains_implicit_multiline_string_with_comments..sdirOrWTF) itertoolsgroupbyr1r&rlistrXcomments_after)rL leaf_typeleaf_group_iterator leaf_listr7s rN0contains_implicit_multiline_string_with_commentsz5Line.contains_implicit_multiline_string_with_commentss.7.? K/// / *I*EL((011I9~~""!  &&t,, 444  urOct} |jd}|t||jt jks|jt jkr6|js/|jd}|t|n#t$rYdSwxYwd}|j D]4\}}|D],}t|r|st|s||vrdSd}-5dS)Nrr<FT)setr1addidr>r&COMMArrArsr2itemsrr)rL ignored_ids last_leaf comment_seenleaf_idr2comments rN$contains_uncollapsable_type_commentsz)Line.contains_uncollapsable_type_commentss'ee   BI OOByMM * * *~,,%*,,Y_, !KO 9 ...   55  !%!4!4!6!6 $ $ GX# $ $"7++$#$27;;$#;66#ttt#  $usBB B.-B.cZ|jsdStd|jDd}tdt|jDd}||krP|jddD]@}|jt |gD]}t |rdSAdS)NFc3:K|]}|jdk |jVdSrNlinenors rN z9Line.contains_unsplittable_type_ignore..Is1SS4$+QRBRBR4;BRBRBRBRSSrOrc3:K|]}|jdk |jVdSrrrs rNrz9Line.contains_unsplittable_type_ignore..Ks0 O OTdkQ>N>NT[>N>N>N>N O OrOr<T)r1nextreversedr2getrr)rL first_line last_linenoders rN!contains_unsplittable_type_ignorez&Line.contains_unsplittable_type_ignore8s{ 5SS4;SSSUVWW  O OXdk%:%: O O OQR    " " BCC( $ $#}00D2>>$$G-g66$#ttt$$urOc>td|jDS)Nc34K|]}t|VdSr)rrs rNrz2Line.contains_multiline_strings..Zs+EE&t,,EEEEEErO)anyr1rYs rNcontains_multiline_stringszLine.contains_multiline_stringsYs!EEEEEEEErOclosingc.|jtvr'|jr |jdjtjksdS|jtjkrdS|jtjkr|j{|jjtj kra|j Zt|j ||jtj tjfr'|j J|j jtjksJdSdS|jrdS|j t|j ||jsdSdS)zReturn True if we have a magic trailing comma, that is when: - there's a trailing comma here - it's not from single-element square bracket indexing - it's not a one-tuple rFTN)brackets)r>rr1r&rRBRACERSQBparentr#traileropening_bracketrLSQB prev_sibling subscriptlistr)rLrs rNrHzLine.has_magic_trailing_comma\s# L, , ,  - B$ 335 <5< ' '4 <5: % %*N'4<77+7++K#j%*5 8+777+0D4FFFFFu4 > 4  " .7N  #Wdk8 8 .4urOrc|jtkr"|jr d|_dS|jt jkrdS|jst|_d|_dS|jd}|jt jkr|j s|j rtt|j dkrIt|s:t|jdkrt|_d|_dS|jd}|jt!|g|dS)z0Add an inline or standalone comment to the line.Frrnrr<T)r>rr3any_open_bracketsrEr&COMMENTr1rrArrXrrr2 setdefaultrrK)rLrrs rNrJzLine.append_comments9 L. . .$6688 / GN5 <5= ( (5{ -GLGN5KO Nej ( (O )  )D)0022334499#G,,: 4;!##1 !#u BI   I33::7CCCtrOcR|jt|gS)z;Generate comments that should appear directly after `leaf`.)r2rrrs rNrzLine.comments_afters }  D2...rOc|j}|jt|g}|jt|jdg|dS)z@Remove the trailing comma and moves the comments attached to it.rN)r1popr2rrextend)rLtrailing_commatrailing_comma_commentss rNrIzLine.remove_trailing_commasx**"&-"3"3B~4F4F"K"K   DKO!4!4b99@@ #     rOcJ|j}|dS|j}t|tr<|jt jkrdS|jt jkrt||}|duo*td| DS)zAReturn True iff `leaf` is part of a slice with non-trivial exprs.NFc32K|]}|jtvVdSr)r>r)rkns rNrz,Line.is_complex_subscript..s;3 3 +,AF& &3 3 3 3 3 3 rO) r3 get_open_lsqb next_sibling isinstancer(r>r# listmakerrrr pre_order)rLr7 open_lsqbsubscript_starts rNrFzLine.is_complex_subscripts(6688  5#0 ot , , G#t~55u#t'999"/"F"Fd* s3 3 0?0I0I0K0K3 3 3 0 0  rO is_reversedc#Kttttgtt t tff|rtnt}||j D]p\}}t|j t|j z}d|j vrdS| |D]}|t|j z }|||fVqdS)zReturn an enumeration of leaves with their length. Stops prematurely on multiline strings and standalone comments.  N)rrr r'rr Indexenumerate_reversed enumerater1rXrErAr)rLropindexr7lengthrs rNenumerate_with_lengthzLine.enumerate_with_lengths htn%xeTk0B'CC D"- <  9  2dk?? & &KE4%%DJ7Ftz!!..t44 - -#gm,,,v% % % % % & &rOc\t|j|j|j|j|jS)N)r-r.r4r5r6)r+r-r.r4r5r6rYs rNclonez Line.clones5* 0!2!%!:     rOcV|sdSd|jz}t|j}t|}|j||j}|D]}|t |z }tj |j D]}|t |z }|dzS)zRender the line.rz ) r.iterr1rrErAstrrchain from_iterabler2values)rLindentr1firstresr7rs rN__str__z Line.__str__s 4$*$dk""V 4v4u{44  D 3t99 CC 44T]5I5I5K5KLL  G 3w<< CCTzrOc8t|jp|jS)z/Return True if the line has leaves or comments.)r@r1r2rYs rN__bool__z Line.__bool__sDK04=111rO)FFF)r:N)r:r+)=__name__ __module__ __qualname____doc__rr-r__annotations__r.intrr1rr'dictr2rLeafIDrr3r4r@r5r6r rKrUpropertyrSr\rr rbrprwr|rDrrrrrrrrrrrrHrJrrIrFrr rrrrrrrrOrNr+r+1saEEE"""D$"""E3NNNt444FDJ444).t)D)D)DHd64:%&DDD&+eN&K&K&KO^KKK!OT!!!"d"""+/(4.///MR'%'%'%(,'%EI'% '%'%'%'%R555D5T5555(SDSSSXS>d>>>X>84888X8IDIIIXI $   X  t   X     X $ T   X   d    X   $   X FdFFFXF JtJJJXJ3T333X3IM   %-hvt|.D%E     (d $    "d""""H4BFDFFFF******X#d#t####J/4/DJ////      $    (#(&&& %tS() *&&&&*     2$222222rOr+cFeZdZUdZeed<eed<eed<eed<eed<dS) RHSResultz2Intermediate split result from a right hand split.headbodytailrclosing_bracketN)rrrrr+rr'rrOrNr r sK<< JJJ JJJ JJJrOr ceZdZUdZeed<eded<eed<dZe ed<e e Z e eed<dZe ed <d Zeed <d e efd ZdS) LinesBlockzClass that holds information about a block of formatted lines. This is introduced so that the EmptyLineTracker can look behind the standalone comments and adjust their empty lines for class or def lines. r-previous_block original_linerbeforer/ content_linesafterF form_feedr:ctt|j}t|j|j|}|g|jz||jzgzS)N)r-)rr+r-r!rrrr)rL empty_linerEs rN all_lineszLinesBlock.all_linessP49---.. #DKLLx$,, TZ0G/HHHrON)rrrrrrr r+rrrrrrrrrr@rrrOrNrr s JJJ\****FCOOO$uT:::M49:::E3NNNItI49IIIIIIrOrc eZdZUdZeed<dZeeed<dZ ee ed<e e Z eeed<dZee ed<d ed e fd Zd ed eeeffd Zd ed eded eeeffdZdS)EmptyLineTrackera{Provides a stateful method that returns the number of potential extra empty lines needed before and after the currently processed line. Note: this tracker works on lines that haven't been split yet. It assumes the prefix of the first leaf consists of optional newlines. Those newlines are consumed by `maybe_empty_lines()` and included in the computation. r-N previous_linerr/ previous_defssemantic_leading_comment current_liner:c|jdko't|jod|jdjv}||\}}|jr |jjnd}td||z }|jrO|jjCt|jj jdkr!|jj j r|j s |j sd}t|j|j||||}|jr2|j#|jjs|jjr|r|j|r||_n|jr|rd|_||_||_|S)zReturn the number of extra empty lines before and after the `current_line`. This is for separating `def`, `async def` and `class` with extra empty lines (two on module-level). rz NrW)r-rrrrr)r.r@r1rE_maybe_empty_linesrrmaxrXrrrbrwrr-rSrr\r)rLrrrrprevious_afterblocks rNmaybe_empty_linesz"EmptyLineTracker.maybe_empty_lines0s  ! # 8\()) 8,-a077  // == 6:6IP,22qQ/00   #2:D'5<==BB#1>C!*C.:.ACF.&      " 1!)&3*+6*;A*2:f:05-* 1f 1,0D ))# rOcpd}|jdkr|jjrdnd}|jr?|jd}|jd}t ||}d|_nd}t|}|j}d}|jrL|jdj|kr6|j }|jr|jdj|k6|j s|j r|j ||j dS|jr(|j j rdS|j jr|j j rdS||j J|jjr5|j r |jsd}nk|r|j s|j j r|rdnd}nO|rd}nJd}nG|rd}nB|s>|jr7|jdjt$jkr|jdjd vrd}nd}|js|j s|j r||||S|j jr8|js1|t. s||j jkr|pddfS|dfS) NrWrrrrrrrrrW)withtryforwhileifmatchr)r.r-is_pyir1rErminr@rrrwrbrKrrrrpr>r&rCrAr\#_maybe_empty_lines_for_class_or_defrr)rLr max_allowedruruser_had_newliner. previous_defs rNr!z#EmptyLineTracker._maybe_empty_linesbs   " "#y/6!!QK   %,Q/J&,,T22F--F "J  F<<"   4T%7%;%AU%J%J-1133L  4T%7%;%AU%J%J   4,"7 4   % %l 3 3 3   %4  $ !* t!- $2D2K t  #%111y (1KFF<#64;M;T"29QQFFFFFFFF$*%+B/4 CC$+A.4MNNFFF  $  (; |?T ;;f&6    ( $ * $!66)6TT $+111Ka!# #qyrOrr3c|jJ|jjr|jjr |jrdSdS|jj|jkr.|jjs |jjr|jjrdS|rdnddfSd}|jjr]|jj|jkrH|dkrB|j }|7|j 0|j j js|j j j s|j dkr|}ndS|jjr|js |jjrI|jj|jkrd}n|jj|jkrd}n|jr|jjrd}nnd}nk|jj|jkrd}nS|js|jr'|jjs|jrtd|}n!d}nd}n|jrdnd}|jjr|sd}|-|j }|$t!|j ||jz |_ d}|dfS)Nr(r'rWrr)rr\r-r/rpr.rbrwrSrrrrrr0r|r"r)rLrrr3comment_to_add_newlinesslcnewlinesrs rNr1z4EmptyLineTracker._maybe_empty_lines_for_class_or_defs!---   * y L$> t4   #l&8 8 8   ' 9+/+=+D 9y t(/11a2 28<   ) "(L,>>>! /C&2*8A3*8D3J!OO*-''t 9 " $ (:(C %+l.@@@ HH'- 0BBB HH!/!D4F4T! HH HH#)L,>>># '3'@ (/  %! #1f~~HH !HH(.5qqAH!- 6F  " .4CN)/6AANDXX(.{rO)rrrrrrrr r+rrrrrrrr%r rr!r@r1rrOrNrr s% JJJ$(M8D>(((+/NHZ(/// %d ; ; ;M4:;;;59hz29990d0z0000dRtRc3hRRRRhN N*-NAEN sCxNNNNNNrOrsequencer:c#hKt|dz }t|D] }||fV|dz}dS)z;Like `reversed(enumerate(sequence))` if that were possible.rWN)rXr)r9relements rNrrsS MMA EH%%g  rOFnew_lineold_liner1r8c|D]r}t|j|j}t|||||||D]}||dsdS)a Append leaves (taken from @old_line) to @new_line, making sure to fix the underlying Node structure where appropriate. All of the leaves in @leaves are duplicated. The duplicates are then appended to @new_line and used to replace their originals in the underlying Node structure. Any comments attached to the old leaves are reattached to the new leaves. Pre-conditions: set(@leaves) is a subset of set(@old_line.leaves). rQTN)r'r>rAr"rKr)r<r=r1r8old_leafnew_leaf comment_leafs rN append_leavesrBs== x~66h)))|<<<$33H== = =L OOLtO < < < < = ==rOr)line_strliner-rCc|st|}tj|vr1t||jkod|vo| S|rdSd|vrt||jkS|d^}}}t||jkst||jkrdSg}d}g}tj} t|j D]\} } | tjkrd} | j dzt|kr| dn/| j dzt|kr|} | %|#|j | j dzkr| j } | dkrdS| j | krh| jt jkrSdg} | |z } |js | j dkr9| t|j dz ks | j| vr|| j xxdz cc<| tjkrt)| | j } t+| r`t|dkrdS| }| }t-||vr5| ||jn|j}t-||v5t|dkrdSt1d|DS)aFor non-multiline strings, return True if `line` is no longer than `line_length`. For multiline strings, looks at the context around `line` to determine if it should be inlined or split up. Uses the provided `line_str` rendering, if any, otherwise computes a new one. rFNrWrTc3"K|] }|dkV dSrr)rkvals rNrz'is_line_short_enough..s&**Csax******rO)line_to_stringrmultiline_string_handlingr% line_lengthrsplitmathinfrr1 bracket_depthrXrKrr>r&rr4rr0rrrall)rDr-rCrrllastcommasmultiline_stringmultiline_string_contextsmax_level_to_updateir7 had_comma ignore_ctxsctxs rNis_line_short_enoughrY's( (!$''(44 h  4#3 3 8H$ 855777  ((**u 8""d&666nnT**OEAt$***ioo@P.P.PuF'+*,-1XT[)))!)!4 $( * *'+I!A%F 33 a    #a'#f++55"JJLL %$0$2d6H16LLL'+&8#q== 55  !4 4 4ek9Q9Q04fK 4 4K$ 0(:Q(>(>S%%)))T->k-Q-Qt)***a/*** $( * *"%&94;M"N"N  t $ $ !,--11uu# Cc((h&&)00555:%j c((h&& $%%**t **6*** * **rOc|j}t|dkrdS|djtjkr|djtjkrd}d}|d}|dddD]}|jt vr|jtvrdS|dz }nh|jtjkr|dz }nM|jtjkr'|jtjks|jt vsdSn|jtvrdS|dkr |dkrdSdS) zReturn False if the line cannot be split *for sure*. This is not an exhaustive search but a cheap heuristic that we can use to avoid some unfortunate formattings (mostly around wrapping unsplittable code in unnecessary parentheses). rFrrWrr<NT) r1rXr>r&rrirrra)rDr1 call_count dot_countrr7s rN can_be_splitr]s[F 6{{Qu ay~%%&).EI*E*E  bz26r6N  Dy,,,9$444 55a ei''Q ej(( UY..$)?O2O2O 55"222uu1}}auu 4rOrhsrJc|j}d}t|jD]K}|r ||jurd}|jt kr|sdS|s%|jt vr|j|jvr |jr|}L|j}|j sdS| }| |}|dkrdS|dkr|tkr|j jrdS|tkrdSt!|jdks Jd|jd}|jd} |jt"vr"| jt vrt%|||rdS|jd } |jd } | jt&jksK| jt&jks6| jt&jkrV| jrO| jjt0jkr5| jt"vrdSt5|rdSt7|| | rdSdS) aDoes `rhs.body` have a shape safe to reformat without optional parens around it? Returns True for only a subset of potentially nice looking formattings but the point is to not return false positives that end up producing lines that are too long. NFTrWrzStranded delimiterr)rrJr<r)rPrJ)r rr1rr>rrrAr3 delimitersmax_delimiter_prioritydelimiter_count_with_priorityrr r rrXr_can_omit_opening_parenr&rrrrr#rr_can_omit_closing_paren) r^rJrDrr7bt max_prioritydelimiter_countrsecond penultimaterPs rNcan_omit_invisible_parensrjsA 8D'+O%% # #  #t'FFF"O 9* * *? *55 # ---$ 33 4#O B =t,,..L66|DDOu! > ) )ch.Q ) 5 |##t t{  q "6  KNE [^F z%%%&+=M*M*M "4u+ N N N 4 +b/K ;r?D UZ 9 $ $ I # #  $  DL00  / / /5 u % % 4 "4d L L L 4 5rOrcd}d|jz}d}|D]>\}}}|jtvr |j|urd}|r||z }||krn.|jt vrd}?t |j|dzkrdSdS) See `can_omit_invisible_parens`.Fr~rTrW)r.rr>rrrrXr1)rDrrJ remainderr_indexr7 leaf_lengths rNrcrcsI ^F F%)%?%?%A%A!k 9( ( (T-AU-J-JI  " k !F ##y,,,!  t{  vz ) )4 5rOrPcd|jz}d}|D]0\}}}||z }||jur |s||krdS |jtvrd}1dS)rlr~FT)r.rrr>r)rDrPrJrseen_other_bracketsrnr7ros rNrdrd s ^F%)%?%?%A%A''!k+ 4' ' '" f &;&;tt'<Y* * *"&  5rOcFt|dS)zmReturns the string representation of @line. WARNING: This is known to be computationally expensive. r)rrB)rDs rNrHrH1s t99??4  rOr)CrrL dataclassesrrtypingrrrrr r r r r rblack.bracketsrrr black.moderr black.nodesrrrrrrrrrrrrr r!r"r#r$ black.stringsr%blib2to3.pgen2r&blib2to3.pytreer'r(r)rrrLNr+r rrrr@rBrrYr]rjrcrdrHrrOrNr|s ((((((((                        HGGGGGGGGG$$$$$$$$&$##### &&&&&&&& GCLL   4: J2J2J2J2J2J2J2 J2Z   IIIIIII I* ccccccc cL!%q/1JNS==="=,0J=FJ= ====202X+X+X+ X+X+),X+ X+X+X+X+v!t!!!!!H^ ^^ ^^^^B$$ST2$CD"!!#!!!!!!rO