o 2gx@sUdZddlmZddlZddlmZddlmZmZm Z m Z m Z m Z ddl mZmZddlmZmZddlmZdd lmZmZmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4dd l5m6Z6dd l7m8Z8m9Z9m:Z:m;Z;mZ>m?Z?m@Z@mAZAmBZBmCZCmDZDmEZEmFZFmGZGmHZHmIZImJZJdd lKmLZLdZMdeNd<dZOdeNd<dZPdeNd<GdddZQdS)zZSemantic analysis of named tuple definitions. This is conceptually part of mypy.semanal. ) annotationsN)contextmanager) ContainerFinalIteratorListMappingcast)ARG_TYPE ErrorCode)TypeTranslationErrorexpr_to_unanalyzed_type)MessageBuilder) ARG_NAMED_OPTARG_OPTARG_POSMDEFArgumentAssignmentStmtBlockCallExprClassDefContext Decorator EllipsisExpr ExpressionExpressionStmtFuncBaseFuncDefListExprNamedTupleExprNameExprPassStmtRefExpr StatementStrExpr SymbolTableSymbolTableNodeTempNode TupleExprTypeInfo TypeVarExprVaris_StrExpr_list)Options)PRIORITY_FALLBACKSSemanticAnalyzerInterfacecalculate_tuple_fallbackhas_placeholderset_callable_name) TYPED_NAMEDTUPLE_NAMESAnyType CallableType LiteralType TupleTypeType TypeOfAnyTypeType TypeVarIdTypeVarLikeType TypeVarType UnboundType has_type_vars)get_unique_redefinition_name) __new____init__ __slots____getnewargs___fields_field_defaults _field_types_make_replace_asdict_source__annotations__rNAMEDTUPLE_PROHIBITED_NAMESzYInvalid statement in NamedTuple definition; expected "field_name: field_type [= default]"NAMEDTUP_CLASS_ERROR_NTSELF_TVAR_NAMEc@seZdZdLd d ZdMddZdNddZdOddZdPd$d%ZdQd(d)ZdRd/d0Z dSd;d<Z e dTd?d@Z dUdDdEZ dVdWdJdKZdFS)XNamedTupleAnalyzeroptionsr.apir0msgrreturnNonecCs||_||_||_dSN)rSrTrU)selfrSrTrUrZO/home/garg/my-data/venv/lib/python3.10/site-packages/mypy/semanal_namedtuple.pyrCbs zNamedTupleAnalyzer.__init__defnr is_stub_filebool is_func_scopetuple[bool, TypeInfo | None]c Cs|jD]k}t|trn|j||jtvrn|||}|dur"dS|\}}}} |r;d|jvr;|jdt |j 7_d} t|j t rG|j j } ||j||||j | } t | dd|_ |j |j _ |j|j _| |j_d| fSqdS)aAnalyze if given class definition can be a named tuple definition. Return a tuple where first item indicates whether this can possibly be a named tuple, and the second item is the corresponding TypeInfo (may be None if not ready and should be deferred). N)TN@Tis_typed)FN)base_type_exprs isinstancer#rTacceptfullnamer4check_namedtuple_classdefnamestrlineanalyzedr infobuild_namedtuple_typeinfocolumndefsbody) rYr\r]r_ base_exprresultitemstypes default_items statements existing_informrZrZr[analyze_namedtuple_classdefis.         z.NamedTupleAnalyzer.analyze_namedtuple_classdefKtuple[list[str], list[Type], dict[str, Expression], list[Statement]] | Nonec Cst|jdkr |d|g}g}i}g}|jjD]}||t|ts[t|ts5t|t r6t|j t r6qt|t t fr>qt|t rJt|j trJq||j||t|qt|jdksjt|jdts{||j||t|q|jdj}|||jdur|ttjn|jj|j|j dd} | durdS|| |dr|d|||jdust|d r|js|t|qt|jt r|r|d |q|j||<q|j!rd } |j!D] } |j"#| | |q||||fS) aParse and validate fields in named tuple class definition. Return a four tuple: * field names * field types * field default values * valid statements or None, if any of the types are not ready. z"NamedTuple should be a single baserNNamedTuple item typeallow_placeholderprohibit_self_type_z7NamedTuple field name cannot start with an underscore: new_syntaxz:Non-default NamedTuple fields cannot follow default fieldsz( for "__init_subclass__" of "NamedTuple")$lenrdfailrprqappendrerr"rexprrrrr%popremoved_statementsrOlvaluesr!rityper5r: unannotatedrT anal_typer_ startswithhasattrrrvaluer(keywordsrU(unexpected_keyword_argument_for_function) rYr\r]rtrurvrwstmtrirl for_functionkeyrZrZr[rhsp                   z,NamedTupleAnalyzer.check_namedtuple_classdefnodervar_name str | None9tuple[str | None, TypeInfo | None, list[TypeVarLikeType]]cCst|ts ddgfS|}|j}t|tsddgfS|j}|dkr#d}n |tvr*d}nddgfS|||}|r@|\} } } } } }n>|rP|}|rO|dt|j7}n dt|j}}| |ggi|jd}| ||||||ksr|ry|j ||||gfS|s| dgfS|r|}n| }|dus|r|dt|j7}| rddt | t|  d| D}ni}d}t|jtr|jj}| || | ||j|}|r| ||||n t||d |_|j|||ks|r|j ||| || fS) aCheck if a call defines a namedtuple. The optional var_name argument is the name of the variable to which this is assigned, if any. Return a tuple of two items: * Internal name of the named tuple (e.g. the name passed as an argument to namedtuple) or None if it is not a valid named tuple * Corresponding TypeInfo, or None if not ready. If the definition is invalid but looks like a namedtuple, report errors but return (some) TypeInfo. Ncollections.namedtupleFTraz namedtuple@cSsi|]\}}||qSrZrZ).0arg_namedefaultrZrZr[ #s z7NamedTupleAnalyzer.check_namedtuple..rb)rercalleer#rgr4parse_namedtuple_argsrjrkrnstore_namedtuple_inforTadd_symbol_skip_localziprrlr rmset_line)rYrrr_callrrgrcrsrtrudefaultstypename tvar_defsokrirmrvrxrZrZr[check_namedtuplesf               z#NamedTupleAnalyzer.check_namedtuplermr*rirjrrrccCs.|j|||t||d|_|j|dS)Nrb)rT add_symbolr rlr)rYrmrirrcrZrZr[rIsz(NamedTupleAnalyzer.store_namedtuple_inforgWNone | tuple[list[str], list[Type], list[Expression], str, list[TypeVarLikeType], bool]cCsD|tvrdnd}|j}t|dkr|d|d|dSg}d}t|dkr|tvr3|d|dSt|jdddD]G\}}|d kr`||} t| ttfrVt | j }q=|d || q=|d kr||} t| t rx| j d vrx| j d k}q=|jd|d| tdq=|jddttgkr|d|d|dSt|dts|d|d|dS|dj} g} g} t|dttfs|dkrt|dtr|d} | jdd}nW|d ||dS|d}|dkrt|j s|d|dSdd|j D}n-dd|j D}|j|} ||j |}|dur dS|\}} }}|s1ggg| gdfS| s;dd|D} g}t}t|D]:\}}|||}|dur_||||qD|sn|d|d||d |}||||qDt|t|kr|d!|d||dt|}|| || | d"fS)#aParse a namedtuple() call into data needed to construct a type. Returns a 6-tuple: - List of argument names - List of argument types - List of default values - First argument of namedtuple - All typevars found in the field definition - Whether all types are ready. Return None if the definition didn't typecheck. NamedTuple namedtuplezToo few arguments for "z()"NFz%Too many arguments for "NamedTuple()"rz?List or tuple literal expected as the defaults argument to {}()rename)TrueFalserz5Boolean literal expected as the "rename" argument to z()codezUnexpected arguments to "r"z2()" expects a string literal as the first argumentr{r, z?List or tuple literal expected as the second argument to "{}()"z.String literal expected as "namedtuple()" itemcSg|]}|jqSrZ)valueritemrZrZr[ z.cSs.g|]}t|trt|jdkr|jdqS)rr{)rer)rrt)rtrZrZr[rscSsg|]}ttjqSrZ)r5r:rrrrZrZr[rz()" rz$Too many defaults given in call to "T)r4argsrr enumerate arg_namesrerr)listrtformatr!rir arg_kindsrr%rreplacesplitr-rTget_and_bind_all_tvars"parse_namedtuple_fields_with_typessetcheck_namedtuple_field_nameradd)rYrrg type_namerrrirargrrurstr_exprrtlistexpr type_exprsrsrrprocessed_items seen_namesrproblemnew_namerZrZr[rPs                 z(NamedTupleAnalyzer.parse_namedtuple_argsnodeslist[Expression]contextr;tuple[list[str], list[Type], list[Expression], bool] | Nonec Csg}g}|D]}t|tr}t|jdkr|d|dS|j\}}t|tr.||jn |d|dSz t||j |j j }Wnt yS|d|YdSw|j j ||j  dd} t| trkttj} | durwgggdfS|| q|d |dS||gd fS) zParse typed named tuple fields. Return (names, types, defaults, whether types are all ready), or None if error occurred. rz'Invalid "NamedTuple()" field definitionNz!Invalid "NamedTuple()" field namezInvalid field typer|r}Fz&Tuple expected as "NamedTuple()" fieldT)rer)rrtrr%rrr rSrTr]r rr_r?r5r: from_error) rYrrrtrurri type_noderrlrZrZr[rs>             z5NamedTupleAnalyzer.parse_namedtuple_fields_with_typesrt list[str]ru list[Type]rvMapping[str, Expression]rkintrxTypeInfo | Nonec sH|jdttj}|jd|g}|jd|g} |jd|g} |jd|g} |jd|g} |jdfdd|D} t| |}|pR|j|| d_t|| j rqt j j rq|jj dd j kd _d |ijd <t sts|jtfd d dCdDfdd }ddt||D}|D]}||ddqddt||D}tfdd|D|}|td|dd|td| dd|td | dd|td!dd|td"| dd|td#dd|jjd$kr|td%|ddj dusJttjd&t|jjgj ttjd'  dCdEfd0d1 }|d2dd3d|Dd4|jjd5kr[|d6dd7d|Dd4dFfd9d: |d;dfdg| d?|d@ddttdA| | dt gdBt!tjd&tgj ttj}t"t#|j$t<S)GNz builtins.strzbuiltins.tuplez builtins.dictztyping.Iterablezbuiltins.functioncsg|]}t|qSrZ)r7rstrtyperZr[r rz@NamedTupleAnalyzer.build_namedtuple_typeinfo..TzNamedTuple item)force_progressfieldsrcstSrX)r1rZ) tuple_baserZr[sz>NamedTupleAnalyzer.build_namedtuple_typeinfo..Fvarr,is_initialized_in_classr^ is_propertyrVrWcs<|_||_||_jd|j|_tt|j|j<dS)N.) rmrrrgri _fullnamer'rnames)rrr)rmrZr[ add_field s z?NamedTupleAnalyzer.build_namedtuple_typeinfo..add_fieldcSg|] \}}t||qSrZr,rrtyprZrZr[r))rcSrrZrrrZrZr[r0rcsg|]}qSrZrZrrrZr[r2srF)rrHrGrLrM__doc__) __match_args__r)rirgidvalues upper_boundrfuncnamerjret Type | Nonerlist[Argument]is_classmethodis_newcsljd|}jtjj|dd}|dur|}|s|r,ttdt|dt g}n ttd|dt g}||}dd|D}dd|D} d d|D} d|vsUJt t t t || | |} |g| _t||tg} | _|| _t| | | _|| _| _|rt|| j} d | _| _| j| _d | _t| td g| }|_tt|}ntt| }d |_|j|<dS) Nr) namespace)r_cls_selfcSrrZ)type_annotationrrrZrZr[rZrzTNamedTupleAnalyzer.build_namedtuple_typeinfo..add_method..cSsg|]}|jjqSrZ)variablerirrZrZr[r[cSrrZ)kindrrZrZr[r\rT classmethod)rg copy_modifiedr<rraw_idrr,r;make_normalizedrr6r rr9 variablesrrrmis_classr3rrrkr is_decoratedrr!r'rplugin_generatedr)rrrrrrg self_typefirstrurtr signaturefuncvdecsym) function_typermrkshared_self_typerZr[ add_methodGsD     z@NamedTupleAnalyzer.build_namedtuple_typeinfo..add_methodrJcSg|] }t||jttqSrZrrrrrrrZrZr[rw)rr)r __replace__cSrrZrrrZrZr[r}rrcs.|jd}|dur tnt}t||j||SrX)getrirrrr)rrr)rvrZr[ make_init_argszCNamedTupleAnalyzer.build_namedtuple_typeinfo..make_init_argrBcsg|]}|qSrZrZr)r!rZr[rr)rrrrK)rrrIiterable)rrr)FF)rr,rr^rr^rVrW) rrjrrrrrr^rr^rVrW)rr,rVr)%rT named_typer5r: special_formnamed_type_or_noner8basic_new_typeinfois_named_tuple special_aliasr2targetprocess_placeholder tuple_typeupdate_tuple_typerkcopymetadatar@schedule_patchr/rr,rSpython_versionr>rQrg tvar_scopenew_unique_func_idfrom_omitted_genericsrrr+r'rr)rYrirtrurvrkrx implicit_anybasetuple_typedictypeordereddictypefallback iterable_typeliteralsmatch_args_typerrrvarstuple_of_stringsrself_tvar_exprrZ)rvrrmrkr!rrrr[rns        -   z,NamedTupleAnalyzer.build_namedtuple_typeinfonamed_tuple_infoIterator[None]c cs|j}t|_dVtD](}||jvr5|||j|urq |j|j}|dus+J|d|d|q |D]/\}}||jvrd|dkrHq:|j|}t|jtt frY|j sYq:t ||j}||j|<||j|<q:dS)ajPreserve the generated body of class-based named tuple and then restore it. Temporarily clear the names dict so we don't get errors about duplicate names that were already set in build_namedtuple_typeinfo (we already added the tuple field names while generating the TypeInfo, and actual duplicates are already reported). Nz'Cannot overwrite NamedTuple attribute "rr) rr&rNr rrrtrerrrrA) rYr?nt_names prohibitedctxrrrr_keyrZrZr[save_namedtuple_bodys.         z'NamedTupleAnalyzer.save_namedtuple_bodyfieldrContainer[str]cCsX||vr d|dS|sd|dS|drd|dSt|r*d|dSdS) zDReturn None for valid fields, a string description for invalid ones.zhas duplicate field name "rz field name "z" is not a valid identifierrz" starts with an underscorez" is a keywordN) isidentifierrkeyword iskeyword)rYrFrrZrZr[rs      z.NamedTupleAnalyzer.check_namedtuple_field_nameNrCrErrorCode | NonecCs|jj|||ddS)Nr)rTr)rYrUrCrrZrZr[rszNamedTupleAnalyzer.fail)rSr.rTr0rUrrVrW)r\rr]r^r_r^rVr`)r\rr]r^rVrz)rrrrr_r^rVr) rmr*rirjrrrcr^rVrW)rrrgrjrVr)rrrrrVr)rirjrtrrurrvrrkrrxrrVr*)r?r*rVr@)rFrjrrGrVrrX)rUrjrCrrrKrVrW)__name__ __module__ __qualname__rCryrhrrrrrnrrErrrZrZrZr[rRas   # P m  y +%  ) rR)Rr __future__rrI contextlibrtypingrrrrrr mypy.errorcodesr r mypy.exprtotyper r mypy.messagesr mypy.nodesrrrrrrrrrrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r- mypy.optionsr.mypy.semanal_sharedr/r0r1r2r3 mypy.typesr4r5r6r7r8r9r:r;r<r=r>r?r@ mypy.utilrArNrMrOrQrRrZrZrZr[s$     !<