h*6dZddlmZddlZddlmZddlmZmZm Z m Z m Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZmZm Z m!Z!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1ddl2m3Z3Gddee"Z4dddd d#dZ5d$dZ6d%dZ7de8ee8e!ddd d&dZ9e dddde8ee8e!ddf d'd Z:de8ee8e!dddd! d(d"Z;y))z@LLM Chain for turning a user text query into a structured query.) annotationsN)Sequence)AnyCallableOptionalUnioncast) deprecated)OutputParserException)BaseLanguageModel)BaseOutputParser)parse_and_check_json_markdown)BasePromptTemplate)FewShotPromptTemplate)Runnable) Comparator ComparisonFilterDirective OperationOperatorStructuredQuery)LLMChain) get_parser) DEFAULT_EXAMPLESDEFAULT_PREFIXDEFAULT_SCHEMA_PROMPTDEFAULT_SUFFIXEXAMPLE_PROMPTEXAMPLES_WITH_LIMITPREFIX_WITH_DATA_SOURCESCHEMA_WITH_LIMIT_PROMPTSUFFIX_WITHOUT_DATA_SOURCEUSER_SPECIFIED_EXAMPLE_PROMPT) AttributeInfocTeZdZUdZded< ddZe d d dZy) StructuredQueryOutputParserz-Output parser that parses a structured query.r ast_parsec  ddg}gd}t||}|dt|ddk(rd|d<|ddk(s|dsd|d<n|j|d|d<|jds|j ddt d i|j Dcic] \}}||vs ||c}}Scc}}w#t$r}d|d |}t||d}~wwxYw) Nqueryfilter)r)r*limitr NO_FILTERr+z Parsing text z raised following error: ) rlenr'getpopritems Exceptionr ) selftext expected_keys allowed_keysparsedkvemsgs e/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain/chains/query_constructor/base.pyparsez!StructuredQueryOutputParser.parse1s 4$h/M7L24GFg&#fWo*>!*C"%wh;.fX6F#'x #'>>&2B#Cx ::g& 7D)"$*LLNHDAqa<6G1a4H H 4"4&(DQCHC',! 3 4s0BB6 B0%B0*B60B66 C?CCNc`|r dfd }ntj}||S)z Create a structured query output parser from components. Args: allowed_comparators: allowed comparators allowed_operators: allowed operators Returns: a structured query output parser c~ttttj |}t |S)Nallowed_comparatorsallowed_operatorsallowed_attributes)r rrrr>fix_filter_directive) raw_filterfilter_directiverDrBrCs r=r'z>StructuredQueryOutputParser.from_components..ast_parseZsA#'_-L&&z2$ ,$(;&7'9 rA)r')rFstrreturnOptional[FilterDirective])rr>)clsrBrCrD fix_invalidr's ``` r=from_componentsz+StructuredQueryOutputParser.from_componentsEs>&   #$7"3#5e  Y''rH)r5rIrJr)NNNF) rBOptional[Sequence[Comparator]]rCOptional[Sequence[Operator]]rDOptional[Sequence[str]]rMboolrJr&)__name__ __module__ __qualname____doc____annotations__r> classmethodrNr.rHr=r&r&+sf7S4(?C:>6:! &(;&(8&(4 &(  &( % &(&(rHr&rAc |s|s|r|s|St|tr$|r|j|vry|r|j|vry|St|tr|r|j |vry|j Dcgc]!}|ttt||||#}}|syt|dk(r1|j tjtjfvr|dSt |j |S|Scc}w)ahFix invalid filter directive. Args: filter: Filter directive to fix. allowed_comparators: allowed comparators. Defaults to all comparators. allowed_operators: allowed operators. Defaults to all operators. allowed_attributes: allowed attributes. Defaults to all attributes. Returns: Fixed filter directive. NrAr)operator arguments) isinstancer comparator attributerr[r\r rrEr/rANDOR)r*rBrCrDargargss r=rErEos&!$59K  &*% 6#4#4foo(,, 1LL7N__   M+  s.&C1ci}|D]!}t|}|||jd<#tj|dj ddj ddS)Nnameindent{{{}}})dictr1jsondumpsreplace)info info_dictsii_dicts r=_format_attribute_inforus_J 0a)/ 6::f%&0 ::j + 3 3C > F FsD QQrHcg}t|D]Y\}\}}tj|djddjdd}|dz||d}|j |[|S) zConstruct examples from input-output pairs. Args: input_output_pairs: Sequence of input-output pairs. Returns: List of examples. rfrgrirjrkrlrZ)rs user_querystructured_request) enumeraternrorpappend)input_output_pairsexamplesrs_inputoutputrxexamples r=construct_examplesrsH();< ! FF JJva ( 0 0d ; C CC N Q "4    ! OrHFr|rBrC enable_limit schema_promptc >|rtnt}|xs|}t|} |jdj |dj |} |r_t |dt rLt|}t} tj| || } tjt|dz} nR|xs|rtnt}t} tj| } t!jt|dz|| } t#d t%|| d g| | d |S) a#Create query construction prompt. Args: document_contents: The contents of the document to be queried. attribute_info: A list of AttributeInfo objects describing the attributes of the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. allowed_operators: Sequence of allowed operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A prompt template that can be used to construct queries. z | )rBrCr)schemacontent attributesrZ)rs)r)rsrrr))r|example_promptinput_variablessuffixprefixr.)r!rruformatjoinr]tuplerr#r r"r/rrrrrrlist)document_contentsattribute_infor|rBrCrrkwargsdefault_schema_prompt attribute_strrrrrs r=get_query_constructor_promptrs/:%1 6K":%:M*>:M  ! !!JJ':;**%67"FJx{E2%h/6(//%$  ,22S]Q5FG #/ 5E (&&f5&&(ma%$  ! h%      rHz0.2.13load_query_constructor_runnablez1.0)since alternativeremovalc t|||||||} |D cgc]#} t| tr | jn| d%} } tj ||| } | | _td|| | d|Scc} w)aSLoad a query constructor chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: The contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. **kwargs: Arbitrary named params to pass to LLMChain. Returns: A LLMChain that can be used to construct queries. rrerA)llmprompt output_parserr.)rr]r$rer&rNrr) rrrr|rBrCrrrrainforDrs r=load_query_constructor_chainr sD*/+!#F$ ! 6 E&MI0??/+-@M )F  RF- R6 RRs(A/)r|rBrCrrrMc t||f|||||d| } |D cgc]#} t| tr | jn| d%} } tj ||| |} | |z| zScc} w)aLoad a query constructor runnable chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: Description of the page contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. fix_invalid: Whether to fix invalid filter directives by ignoring invalid operators, comparators and attributes. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A Runnable that can be used to construct queries. rre)rBrCrDrM)rr]r$rer&rN)rrrr|rBrCrrrMrrrrDrs r=rrBsD* /+!#   F$ ! 6 E&MI0??/+- @M C<- ''s(A#) r*rKrBrOrCrPrDrQrJrK)rq$Sequence[Union[AttributeInfo, dict]]rJrI)r{zSequence[tuple[str, dict]]rJz list[dict])rrIrrr|Optional[Sequence]rBSequence[Comparator]rCSequence[Operator]rrRrOptional[BasePromptTemplate]rrrJr)rr rrIrrr|zOptional[list]rBrrCrrrRrrrrrJr)rr rrIrrr|rrBrrCrrrRrrrMrRrrrJr)rslF" $77*;<:L5A-*@   DA("2?"CA(N;?6:26 5 %5854 5 0 5  5pR6$(05j0A,1(O26@@8@! @ . @ * @@0@@@F 1  $05j0A,1(O261S 1S1S91S 1S . 1S * 1S1S01S1S1S  1Sr$(05j0A,1(O266( 6(6(96( ! 6( . 6(*6(6(06(6(6(6(rH