h20ddlmZddlZddlmZmZddlmZddlm Z m Z m Z m Z m Z mZddlmZddlmZddlmZdd lmZdd lmZmZmZdd lmZd ZGd deZGddeZGddeZ GddeZ!GddeeZ"Gddee"Z#y)) annotationsN)ABCabstractmethod)Enum)AnyDictIteratorListMappingOptional)CallbackManagerForLLMRun)LLM)GenerationChunk)pre_init) BaseModel ConfigDictField)enforce_stop_tokenszocid1.generativeaiendpointc:eZdZeeddZeddZy)ProvidercyNselfs h/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain_community/llms/oci_generative_ai.pystop_sequence_keyzProvider.stop_sequence_keys(+cyrrrresponses rcompletion_response_to_textz$Provider.completion_response_to_textsADrNreturnstrr!rr$r%)__name__ __module__ __qualname__propertyrrr"rrrrrs& ++DDrrc,eZdZUdZded<ddZddZy) CohereProviderstop_sequencesr%rc2ddlm}|j|_yNrmodels)oci.generative_ai_inferencer1CohereLlmInferenceRequestllm_inference_requestrr1s r__init__zCohereProvider.__init__s6%+%E%E"rc\|jjjdjSNr)datainference_responsegenerated_textstextr s rr"z*CohereProvider.completion_response_to_text$s#}}//??BGGGrNr$Noner&r'r(r)r__annotations__r6r"rrrr,r,s-s-F Hrr,c,eZdZUdZded<ddZddZy) MetaProviderstopr%rc2ddlm}|j|_yr/)r2r1LlamaLlmInferenceRequestr4r5s rr6zMetaProvider.__init__+s6%+%D%D"rc\|jjjdjSr8)r9r:choicesr<r s rr"z(MetaProvider.completion_response_to_text0s#}}//77:???rNr=r&r?rrrrBrB(s#s#E @rrBc eZdZdZdZdZdZdZy) OCIAuthTypez'OCI authentication types as enumerator.N)r'r(r)__doc__API_KEYSECURITY_TOKENINSTANCE_PRINCIPALRESOURCE_PRINCIPALrrrrIrI4s1GNrrIceZdZUdZeddZded<dZded < d Zded < d Z ded < dZ ded< dZ ded< dZ ded< dZ ded< dZded< dZded< edddZeddZeddZddZy) OCIGenAIBasezBase class for OCI GenAI modelsNT)defaultexcluderclientrOz Optional[str] auth_typeDEFAULT auth_profilez ~/.oci/configauth_file_locationmodel_idproviderzOptional[Dict] model_kwargsservice_endpointcompartment_idFbool is_streamforbidr)extraarbitrary_types_allowedprotected_namespacesc|d|S ddlid|djjdd}|dtdjk(r9j j |d |d  |d <|jd dn|dtdjk(r@ dfd }j j |d |d  |d <||d |d <n|dtdjk(r(jjj|d <nU|dtdjk(r(jjj|d <ntd|ddjjdi||d<|S#t$r}t!d|d}~wt"$r}td||d}~wwxYw)zBValidate that OCI config and python package exists in environment.rWNrr_) )configsignerr_retry_strategytimeoutrXrJr[rZ) file_location profile_namerjrkrKc:jj|jdd}tt |jdd5}|j }dddj jj|S#1swY/xYw)Nkey_filesecurity_token_filezutf-8)encoding) rkload_private_key_from_filegetopenr%readauthsignersSecurityTokenSigner) oci_configpkf st_stringocis rmake_security_token_signerzEOCIGenAIBase.validate_environment..make_security_token_signers>>"z2DBJNN+@ABW-$%FFH -88++?? 2NN --s BB)r{rLrMz)Please provide valid value to auth_type, z is not valid.zYCould not import oci python package. Please make sure you have the oci package installed.zCould not authenticate with OCI client. If INSTANCE_PRINCIPAL or RESOURCE_PRINCIPAL is used, please check the specified auth_profile, auth_file_location and auth_type are valid.)r{zdict[str, Any]r$z&'oci.auth.signers.SecurityTokenSigner'r)rretryDEFAULT_RETRY_STRATEGYrInamerj from_filepoprxry%InstancePrincipalsSecurityTokenSignerget_resource_principals_signer ValueErrorgenerative_ai_inferenceGenerativeAiInferenceClient ImportErrorModuleNotFoundError Exception)clsvalues client_kwargsrexers @rvalidate_environmentz!OCIGenAIBase.validate_environmentps1 (  'MD  $*+=$>"%))"B"B$ Mk"k!n&9&99*-***>*>"()=">!'!7+?+ h'!!(D1 $ A(;(;; O . O; O+.***>*>"()=">!'!7+?+ h'+E,X6+ h' $ A(;(;;HH$$JJLh' $ A(;(;;HH$$CCEh'!?k*+>; Ws::VV  F8 $  %G  M     s$F F G F** G6 GGc.|jxsi}id|iS)zGet the identifying parameters.r^)r^)r _model_kwargss r_identifying_paramsz OCIGenAIBase._identifying_paramss+))/R  }-  rc|j |j}nC|j td|jjddj }||vrtd|jd||S)Nzmodel_id is required to derive the provider, please provide the provider explicitly or specify the model_id to derive the provider..rz(Invalid provider derived from model_id: zL Please explicitly pass in the supported provider when using custom endpoint)r]r\rsplitlower)r provider_mapr]s r _get_providerzOCIGenAIBase._get_providers == $}}H}}$ ; }}**3/288:H < ':4==/J--  H%%r)rrr$rr$Mapping[str, Any])rrr$r)r'r(r)rNrrWr@rXrZr[r\r]r^r_r`rbr model_configrrr*rrrrrrTrT=s)d3FC3(I}(#,L-+)8 7#Hm"7"Hm" $(L.'0&*m*$(NM(It12LMM^  &rrTceZdZdZeddZed dZeddZeddZ ddZ dd Z d dd Z d dd Z y )OCIGenAIaOCI large language models. To authenticate, the OCI client uses the methods described in https://docs.oracle.com/en-us/iaas/Content/API/Concepts/sdk_authentication_methods.htm The authentifcation method is passed through auth_type and should be one of: API_KEY (default), SECURITY_TOKEN, INSTANCE_PRINCIPAL, RESOURCE_PRINCIPAL Make sure you have the required policies (profile/roles) to access the OCI Generative AI service. If a specific config profile is used, you must pass the name of the profile (from ~/.oci/config) through auth_profile. If a specific config file location is used, you must pass the file location where profile name configs present through auth_file_location To use, you must provide the compartment id along with the endpoint url, and model id as named parameters to the constructor. Example: .. code-block:: python from langchain_community.llms import OCIGenAI llm = OCIGenAI( model_id="MY_MODEL_ID", service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com", compartment_id="MY_OCID" ) rcT)rdrecy)zReturn type of llm.oci_generative_ai_completionrrs r _llm_typezOCIGenAI._llm_types.rc,ttdS)zGet the provider map)coheremeta)r,rBrs r _provider_mapzOCIGenAI._provider_maps%& N  rc:|j|jS)z Get the internal provider object)r)rrrs r _providerzOCIGenAI._providers!!t/A/A!BBrc ddlm}|jxsi}||||jj<|j t d|j jtr|j|j }n|j|j }i||}||d<|j|d<|j|j||jjd i|}|S) Nrr0zDmodel_id is required to call the model, please provide the model_id.) endpoint_id)r\promptrb)r` serving_modeinference_requestr)r2r1r^rrr\r startswithCUSTOM_ENDPOINT_PREFIXDedicatedServingModeOnDemandServingModerbGenerateTextDetailsr`r4) rrrCkwargsr1rrinference_paramsinvocation_objs r_prepare_invocation_objectz#OCIGenAI._prepare_invocation_objects 7))/R  >BM$..:: ; == V  == # #$: ;!664==6QL!55t}}5ML6m6v6%+"(,%33..%BdnnBBVEUV4  rcX|jj|}| t||}|Sr)rr"r)rr!rCr<s r_process_responsezOCIGenAI._process_response4s-~~99(C  &tT2D rNc |jr;d}|j|||fi|D]}||jz }| t||}|S|j |||}|j j |}|j||S)akCall out to OCIGenAI generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = llm.invoke("Tell me a joke.") )rb_streamr<rrrW generate_textr) rrrC run_managerrr<chunkrr!s r_callzOCIGenAI._call<s* >>D%fdKJ6J # " #*46K88vN;;,,^<%%h55rc+hKd|_|j|||}|jj|}|jj D]\}t j|j}d|vr|d} nd} t| } |r|j| j| | ^yw)acStream OCIGenAI LLM on given prompt. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: An iterator of GenerationChunks. Example: .. code-block:: python response = llm.stream("Tell me a joke.") Tr<r)r<)rN) rbrrWrr9eventsjsonloadsron_llm_new_tokenr<) rrrCrrrr!event json_loadevent_data_textrs rrzOCIGenAI._stream]s,88vN;;,,^<]]))+ E 5::.I""+F"3"$#9E,,UZZu,EK sB0B2r#r)r$r)rr%rCOptional[List[str]]rDict[str, Any]r$r)r!rrCrr$r%)NN) rr%rCrr"Optional[CallbackManagerForLLMRun]rrr$r%) rr%rCrrrrrr$zIterator[GenerationChunk])r'r(r)rNrrr*rrrrrrrrrrrrs@ $L ..  CC!4>L >%):> 66"68 6  6 6H%):> ##"#8 #  # # #rr)$ __future__rrabcrrenumrtypingrrr r r r langchain_core.callbacksr #langchain_core.language_models.llmsrlangchain_core.outputsrlangchain_core.utilsrpydanticrrrlangchain_community.llms.utilsrrrr,rBrIrTrrrrrs" #??=32)11>5EsE HX H @8 @$]&9c]&@csLcr