o Zh@sdZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z ddl m Z Gd d d eZGd d d ejZGd ddee jZGdddee jZd%ddZd&ddZd'ddZd(dd Zd)d#d$ZdS)*z2Utilities for working with post-processing tokens.) annotationsN)AnyCallableSequence)py_utils) llm_function)llmfn_output_row)llmfn_post_processc@seZdZdZdS)PostProcessParseErrorz,An error parsing the post-processing tokens.N)__name__ __module__ __qualname____doc__rrf/var/www/html/lang_env/lib/python3.10/site-packages/google/generativeai/notebook/post_process_utils.pyr sr c@s0eZdZdZejd ddZejd dd Zd S) ParsedPostProcessExprz:A post-processing expression parsed from the command line.returnstrcCdS)z$Returns the name of this expression.Nrselfrrrname"zParsedPostProcessExpr.namellm_fnllm_function.LLMFunctioncCr)zEAdds this parsed expression to `llm_fn` as a post-processing command.Nrrrrrradd_to_llm_function&rz)ParsedPostProcessExpr.add_to_llm_functionNrrrrrr)r r r rabcabstractmethodrrrrrrrs  rc@8eZdZdZdddZdd d ZdddZdddZdS)_ParsedPostProcessAddExprzEAn expression that returns the value of a new column to add to a row.rrfnCallable[[str], Any]cC||_||_dS)aConstructor. Args: name: The name of the expression. The name of the new column will be derived from this. fn: A function that takes the result of a row and returns a new value to add as a new column in the row. N_name_fnrrr#rrr__init__0s z"_ParsedPostProcessAddExpr.__init__rcC|jSNr'rrrrr<z_ParsedPostProcessAddExpr.namerows-Sequence[llmfn_output_row.LLMFnOutputRowView] Sequence[Any]cfdd|DS)Ncg|] }|qSrr(Z result_value.0rowrrr @z6_ParsedPostProcessAddExpr.__call__..rrr/rrr__call__?z"_ParsedPostProcessAddExpr.__call__rrcC|j|j|dSNrr#)Zadd_post_process_add_fnr'rrrrrBz-_ParsedPostProcessAddExpr.add_to_llm_functionN)rrr#r$r)r/r0rr1rr r r rr*rr;rrrrrr"+s   r"c@r!)_ParsedPostProcessReplaceExprz:An expression that returns the new result value for a row.rrr#Callable[[str], str]cCr%)zConstructor. Args: name: The name of the expression. fn: A function that takes the result of a row and returns the new result. Nr&r)rrrr*Ks z&_ParsedPostProcessReplaceExpr.__init__rcCr+r,r-rrrrrUr.z"_ParsedPostProcessReplaceExpr.namer/r0 Sequence[str]cr2)Ncr3rr4r5rrrr8Yr9z:_ParsedPostProcessReplaceExpr.__call__..rr:rrrr;Xr<z&_ParsedPostProcessReplaceExpr.__call__rrcCr=r>)Zadd_post_process_replace_fnr'rrrrr[r@z1_ParsedPostProcessReplaceExpr.add_to_llm_functionN)rrr#rCr)r/r0rrDrrArrrrrBFs   rBr#r$cCt|j|dSr>)r"r r#rrrpost_process_add_fn`rGrCcCrEr>)rBr rFrrrpost_process_replace_fndrHrItokensrDrNonecCs$|stdt|dkrtddS)Nz,Cannot have empty post-processing expressionz3Post-processing expression should be a single token)r len)rJrrr'validate_one_post_processing_expressionhs  rNtuple[str, Any]c Csvt||dd}t}t|D] \}}t|}||vr/tdd|d|d||}qd||fS)z)Returns name and the resolved expression.r.zUnable to resolve "{}"NrL ) rNsplitrZget_main_module enumeratevarsr formatjoin)rJZ token_partsZcurrent_moduleZpart_numpartZcurrent_module_varsrrr'_resolve_one_post_processing_expressionqs rXSequence[Sequence[str]]Sequence[ParsedPostProcessExpr]cCs^g}|D](}t|\}}t|tr||qt|tr&|t||dqtd||S)a Resolves post-processing tokens into ParsedPostProcessExprs. E.g. Given [["add_length"], ["to_upper"]] as input, this function will return a sequence of ParsedPostProcessExprs that will execute add_length() and to_upper() on each entry of the LLM output as post-processing operations. Raises: PostProcessParseError: An error parsing or resolving the tokens. Args: tokens: A sequence of post-processing tokens after splitting. Returns: A sequence of ParsedPostProcessExprs. r?z{} is not callable)rX isinstancerappendrr"r rU)rJresultsZ expressionZ expr_nameZ expr_valuerrrresolve_post_processing_tokenss    r^)r#r$)r#rC)rJrDrrK)rJrDrrO)rJrYrrZ)r __future__rrtypingrrrZgoogle.generativeai.notebookrZ google.generativeai.notebook.librrr RuntimeErrorr ABCrZLLMFnPostProcessBatchAddFnr"ZLLMFnPostProcessBatchReplaceFnrBrGrIrNrXr^rrrrs*