o /if@sddlmZddlZddlmZmZddlmZddlm Z m Z e e Z dd d Zd ddZd!ddZe jgde jddge jddge jddge jddge jgde jgdiZefd"ddZdS)#) annotationsN)DatasetSequence)ContextPrecision)EvaluationModeMetricdatasetr column_mapdict[str, str]returncCsdd|D}||S)zL Remap the column names in case dataset uses different column names cSsi|]\}}||qSr ).0kvr r I/var/www/html/corbot_env/lib/python3.10/site-packages/ragas/validation.py sz&remap_column_names..)itemsrename_columns)rr inverse_column_mapr r rremap_column_names s rdscCspd|jvr6d|jvr6d}t|j|tr6|j|jjdkr6tddd|dD}|jd||jdd}|S) N ground_truths ground_truthstringzpassing column names as 'ground_truths' is deprecated and will be removed in the next version, please use 'ground_truth' instead. Note that `ground_truth` should be of type string and not Sequence[string] like `ground_truths`cSsg|]}|dqS)rr )r gtr r r sz3handle_deprecated_ground_truths..a)new_fingerprint) features isinstancerfeaturedtypeloggerwarning add_column _fingerprint)r column_namesrr r rhandle_deprecated_ground_truthss"r'cCsdD]}||jvr|j|jdkrtd|dqdD]'}||jvrCt|j|tr4|j|jjdksCtd|dt|j|qdS)N)questionanswerrrzDataset feature "z" should be of type string)contextsz*" should be of type Sequence[string], got )rr! ValueErrorrrr type)rr&r r rvalidate_column_dtypes*s&    r-)r(r)r*r(r)r*r)r(rr))r(r*rmetrics list[Metric]evalmode_to_columnsdictcCsr|D]4}t||j}t|j}||s6d}t|tr$d|vr$d}td|jdt ||d|qdS)z validates the dataset and returns the evaluation type possible evaluation types 1. (q,a,c) 2. (q,a) 3. (q,c) 4. (g,a) rzLooks like you're trying to use 'context_precision' without ground_truth. Please use consider using `context_utilization' instead.z The metric [z>] that that is used requires the following additional columns z to be present in the dataset. N) setevaluation_moderkeysissubsetrrr+namelist)rr.r0mrequired_columnsavailable_columns extra_msgr r rvalidate_evaluation_modesIs$    r=)rrr r r r)rrr r)rr)rrr.r/r0r1) __future__rloggingdatasetsrr ragas.metrics._context_precisionrragas.metrics.baserr getLogger__name__r"rr'r-qacqaqcgcgaqgaqcgEVALMODE_TO_COLUMNSr=r r r rs&