o /if@sddlZddlZddlmZmZddlmZddlmZm Z ddl m Z ddl m Z ddlmZmZddlmZmZGd d d e ZGd d d e Zd dZddZdS)N)EvaluationDatasetGolden)HallucinationMetric) assert_testevaluate) BaseMetric) LLMTestCase)aggregate_metric_pass_rates TestResult)AnswerRelevancyMetric BiasMetricc@PeZdZddedefddZdefdd Zdefd d Zd d Z e ddZdS) FakeMetric1?T threshold_successcC||_||_dSNrsuccessselfrrrK/var/www/html/corbot_env/lib/python3.10/site-packages/tests/test_dataset.py__init__ zFakeMetric1.__init__ test_casecCs d|_|jS)NThis metric looking good!)reasonscorerrrrrmeasureszFakeMetric1.measurecd|_d|_|jSNrzThis async metric looking good!rrr rrr a_measurezFakeMetric1.a_measurecC|jSrrrrrr is_successfulzFakeMetric1.is_successfulcCdSNFakerr)rrr__name__zFakeMetric1.__name__NrT r/ __module__ __qualname__floatboolrrr!r%r*propertyrrrrr src@r ) FakeMetric2rTrrcCrrrrrrrr$rzFakeMetric2.__init__rcCsd|_d|_|jS)Nrrr$r rrrr!(szFakeMetric2.measurecr"r#r$r rrrr%-r&zFakeMetric2.a_measurecCr'rr(r)rrrr*2r+zFakeMetric2.is_successfulcCr,r-rr)rrrr/5r0zFakeMetric2.__name__Nr1r2rrrrr8#sr8cCst}tjtjt}tj|dd}|j|ddddddt|j d ks+Jd tj|dd }|j |dddddd t|j d ksIJddS)Ndataz dataset.csvquery actual_outputexpected_outputcontext retrieval)input_col_nameactual_output_col_nameexpected_output_col_namecontext_col_nameretrieval_context_col_namezTest Cases not loaded from CSVz dataset.json)input_key_nameexpected_output_key_namecontext_key_nameretrieval_context_key_nameactual_output_key_name zTest Cases not loaded from JSON) rospathdirnamerealpath__file__joinadd_test_cases_from_csv_filelen test_casesadd_test_cases_from_json_file)dataset module_b_dir file_pathrrrtest_create_dataset:s,rXc Cstdddd}tdd}t}|j|d|j|dt}t}|j|d|j|dtd||gddd d gd gd td ||gddddgdgd g}ddd}t|}||ksZJdS)Nz?What is the primary difference between a comet and an asteroid?avComets and asteroids are both celestial bodies found in our solar system but differ in composition and behavior. Comets, made up of ice, dust, and small rocky particles, develop glowing comas and tails when near the Sun. In contrast, asteroids are primarily rocky or metallic and are mostly found in the asteroid belt between Mars and Jupiter. Rabbits are found in the wild.)inputr;r<F)r)rz some inputz some outputzexpected outputr=zretrieval context)rmetricsrYr;r<r=retrieval_contextTz another inputzanother outputzanother expected outputzanother contextzanother retrieval contextrg?)rr8)rrr8r!r r )rfake_metric_1_failfake_metric_2_failfake_metric_1_passfake_metric_2_pass test_resultsexpected_resultresultrrr test_aggregate_metric_pass_ratesUsN       rc)rKpytestdeepeval.datasetrrdeepeval.metricsrdeepevalrrdeepeval.metrics.base_metricrdeepeval.test_caserdeepeval.evaluater r r r rr8rXrcrrrrs