o Zh@sdddlmZddlmZddlmZmZmZmZddl Z ddl m Z ddl m Z Gddde ZdS) )BytesIO)Path)AnyListTupleUnionN)Document) BaseLoaderc @seZdZdZ  ddeeeeeeeeeffdedefddZ dee fd d Z d e d e d eeeefde eeffddZdS)ImageCaptionLoaderzLoad image captions. By default, the loader utilizes the pre-trained Salesforce BLIP image captioning model. https://huggingface.co/Salesforce/blip-image-captioning-base %Salesforce/blip-image-captioning-baseimagesblip_processor blip_modelcCs0t|tttfr |g|_n||_||_||_dS)aaInitialize with a list of image data (bytes) or file paths Args: images: Either a single image or a list of images. Accepts image data (bytes) or file paths to images. blip_processor: The name of the pre-trained BLIP processor. blip_model: The name of the pre-trained BLIP model. N) isinstancestrrbytesr r r)selfr r rrj/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/document_loaders/image_captions.py__init__s   zImageCaptionLoader.__init__returnc Csz ddlm}m}Wn tytdw||j}||j}g}|jD]}|j|||d\}}t ||d} | | q'|S)z,Load from a list of image data or file pathsr)BlipForConditionalGeneration BlipProcessorzQ`transformers` package not found, please install with `pip install transformers`.)model processorimage)Z page_contentmetadata) Z transformersrr ImportErrorZfrom_pretrainedr rr _get_captions_and_metadatarappend) rrrrrresultsrcaptionrdocrrrload)s"      zImageCaptionLoader.loadrrrc Cs.zddlm}Wn tytdw|}z8t|tr'|t|d}n&t|trE| ds6| drE|t j |ddj d}n||d}Wnt yit|tr`d }t|d |}t|w||d d d }|jdi|}||d} t|trddi} | | fSdt|i} | | fS)zBHelper function for getting the captions and metadata of an image.r)ImagezA`PIL` package not found, please install with `pip install pillow`RGBzhttp://zhttps://T)streamz#Could not get image data from byteszCould not get image data for z an image ofpt)Zreturn_tensors image_sourcezImage bytes providedZ image_pathNr)ZPILr$rrropenrconvertr startswithrequestsgetraw Exception ValueErrorgeneratedecode) rrrrr$r(msgZinputsoutputr!rrrrr@sD        z-ImageCaptionLoader._get_captions_and_metadataN)r r )__name__ __module__ __qualname____doc__rrrrrrrr#rrdictrrrrrr s*    r )iorpathlibrtypingrrrrr,Zlangchain_core.documentsrZ)langchain_community.document_loaders.baser r rrrrs