h ddlmZmZmZmZddlmZddlmZddl m Z m Z ddl m Z eddd Gd d e e Zy ) )AnyCallableDictList) deprecated)Document) BaseModelmodel_validator) BaseLoaderz0.3.18zThis class is deprecated and will be removed in a future version. You can swap to using the `ApifyDatasetLoader` implementation in `langchain_apify` package. See z"langchain_apify.ApifyDatasetLoader)sincemessagealternative_importceZdZUdZeed< eed< eege fed< dedeege fffd Z e de ded efd Z d ee fd ZxZS) ApifyDatasetLoaderaLoad datasets from `Apify` web scraping, crawling, and data extraction platform. For details, see https://docs.apify.com/platform/integrations/langchain Example: .. code-block:: python from langchain_community.document_loaders import ApifyDatasetLoader from langchain_core.documents import Document loader = ApifyDatasetLoader( dataset_id="YOUR-DATASET-ID", dataset_mapping_function=lambda dataset_item: Document( page_content=dataset_item["text"], metadata={"source": dataset_item["url"]} ), ) documents = loader.load() apify_client dataset_iddataset_mapping_functionc(t|||y)arInitialize the loader with an Apify dataset ID and a mapping function. Args: dataset_id (str): The ID of the dataset on the Apify platform. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. )rrN)super__init__)selfrr __class__s p/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain_community/document_loaders/apify_dataset.pyrzApifyDatasetLoader.__init__0s !JJ|J$$\26JJ2%+F> "  E  s AAAc|jj|jjdj}t t |j|S)zLoad documents.T)clean)rdatasetr list_itemsitemslistmapr)r dataset_itemss rloadzApifyDatasetLoader.loadXsO    % %doo 6 A A A M S S C55}EFFr)__name__ __module__ __qualname____doc__r__annotations__strrrrrr classmethodr(rr1 __classcell__)rs@rrr s&TO6&vx'788>    9A4&(BR9S  (#$3$.Gd8nGrrN)typingrrrrlangchain_core._apirlangchain_core.documentsrpydanticr r )langchain_community.document_loaders.baser rrrr@sL,,*-/@  9 < IGYIG IGr