BNj])ddlmZddlZddlZddlZddlZddlZddlmZddl m Z ddZ ddZ dddddddd dd Z ed Zeejfd Zd Zgd Zy)) annotationsN)contextmanager)isclassct|s |j}|j}||tjjk(r |jS|dz|jzS)aI Gives a full name (package_name.class_name) for a class / object in Python. Will be used to load the correct classes from JSON files Args: obj: The object for which to get the full name, e.g. an instance of a class or the class itself. Returns: str: The full name of the object. Example: >>> from sentence_transformers.sentence_transformer.losses import MultipleNegativesRankingLoss >>> from sentence_transformers import SentenceTransformer >>> from sentence_transformers.util import fullname >>> model = SentenceTransformer('sentence-transformers/all-MiniLM-L6-v2') >>> loss = MultipleNegativesRankingLoss(model) >>> fullname(loss) 'sentence_transformers.sentence_transformer.losses.multiple_negatives_ranking.MultipleNegativesRankingLoss' .)r __class__ __module__str__name__)objmodules p/Users/ahmed/devFolder/Ultron/claude-voice/.venv/lib/python3.12/site-packages/sentence_transformers/util/misc.pyfullnamer sP( 3<mm ^^F ~3==#;#;;|| C<#,, &&c |jdd\}}tj5tj dt  tj|}ddd t|S#t$r|d}t|wxYw#t$rtj|}YRwxYw#1swYWxYw#t$rd|d|d}t|wxYw) a} Import a dotted module path and return the attribute/class designated by the last name in the path. Raise ImportError if the import failed. Args: dotted_path (str): The dotted module path. Returns: Any: The attribute/class designated by the last name in the path. Raises: ImportError: If the import failed. Example: >>> import_from_string('sentence_transformers.sentence_transformer.losses.multiple_negatives_ranking.MultipleNegativesRankingLoss') rz doesn't look like a module pathignoreNzModule "z" does not define a "z" attribute/class) rsplit ValueError ImportErrorwarningscatch_warnings simplefilterDeprecationWarning importlib import_module ExceptiongetattrAttributeError) dotted_path module_path class_namemsgr s rimport_from_stringr$(s$"-"4"4S!"< Z  "h(:; :,,[9F #vz**  =># :,,[9F : # "  %::,FWX#s@A1B2B% B>1B B/,B2.B//B22B;>CF)trust_remote_coderevision code_revisiontoken cache_folderlocal_files_onlyc N|jdr t|S|^|stjj |r=ddlm} ||||||||} |s#tjd|d|dtd | St|S#ttf$r Yt|SwxYw) a[ Resolve a module class reference to a class object. For class refs in the ``sentence_transformers.*`` namespace, this imports directly via :func:`import_from_string`. For other class refs (e.g. repository-local custom classes like ``modeling_my_model.CustomTransformer``), it first tries :func:`transformers.dynamic_module_utils.get_class_from_dynamic_module` to fetch the modeling file from the model directory, then falls back to :func:`import_from_string` if dynamic loading is not applicable or fails. Dynamic loading is attempted when ``trust_remote_code`` is set, or when ``model_name_or_path`` resolves to a local directory (i.e. the user already has the file on disk and is implicitly trusted). .. deprecated:: 5.6 The implicit trust of local directories is deprecated and will be removed in v6.0. From v6.0, loading repository-local custom code will require ``trust_remote_code=True``, matching the behavior for models loaded from the Hugging Face Hub. A ``FutureWarning`` is emitted whenever a local model is loaded via this short-circuit without ``trust_remote_code=True``. Args: class_ref: Dotted class path. Either a fully-qualified ``sentence_transformers.*`` path or a repository-local reference like ``modeling_.``. model_name_or_path: Hub repo id or local directory used to source repository-local modeling files. Required for dynamic loading. trust_remote_code: Whether to permit dynamic loading from an unverified Hub repo. revision: Hub revision to fetch the modeling file from. code_revision: Optional separate revision pinning for the modeling code (overrides ``revision`` when set). token: Hugging Face Hub authentication token. Required for fetching modeling files from private repositories. cache_folder: Optional override for the Hugging Face Hub cache directory. local_files_only: If True, only use cached files and never reach out to the Hub. Returns: The resolved class. zsentence_transformers.r)get_class_from_dynamic_module)r&r'r( cache_dirr*zLoading custom module z from local path zz without `trust_remote_code=True` is deprecated. It will require `trust_remote_code=True` from Sentence Transformers v6.0.) stacklevel) startswithr$ospathexists!transformers.dynamic_module_utilsr,rwarn FutureWarningOSErrorr) class_refmodel_name_or_pathr%r&r'r(r)r*r, module_classs rimport_module_classr;Osb45!),,%+<Oa@bS 8"!+&!1L% ,YM9JK]J`a23"   i ((!$   i ((! sBB$#B$c#|Kddlm}m}m}|} |r|d|r|yy#|r|wwxYww)zN A context manager that will disable caching in the datasets library. r)disable_cachingenable_cachingis_caching_enabledN)datasetsr=r>r?)r=r>r?is_originally_enableds rdisable_datasets_cachingrBsF ML.0     !   !s< - < 9<c#Ktjjj}tj| dtj|y#tj|wxYww)z A context manager that will prevent any logging messages triggered during the body from being processed. Args: highest_level: the maximum logging level allowed. N)loggingrootmanagerdisable) highest_levelprevious_levels rdisable_loggingrJsI\\))11N OOM"( ''s:A1AA1A..A1cdt|dd5}tj|}t|}dddt dkDrS|dj |t|ddd5}tj |}|j|dddyy#1swYkxYw#1swYyxYw) Nzutf-8)newlineencodingrwTF)opencsvreaderlistlenextendwriter writerows)csv_pathadditional_datafrSrowsrWs rappend_to_last_rowr]s hW 5AF| 6 4y1} R((Cg >!ZZ]F   T "?  6 5?s!B)'B&B#&B/)Dzalbert-base-v1zalbert-base-v2zalbert-large-v1zalbert-large-v2zalbert-xlarge-v1zalbert-xlarge-v2zalbert-xxlarge-v1zalbert-xxlarge-v2zbert-base-cased-finetuned-mrpczbert-base-casedzbert-base-chinesezbert-base-german-casedzbert-base-german-dbmdz-casedzbert-base-german-dbmdz-uncasedzbert-base-multilingual-casedzbert-base-multilingual-uncasedzbert-base-uncasedz3bert-large-cased-whole-word-masking-finetuned-squadz#bert-large-cased-whole-word-maskingzbert-large-casedz5bert-large-uncased-whole-word-masking-finetuned-squadz%bert-large-uncased-whole-word-maskingzbert-large-uncasedzcamembert-basectrlz%distilbert-base-cased-distilled-squadzdistilbert-base-casedzdistilbert-base-german-casedz"distilbert-base-multilingual-casedz'distilbert-base-uncased-distilled-squadz/distilbert-base-uncased-finetuned-sst-2-englishzdistilbert-base-uncased distilgpt2zdistilroberta-basez gpt2-largez gpt2-mediumzgpt2-xlgpt2z openai-gptzroberta-base-openai-detectorz roberta-basezroberta-large-mnlizroberta-large-openai-detectorz roberta-largezt5-11bzt5-3bzt5-basezt5-largezt5-smallztransfo-xl-wt103zxlm-clm-ende-1024zxlm-clm-enfr-1024zxlm-mlm-100-1280zxlm-mlm-17-1280zxlm-mlm-en-2048zxlm-mlm-ende-1024zxlm-mlm-enfr-1024zxlm-mlm-enro-1024zxlm-mlm-tlm-xnli15-1024zxlm-mlm-xnli15-1024zxlm-roberta-basez)xlm-roberta-large-finetuned-conll02-dutchz+xlm-roberta-large-finetuned-conll02-spanishz+xlm-roberta-large-finetuned-conll03-englishz*xlm-roberta-large-finetuned-conll03-germanzxlm-roberta-largezxlnet-base-casedzxlnet-large-cased)returnr )r r ratype)N)r8r r9 str | Noner%boolr&rcr'rcr(zbool | str | Noner)rcr*rdrarb) __future__rrRrrDr1r contextlibrinspectrrr$r;rBCRITICALrJr]ORIGINAL_TRANSFORMER_MODELSrrrks"  %'8$R&*Q)$ $##"Q)Q)"Q) Q)  Q)  Q) Q)Q)Q) Q)h"")"2"2(("(Er