qildZddlZddlZddlmZmZmZddlZddlm Z ddl m Z m Z m Z ddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZmZmZmZe eeZ!eeZ"ejFd e"Dcic]}||c}e$ Z%eee$ejLd d jOe!d ee!fZ(edZ)e)jUdgdddddddejVddf dedededeee%ejLdfdede(dededed dfd!Z,e)jUd"d#d$g d6d%ee$ejZd&fd'ede(ded df d(Z.e)jUd)gd*ddejVddfd%ee$ejZd&fd+eee$ejLd,d-fd.eee$ejLd/fdededed dfd0Z/e)jUd1d2d3gejVdfd1ee$ejZd4fdeded dfd5Z0ycc}w)7aContains commands to interact with datasets on the Hugging Face Hub. Usage: # list datasets on the Hub hf datasets ls # list datasets with a search query hf datasets ls --search "code" # get info about a dataset hf datasets info HuggingFaceFW/fineweb N) AnnotatedOptionalget_args)execute_raw_sql_query)CLIErrorRepositoryNotFoundErrorRevisionNotFoundError) DatasetSort_TExpandDatasetProperty_T) AuthorOpt FilterOpt FormatOptLimitOpt OutputFormatQuietOpt RevisionOpt SearchOptTokenOptapi_object_to_dict get_hf_apimake_expand_properties_parserprint_list_output typer_factoryDatasetSortEnum)typezWComma-separated properties to expand. Example: '--expand=downloads,likes,tags'. Valid: z, .)helpcallbackz"Interact with datasets on the Hub.)rls)zhf datasets lsz*hf datasets ls --sort downloads --limit 10zhf datasets ls --search "code")examples Fsearchauthorfiltersortz Sort results.limitexpandformatquiettokenreturnc t|} |r |jnd} | j|||| ||D cgc] } t| } } t | ||ycc} w)zList datasets on the Hub.r+N)r%r$r#r&r'r(r)r*)rvalue list_datasetsrr) r#r$r%r&r'r(r)r*r+apisort_key dataset_inforesultss N/opt/pipecat/venv/lib/python3.12/site-packages/huggingface_hub/cli/datasets.py datasets_lsr7Hst. 5 !C!tzztH -- .    <( G gfE: sAinfoz&hf datasets info HuggingFaceFW/finewebz9hf datasets info my-dataset --expand downloads,likes,tags dataset_idz+The dataset ID (e.g. `username/repo-name`).revisionct|} |j|||}t t jt|d y#t$r}td|d|d}~wt$r}td|d|d|d}~wwxYw) z$Get info about a dataset on the Hub.r.)repo_idr:r(z Dataset 'z ' not found.Nz Revision 'z' not found on 'z'.)indent) rr4rrr printjsondumpsr)r9r:r(r+r2r8es r6 datasets_inforCos 5 !CU XfU  $**'-a 89 #D:,l;rls  00 A[[I$H%<=>' $))-m/L1/LSVW  SMELLfgkgpgprDhEgFFGH./AB  "FG  $**; ; ; ; ! /* ,  ; ; ; ; ; ; ;;> 0C! :#~u~~3`aab:: :  :  ::" sw]a$** I#~u~~3`aabI hsm\U\\*Cm%nn oI Xc]LELL6X$YY ZI  I  I  I II$  c j%** : 3,GHH I :  :  : : :a0Ms8 H1