i ddlmZmZmZmZmZmZddlmZm Z m Z m Z m Z m Z ddlmZddlmZddlmZddlmZmZedZd ed ed e fd Zd eedeed eeee ffdZd ed efdZd ed eeeffdZdS))DictAnyUnionListTypeVarType) SearchRequest SearchDataDocumentSearchResultWebSearchResultNewsSearchResultImages)AsyncHttpClient)handle_response_error)normalize_document_input)validate_scrape_optionsprepare_scrape_optionsTclientrequestreturncKt|} |d|d{V}|jdkrt|d|}|dst|d|dipi}t }d|vr t|dt|_ d|vr t|dt|_ d |vr t|d t|_ |S#t$r5}t|d rtt!|d d|d}~wwxYw) a  Async search for documents. Args: client: Async HTTP client instance request: Search request Returns: SearchData with search results grouped by source type Raises: FirecrawlError: If the search operation fails z /v2/searchNsearchsuccessdatawebnewsimagesresponse)_prepare_search_requestpost status_coderjsongetr _transform_arrayr rrrrr Exceptionhasattrgetattr)rr request_datar! response_datarouterrs i/home/agentuser/.hermes/hermes-agent/venv/lib/python3.11/site-packages/firecrawl/v2/methods/aio/search.pyrrsg"+733L\<@@@@@@@@  3 & & !(H 5 5 5    ++ 6 !(H 5 5 5  ,,2ll D==&tE{ODDCG T>>'V 6FGGCH t  )$x.:LMMCJ  3 # # F !'#z":":H E E E sDD E!0EEarr result_typec Rg}|D]}|r~t|trid|vsd|vsd|vsd|vsd|vs d|vsd|vsd|vr-|td it |f||d i|||| |S) a Transforms an array of items into a list of result_type or Document. If the item dict contains any of the special keys, it is treated as a Document. Otherwise, it is treated as result_type. If the item is not a dict, it is wrapped as result_type with url=item. markdownhtmlrawHtmllinks screenshotchangeTrackingsummaryr%)url) isinstancedictappendr r)r0r1resultsitems r/r'r'8s)+G22  2JtT** 2d""$T!!4$$ D((T!!$xII*B4*H*HIIJJJJ{{22T223333 NN;;4000 1 1 1 1 Nc|jr|jstd|j4|jdkrtd|jdkrtd|j4|jdkrtd|jdkrtd |jphd }|jD]d}t |tr||vrtd |d |1t|d r#|j |vrtd |j d |e|j St |j tr*t|j dkrtd|j St |j tr*t|j dkrtd|j t|j |S)z Validate and normalize search request. Args: request: Search request to validate Returns: Validated request Raises: ValueError: If request is invalid zQuery cannot be emptyNrzLimit must be positivedzLimit cannot exceed 100zTimeout must be positiveiz*Timeout cannot exceed 300000ms (5 minutes)>rrr zInvalid source type: z. Valid types: typez#Location must be a non-empty stringztbs must be a non-empty string)querystrip ValueErrorlimittimeoutsourcesr<strr)rDlocationlentbsscrape_optionsr)r valid_sourcessources r/_validate_search_requestrRSs =2 3 3 5 520111} =A  566 6 =3  677 7" ?a  788 8 ?V # #IJJ J"111 o j jF&#&& j..$%cV%c%cTa%c%cddd/(( j;m33$%hV[%h%hYf%h%hiii#'*C00 DC8H8N8N8P8P4Q4QUV4V4VBCC C{'+s++ ?s7;3D3D3F3F/G/G1/L/L=>> >) 6777 NrAct|}|dd}d|vr|j |j|d<d|vr|j |j|d<|j |j|d<|dd|j1t|j}|r||d<|d dt|d dx}Jt| r)t|j  |d <|S) z Prepare a search request payload. Args: request: Search request Returns: Request payload dictionary T) exclude_noneby_aliasrHNrIignoreInvalidURLsignore_invalid_urls scrapeOptionsrO integration) rR model_dumprHrIrWpoprOrr*rKrFrY)rvalidated_requestr scrape_datavs r/r"r"s*199  ' 'TD ' I IDd06B)/W !2!:!F+3Y,8$5$I ! &---'3,->-MNN  0$/D ! !4((( & t < <<IcRSffllnnI!"3"?@@FFHH] KrAN)typingrrrrrrtypesr r r r rrutils.http_client_asyncrutils.error_handlerrutils.normalizerutils.validationrrrrr'rRrKr"r;rAr/res8888888888888888766666888888777777OOOOOOOO GCLL% % %%%%%N$s)$q'd5HCU>V61m1 1111f]tCH~rA