i dZddlmZmZmZmZmZmZddlm Z m Z m Z m Z m Z mZddlmZmZddlmZmZmZmZedZded e d e fd Zd eed eed eeedffdZd e d e fdZd e d eeeffdZdS)z, Search functionality for Firecrawl v2 API. )DictAnyUnionListTypeVarType) SearchRequest SearchDataDocumentSearchResultWebSearchResultNewsSearchResultImages)normalize_document_input_map_search_result_keys) HttpClienthandle_response_errorvalidate_scrape_optionsprepare_scrape_optionsTclientrequestreturnct|} |d|}|jdkrt|d|}|dst|d|dipi}t }d|vr t|dt|_ d|vr t|dt|_ d|vr t|dt|_ |S#t$r5}t|d rtt!|d d|d }~wwxYw) a Search for documents. Args: client: HTTP client instance request: Search request Returns: SearchData with search results grouped by source type Raises: FirecrawlError: If the search operation fails z /v2/searchsearchsuccessdatawebnewsimagesresponseN)_prepare_search_requestpost status_coderjsongetr _transform_arrayr rrr rr! Exceptionhasattrgetattr)rr request_datar" response_datarouterrs e/home/agentuser/.hermes/hermes-agent/venv/lib/python3.11/site-packages/firecrawl/v2/methods/search.pyrr sS"+733L;;|\::  3 & & !(H 5 5 5    ++ 6 !(H 5 5 5  ,,2ll D==&tE{ODDCG T>>'V 6FGGCH t  )$x.:LMMCJ  3 # # F !'#z":":H E E E sC=D E0E  Earr result_typer c g}|D]}|rt|trd|vsd|vsd|vsd|vsd|vs d|vsd|vsd|vr-|tdit |fd }|t krd }n|t krd }n |tkrd }|r,t||}||di|||di|||| |S)a Transforms an array of items into a list of result_type or Document. If the item dict contains any of the special keys, it is treated as a Document. Otherwise, it is treated as result_type. If the item is not a dict, it is wrapped as result_type with url=item. markdownhtmlrawHtmllinks screenshotchangeTrackingsummaryr&Nr!r r)url) isinstancedictappendr rrrr r)r1r2resultsitemresult_type_namenormalized_items r0r(r(5sy+-G22  2JtT** 2d""$T!!4$$ D((T!!$xII*B4*H*HIIJJJJ#' "444'/$$ $444'-$$ O33',$#8&=dDT&U&UONN;;#A#A#A#ABBBBNN;;#6#6#6#67777 NN;;4000 1 1 1 1 Nc|jr|jstd|j4|jdkrtd|jdkrtd|j4|jdkrtd|jdkrtd |jphd }|jD]d}t |tr||vrtd |d |1t|d r#|j |vrtd |j d |e|j phd}|j D]d}t |tr||vrtd|d |1t|d r#|j |vrtd|j d |e|j St |j tr*t|j dkrtd|j St |j tr*t|j dkrtd|jt|j|S)z Validate and normalize search request. Args: request: Search request to validate Returns: Validated request Raises: ValueError: If request is invalid zQuery cannot be emptyNrzLimit must be positivedzLimit cannot exceed 100zTimeout must be positiveiz*Timeout cannot exceed 300000ms (5 minutes)>rr r!zInvalid source type: z. Valid types: type>pdfgithubresearchzInvalid category type: z#Location must be a non-empty stringztbs must be a non-empty string)querystrip ValueErrorlimittimeoutsourcesr=strr*rG categorieslocationlentbsscrape_optionsr)r valid_sourcessourcevalid_categoriescategorys r0_validate_search_requestr[\s =2 3 3 5 520111} =A  566 6 =3  677 7" ?a  788 8 ?V # #IJJ J"111 o j jF&#&& j..$%cV%c%cTa%c%cddd/(( j;m33$%hV[%h%hYf%h%hiii%888* q qH(C(( q#333$%jx%j%jXh%j%jkkk46** q=(888$%ox}%o%o]m%o%oppp#'*C00 DC8H8N8N8P8P4Q4QUV4V4VBCC C{'+s++ ?s7;3D3D3F3F/G/G1/L/L=>> >) 6777 NrDct|}|dd}d|vr|j |j|d<d|vr|j |j|d<|j |j|d<|dd|j1t|j}|r||d<|d dt|d d}|(t| }|r||d <|S) z Prepare a search request payload. Args: request: Search request Returns: Request payload dictionary T) exclude_noneby_aliasrNNrOignoreInvalidURLsignore_invalid_urls scrapeOptionsrV integration) r[ model_dumprNrOr`poprVrr+rQrL)rvalidated_requestr scrape_dataintegration_valueintegration_strs r0r#r#s)199  ' 'TD ' I IDd06B)/W !2!:!F+3Y ,8$5$I ! &---'3,->-MNN  0$/D ! !4((( 1=$GG$/006688  2"1D  KrDN)__doc__typingrrrrrrtypesr r r r rrutils.normalizerrutilsrrrrrrr(r[rQr#r<rDr0rns9888888888888888nnnnnnnnnnnnnnnnOOOOOOOOffffffffffff GCLL' ' '''''R%$s)%$q'%d5JCW>X%%%%NCmC CCCCL)])tCH~))))))rD