imdZddlmZmZmZmZddlmZmZm Z m Z ddl m Z ddl mZmZmZmZdded eed eeeffd Zdd eded eed efd Z ddddddd ededeedeededdeedeed e fdZd eded e fdZd eded e fdZ ddddddd ededeedeededdeedeed e fdZd eded e fdZdS)z. Scraping functionality for Firecrawl v2 API. )OptionalDictAnyLiteral) ScrapeOptionsDocumentBrowserExecuteResponseBrowserDeleteResponse)normalize_document_input) HttpClienthandle_response_errorprepare_scrape_optionsvalidate_scrape_optionsNurloptionsreturnc|r|stdd|i}|7t|}|&t|}|r|||S)z Prepare a scrape request payload for v2 API. Args: url: URL to scrape options: ScrapeOptions (snake_case) to convert and include Returns: Request payload dictionary with camelCase fields zURL cannot be emptyr)strip ValueErrorrrupdate)rr request_data validatedoptss e/home/agentuser/.hermes/hermes-agent/venv/lib/python3.11/site-packages/firecrawl/v2/methods/scrape.py_prepare_scrape_requestrs 0ciikk0.///$)399;;#7L+G44  ))44D *##D))) clientcvt||}|d|}|jst|d|}|ds#t |dd|di}t|}tdi|S)aJ Scrape a single URL and return the document. The v2 API returns: { success: boolean, data: Document } We surface just the Document to callers. Args: client: HTTP client instance url: URL to scrape options: Scraping options (snake_case) Returns: Document z /v2/scrapescrapesuccesserrorUnknown error occurreddata) rpostokrjsonget Exceptionr r )rrrpayloadresponsebody document_data normalizeds rr r )s&c733G{{<11H ;2h111 ==??D 88I  E*BCCDDDHHVR((M)-88J  ! !j ! !!rnodepromptlanguagetimeoutoriginjob_idcoder2r3)pythonr0bashr4r5c|r|std|o|}|o|}|s|stdd|i} |r|| d<|r|| d<||| d<||| d<|d |d | } | jst | d | } | d s#t| d dt| } d| vrd| vr | d| d<d| vrd| vr | d| d<d| vrd| vr | d| d<tdi| S)a Interact with the scrape-bound browser session for a scrape job. Either ``code`` or ``prompt`` must be provided. When ``prompt`` is given the server runs an AI agent that translates the natural-language instruction into browser actions. Args: client: HTTP client instance job_id: Scrape job ID code: Code to execute (optional if prompt is provided) prompt: Natural-language instruction for the browser agent (optional if code is provided) language: Programming language ("python", "node", or "bash") timeout: Execution timeout in seconds (1-300) origin: Optional request origin tag Returns: BrowserExecuteResponse with execution output Job ID cannot be emptyz*Either 'code' or 'prompt' must be providedr3r7r2Nr4r5 /v2/scrape/ /interactzinteract with scrape browserr!r"r#exitCode exit_code liveViewUrl live_view_urlinteractiveLiveViewUrlinteractive_live_view_urlr%) rrr&r'rr(r)r*dictr ) rr6r7r2r3r4r5has_code has_promptr-r,r+r/s rinteractrGHs: 331222$ H*FLLNNJ GJGEFFF HDV  X!Y X{{::::DAAH ;Hh(FGGGmmooG ;;y ! !H G-EFFGGGgJZKz$A$A",Z"8 ; ""j'H'H&0&? ?#:--2MU_2_2_2<=U2V ./ ! / /J / //rcV|r|std|d|d}|jst |d|}t |}d|vrd|vr |d|d<d|vrd|vr |d|d<td i|S) z Stop the interaction session for a scrape job. Args: client: HTTP client instance job_id: Scrape job ID Returns: BrowserDeleteResponse r;r<r=zstop interactionsessionDurationMssession_duration_ms creditsBilledcredits_billedr%)rrdeleter'rr(rDr )rr6r,r+r/s rstop_interactionrNs 331222}}<6<<<==H ;<h(:;;;mmooGgJj((-B*-T-T,67J,K ()*$$)9)K)K'1/'B #$ . .: . ..rc"t||Sz(Deprecated alias for stop_interaction().rNrr6s rstop_interactive_browserrS FF + ++rc .t|||||||S)z Deprecated alias for interact().r1)rG)rr6r7r2r3r4r5s rscrape_executerVs0     rc"t||SrPrQrRs rdelete_scrape_browserrXrTr)N)__doc__typingrrrrtypesrr r r utils.normalizer utilsr rrrstrrr intrGrNrSrVrXr%rrr`s0/////////// 766666ffffffffffffx /FRVWZ\_W_R`2"":"C"(=2I"U]""""D?0 !28! ?0?0?0 ?0 ?0 3-?0 SM ?0 ./ ?0c]?0 SM?0?0?0?0?0D/ / /////>, , ,,,,, !28!    3- SM  ./ c] SM,, , ,,,,,,,r