i's dZddlmZmZmZmZddlmZmZde de fdZ dedefd Z dede fd Z d Zdd ede dee efdeede f dZdee efde fdZdd edee efdeededef dZdede fdZddedee e ffdZdedeee effdZdedee effdZdedee effdZdeedeefdZdeedeee effdZd S) z3 Shared validation functions for Firecrawl v2 API. )OptionalDictAnyList) ScrapeOptions ScrapeFormats format_strreturnc:dddd}|||S)z Convert format string from snake_case to camelCase. Args: format_str: Format string in snake_case Returns: Format string in camelCase rawHtmlchangeTrackingzscreenshot@fullPage)raw_htmlchange_trackingscreenshot_full_page)get)r format_mappings g/home/agentuser/.hermes/hermes-agent/venv/lib/python3.11/site-packages/firecrawl/v2/utils/validation.py_convert_format_stringr s1+ 5N   j* 5 55schemac|rt|ts|Stdtdtffd |S)z Normalize a schema for OpenAI compatibility by handling recursive references. Args: schema: Schema to normalize Returns: Normalized schema objr c t|ts%t|tr fd|DS|St|}| vr|S |t| d vr | Sd vr d}i} D]2\}}t|trd|vr |||<-|||<3i}|D]\}} |||<i|d|i} ||S ddkrd vr ddur d= ddkrad vr]d vrYt d tr;t dtr fd  d D}|r| d <n d =n d =t D]S\}}t|trd|vr | |<-t|tr fd |D |<T | S) Nc&g|] }|Sr.0itemnormalize_objects r zInormalize_schema_for_openai..normalize_object..-s%???4((..???r$ref$defstypeobject propertiesadditionalPropertiesTrequiredc(g|]}|dv |S)r&r)rfield normalizeds rr!zInormalize_schema_for_openai..normalize_object..Xs5"E"E"EE"':l+C"C"C#("C"C"CrcTg|]$}t|tr |n|%Sr) isinstancedictrs rr!zInormalize_schema_for_openai..normalize_object..es;"p"p"pbfZd=S=S#]#3#3D#9#9#9Y]"p"p"pr) r-r.listidadddiscardpopitemsr) robj_iddefsprocessed_restkeyvaluenormalized_defsresultvalid_requiredr+r visiteds @rr z5normalize_schema_for_openai..normalize_object*s(#t$$ #t$$ @????3????JC W  J F#YY  Z   OOF # # #  j >>'**DN(..00 0 0 UeT**0vU/B/B*:*:5*A*AN3''*/N3'' O"jjll ? ? U'7'7'>'>$$AAAAF OOF # # #M NN6 " "h . . J & & NN1 2 2d : :12 NN6 " "h . . * $ $ J & &:j1488 +:l3T:: +"E"E"E"EZ 5K"E"E"E!/-;Jz**":..z*z//1122 q qJC%&& q6+>+>"2"25"9"9 3E4(( q"p"p"p"pjo"p"p"p 3r)r-r.setr)rr r=s @@rnormalize_schema_for_openair?sr FD11 eeG>c>c>>>>>>>@  F # ##rc|rt|tsdStdtdtffd | S)z Validate schema for OpenAI compatibility. Args: schema: Schema to validate Returns: True if schema is valid, False otherwise Trr ct|tsdSt|}|vrdS|d|vr|dS|ddkr6d|vr2d|vr.|ddur|dS|D]}t|tr(d|vr$|r|dS?t|trB|D]?}t|tr(d|vr$|r|dS@|dS) NFr"r$r%r&patternPropertiesr'T)r-r.r0r1r2rvaluesr/)rr5r9rhas_invalid_structurer=s rrDz9validate_schema_for_openai..has_invalid_structure|s#t$$ 5C W  5 F S== OOF # # #5 GGFOOx ' '  # # s * * GG* + +t 3 3 OOF # # #4ZZ\\ ( (E%&& (6+>+>((// OOF+++44 E4(( (!((D!$--(&2D2D0066(#OOF333#'444ur)r-r.r>rbool)rrDr=s @@rvalidate_schema_for_openairFmsu FD11teeG!3!4!!!!!!!F%$V,, ,,raSchema contains invalid structure for OpenAI: object type with no 'properties' defined but 'additionalProperties: true' (schema-less dictionary not supported by OpenAI). Please define specific properties for your object. Note: Recursive schemas using '$ref' are supported.Nrtarget_def_namer6r=c|rt|ttfsdS|t}ddl}||dt }||vrdS|| t|trd|vrt|dt r|dd}t|dkro|dd krc|d d krW|d }||kr | |dS||vr-t|||||| |S| D],}t||||r| |dS-nDt|tr/|D],} t| |||r| |dS-| |n#| |wxYwdS) a Check if an object contains a recursive reference to a specific definition. Args: obj: Object to check target_def_name: Name of the definition to check for recursion defs: Dictionary of definitions visited: Set of visited object keys to detect cycles Returns: True if recursive reference is found, False otherwise FNrT) sort_keysdefaultr"/#r#) r-r.r/r>jsondumpsstrr1splitlenr2_contains_recursive_refrC) rrGr6r=rPobj_keyref_pathdef_namer9rs rrUrUs> jtTl33u%%KKKjjcj::G'u KK! c4  }}CK!=!=}v;,,S11x==A%%(1+*<*<!PWAWAW'|H?22#       4''6tH~X\^eff       *5/4QQ         T " "   *4$PP                 5s%.BGG?)G?.GGG2cj|sdS|D]\}}t|||rdSdS)z Check if $defs contain circular references. Args: defs: Dictionary of definitions to check Returns: True if circular references are found, False otherwise FT)r4rU)r6rX def_values r_check_for_circular_defsr[sT u#zz||) "9h = = 44  5rdepthc|r"t|ttfrdkr|Stt |}|vr|S| t|trd|vrt|dt r|dd}t|dkra|ddkrU|dd krI|d }|vr=tt|dz |S| |Si}| D]$\}} |d kr t| dz||<%| |St|tr%fd |D |S  |n# |wxYw|S) aP Resolve $ref references in a JSON schema object. Args: obj: Object to resolve references in defs: Dictionary of definitions visited: Set to track visited objects and prevent infinite recursion depth: Current recursion depth Returns: Object with resolved references Nr"rKrLrrMrNr#rOc :g|]}t|dzS)rN) resolve_refs)rrr6r\r=s rr!z resolve_refs..s+QQQTLtWeai@@QQQr) r-r.r/r>r0r1rRrSrTr`r2r4) rr6r=r\r5rWrXresolvedr8r9s ``` rr`r`s9 jtTl33urzz %% WWF   KK c4  R}}CK!=!=}v;,,S11x==A%%(1+*<*<!PWAWAW'|H4''+Dh,@,@$QVYZQZ[[  H!iikk N N U'>> ,UD'519 M M   T " " RQQQQQQSQQQ   R  Js%B.G#)G#$ ,89JD,Q,Q)%&7>>;7N_C_C_ 1' :$(CCT'U'U $-.FGG > !<===#;Jx s%*A D88 EE ,E66 FFct|tstdt|dtr|dstd|S)a Validate and prepare query format object. Args: format_obj: Format object that should be query type Returns: Validated query format dict Raises: ValueError: If query format is missing required 'prompt' field >query format must be an object with 'type' and 'prompt' fieldspromptz1query format requires a non-empty 'prompt' string)r-r.rrrRstrip)r|s r_validate_query_formatrss j$ ' '[YZZZ jnnX.. 4 4NJx.>.@.@.HD M*i/1!$+7It#D#D . >>o'/%>#3#;$>$>C)#s33#>#&&==*45+A+A%A#&'>>*45u*v*v$v 1 8 89OPS9T9T U U U U!+C!6!6>VYV]V]^dVeVe+o+A#''&//+R+R+Rko#+v#5#55JKbcKbSY[aKbKb5c5cN$5$<$<^$L$L$L$L%-%8%8$5$<$<=STW=X=X$Y$Y$Y$Y%-%=%=1NC1N1N1NJ'2j'@'@AKP[A\A\ :(>)3 )C)CB'.r<'@'@%bAC\`AaAa :(>$5$<$6M#f+F $5$<$#&8v#5#5$5$<$<=RSVSaSaScSc=d=d$e$e$e$e%(X%8%8$5$<$<=STWTbTbptTbTuTu=v=v$w$w$w$w$5$<$<=STWT\=]=]$^$^$^$^ 1 8 8 = = = =(0=)00<<<',9)00888'0<)00;;;'/<)00;;;'-:)00999'2?)00>>>'7C)001ABBB 0$774/,:,:%c3//+:"f}}&01{&|&| |"g~~&01q&r&r r-445KC5P5PQQQQ'T22%:RURYRYZ`RaRa'k'=cggfoo'N'N'NgkH'6111FG^#G^vW]G^G^1_1_ 1 8 8 H H H H!)W!4!4 1 8 89OPS9T9T U U U U!)\!9!9-J-JV\-J-J #.*#<#<=G^^K=X=XJz$:%/^^J%?%?#*2|#<#<!^=?]]X\]=]=]Jz$: 1 8 8 D D D D#)S==2:2Ic&kCK 1 8 8 = = = =$S&11:"x611 1 8 89Ns~~O_O_9`9` a a a a!$\!9!9.4l-C #*3 T#B#B#N=@]Jz$:#*3 4#@#@#Lahikmyazaz>CR]]X\]=]=]=]ACJz$: 1 8 8 D D D D!$W!4!4 1 8 89OPSP^P^lpP^PqPq9r9r s s s s 1 8 89OPSPX9Y9Y Z Z Z Z-44S9999Y,:^#(::C-44S9999:$%?->K * !!$&!#CCF!&$//C+-(8> LL4J )[88?K 0 < >F!&#.. >)008888#FD11 >&*6ll &+556Aook6R6RK 3)00====&,&7&7T&7&J&J &+556Aook6R6RK 3)00====): I&& ""eT**R.3K ++.3.>.>D.>.Q.QK ++ !!eT**  %f ',yy=Z^A_A_'`'`$$LL !& '.ungeUbdhFiFi'j'j$$L*6 I&&$) C s:_ _"!_")N)Nr)__doc__typingrrrrtypesrr rRrr?rErFrr>rUr[intr`rirpr{rrrrrrrrs-,,,,,,,,,,,000000006s6s6666$O$O$O$O$O$O$d2-s2-t2-2-2-2-lm000s0$sCx.0[cdg[h0tx0000f4S>d(00c0c3h0(3-0WZ0cf0000f C D    2CCCC4S>CCCC&8c8htCH~&>8888BCcCd38nCCCCLstCH~,Xm%<-AX6zH]$;zcSVh@Xzzzzzzr