i,dZddlZddlZddlZddlZddlZddlZddlmZddl m Z m Z ddl m Z mZmZmZmZejeZd dZGdd e ZdS) zKSSH remote execution environment with ControlMaster connection persistence.N)Path)BaseEnvironment _popen_bash)FileSyncManageriter_sync_filesquoted_mkdir_commandquoted_rm_commandunique_parent_dirsreturncLtjdstddS)z@Fail fast with a clear error when the SSH client is unavailable.sshzWSSH is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientN)shutilwhich RuntimeError>/home/agentuser/.hermes/hermes-agent/tools/environments/ssh.py_ensure_ssh_availablers3 <    e     rc $eZdZdZ d&dededed ed ed ef fd Zd'ded zdefdZdZ defdZ d(dZ dededd fdZ dee eefdd fdZdedd fdZdeedd fdZd(dZddd d d!ed"ed ed#ed zdejf d$Zd%ZxZS))SSHEnvironmentaRun commands on a remote machine over SSH. Spawn-per-call: every execute() spawns a fresh ``ssh ... bash -c`` process. Session snapshot preserves env vars across calls. CWD persists via in-band stdout markers. Uses SSH ControlMaster for connection reuse. ~<hostusercwdtimeoutportkey_pathct|||_|_|_|_t tjdz _ j ddj |d|d|dz _ t _t#fdjjjj _jd dS) N)rrz hermes-sshT)parentsexist_ok@:z.sockc2tjdS)N/.hermes)r _remote_homeselfsrz)SSHEnvironment.__init__..9sD4E1O1O1O!P!Pr) get_files_fn upload_fn delete_fnbulk_upload_fnbulk_download_fn)force)super__init__rrrr rtempfile gettempdir control_dirmkdircontrol_socketr_establish_connection_detect_remote_homer(_ensure_remote_dirsr _scp_upload _ssh_delete_ssh_bulk_upload_ssh_bulk_download _sync_managersync init_session)r*rrrrrr __class__s` rr3zSSHEnvironment.__init__(sS S'222      3 5 566E td;;;".D1M1M41M1M$1M1M1MM ""$$$ 4466   """,PPPP&&0!4     d+++ rN extra_argsr cTdg}|dd|jg|ddg|ddg|ddg|ddg|ddg|jd kr)|d t|jg|jr|d |jg|r||||jd |j|S) Nr -o ControlPath=zControlMaster=autozControlPersist=300z BatchMode=yesz StrictHostKeyChecking=accept-newzConnectTimeout=10rz-p-ir$)extendr8rstrr appendrr)r*rDcmds r_build_ssh_commandz!SSHEnvironment._build_ssh_commandCs3g D>)<>>?@@@ D./000 D./000 D/*+++ D<=>>> D-./// 9?? JJc$)nn- . . . = . JJdm, - - -  # JJz " " " di--$)--... rc|}|d tj|ddd}|jdkrD|jp|j}td|dS#tj $r!td|j d|j d wxYw) Nz!echo 'SSH connection established'Tcapture_outputtextrrzSSH connection failed: zSSH connection to r$z timed out) rMrK subprocessrun returncodestderrstripstdoutrTimeoutExpiredrr)r*rLresult error_msgs rr9z$SSHEnvironment._establish_connectionTs%%'' 6777 W^C4QSTTTF A%%"M//11JV]5H5H5J5J "#HY#H#HIII&%( W W WUDIUU UUUVV V Ws A'B0Cc\ |}|dtj|ddd}|j}|r(|jdkrtd||Sn#t$rYnwxYw|j dkrdSd |j S) z(Detect the remote user's home directory.z echo $HOMET rPrzSSH: remote home = %srootz/rootz/home/) rMrKrSrTrXrWrUloggerdebug Exceptionr)r*rLrZhomes rr:z"SSHEnvironment._detect_remote_home_s ))++C JJ| $ $ $^C4QSTTTF=&&((D )Q.. 4d;;;     D  9  7# ###sBB BBc|jd}||d|d|dg}|}|t|t j|ddddS) z?Create base ~/.hermes directory tree on remote in one SSH call.r'z/skillsz /credentialsz/cacheTr]rPN)r(rMrKrrSrT)r*basedirsrLs rr;z"SSHEnvironment._ensure_remote_dirsss#---&&&4(=(=(=$O%%'' '--...s4dBGGGGGGr host_path remote_pathctt|j}|}|dt j|tj|dddddd|j g}|j dkr)| d t|j g|j r| d |j g| ||j d |jd |gtj|ddd }|jdkr)t!d|jdS)z0Upload a single file via scp over ControlMaster.z mkdir -p Tr]rPscprFrGrz-PrHr$r%rz scp failed: N)rJrparentrMrKshlexquoterSrTr8rrIr rrrUrrVrW)r*rfrgrk mkdir_cmdscp_cmdrZs rr<zSSHEnvironment._scp_upload}sUT+&&-..++-- :U[%8%8::;;;yD"MMMM$ Dt/B D DE 9?? NND#di..1 2 2 2 = 2 NND$-0 1 1 1 di#K#K$)#K#Kk#K#KLMMM4QSTTT   ! !Efm.A.A.C.CEEFF F " !rfilesc |sdSt|}|r|}|t|t j|ddd}|jdkr)td|j tj d5}|D]\}}tj ||d }tjtj |d tjtj ||d d d d|dg} |} | dt j| tjtj} t j| | jtjtj} n7#t.$r*| | wxYw| j | d\} }d}| | d\} }n"| jr| jnd}nr#tj$r`| | | | tdwxYw| jdkr@td| jd|d | jdkr@td| jd|d  dddn #1swxYwYt@!dtE|dS)aUpload many files in a single tar-over-SSH stream. Pipes ``tar c`` on the local side through an SSH connection to ``tar x`` on the remote, transferring all files in one TCP stream instead of spawning a subprocess per file. Directory creation is batched into a single ``mkdir -p`` call beforehand. Typical improvement: ~580 files goes from O(N) scp round-trips to a single streaming transfer. NTrjrPrzremote mkdir failed: zhermes-ssh-bulk-)prefix/)r#tarz-chf-z-C.z tar xf - -C /)rXrV)stdinrXrVx)rrr]zSSH bulk upload timed outztar create failed (rc=z): replaceerrorsz tar extract over SSH failed (rc=z*SSH: bulk-uploaded %d file(s) via tar pipe)#r rMrKrrSrTrUrrVrWr4TemporaryDirectoryospathjoinlstripmakedirsdirnamesymlinkabspathPopenPIPErXrakillwaitclose communicatepollreadrYdecoder_r`len)r*rpr"rLrZstagingrfrgstagedtar_cmdssh_cmdtar_procssh_proc_ ssh_stderrtar_stderr_raws rr>zSSHEnvironment._ssh_bulk_uploads&  F$U++  T))++C JJ+G44 5 5 5^C4QSTTTF A%%"#R6=;N;N;P;P#R#RSSS (0B C C C3 w*/ ? ?& ;g{/A/A#/F/FGG BGOOF33dCCCC 27??955v>>>>fc4#>G--//G NN? + + +!'  H %+8?:?%?       O ! ! # # # @ ( 4 4S 4 A A :"%==??*(0(<(???  @"a''"IX-@II%,,I,>>DDFFII"a''"Ex7JEE!(( (::@@BBEE(_3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 j  A3u::NNNNNsF-C=N/+1GN/4HN/.A+JN/A/L  BN//N36N3destc|jdd}|}|dt j|t |d5}tj||tj d}dddn #1swxYwY|j dkr=td |j d dS) z*Download remote .hermes/ as a tar archive.r'rsztar cf - -C / wbrx)rXrVrNrzSSH bulk download failed: ryrz)r(rrMrKrlrmopenrSrTrrUrrVrrW)r*rrel_baserfrZs rr?z!SSHEnvironment._ssh_bulk_downloads3'11188==))++? H(=(=??@@@ $   \^GAjoWZ[[[F \ \ \ \ \ \ \ \ \ \ \ \ \ \ \   ! !lFM ? ? ?3 +++rc|jr3td|j|jr ddd|jdd|jd|jg}tj |dd n#ttj f$rYnwxYw |j dS#t$rYdSwxYwdS) Nz"SSH: syncing files from sandbox...r rFrGz-Oexitr$T)rQr) r@r_info sync_backr8existsrrrSrTOSErrorSubprocessErrorunlink)r*rLs rcleanupzSSHEnvironment.cleanups   + KK< = = =   ( ( * * *   % % ' '  d$H43F$H$HV %?%?DI%?%?As4CCCCCZ78     #**,,,,,      s$6B B%$B%)C CC)rrrr)Nr N)__name__ __module__ __qualname____doc__rJintr3listrMr9r:r;r<tupler>rr?r=rboolrSrrr __classcell__)rCs@rrrs+9A6TD[D" W W W$S$$$$(HHHHGSGsGtGGGG"LOd5c?&;LOLOLOLOLO\ nt n n n n nMS MdMMMM"""";@!$+/ , , ,C ,4 , ,!Dj ,4>4D , , , ,rrr)rloggingr}rlrrSr4pathlibrtools.environments.baserrtools.environments.file_syncrrrr r getLoggerrr_rrrrrrsQQ @@@@@@@@  8 $ $    ttttt_tttttr