SjrdZddlmZddlZddlZddlZddlZddlmZddl Z ddl Z ddl mZdZej$Zej$Zdaej,Zej0j3dd Zej0j3d d Zd&d Zd'd Zd(dZd(dZd&dZ d&dZ!d'dZ"d)d*dZ#dZ$dZ%ee&jOjPjPdz dz Z)ee&jOjPjPdz dz Z*GddZ+d+dZ,d,dZ-d-d.dZ.Gdde+Z/Gd d!e+Z0Gd"d#e+Z1Gd$d%Z2y#e$rdZY?wxYw)/u;Full-duplex audio: continuous 16 kHz mic capture + interruptible playback. Mic runs in a callback thread and feeds an asyncio queue of 32 ms frames (512 samples @ 16 kHz — the frame size Silero VAD expects). Playback keeps its own OutputStream; stop() cuts audio within one block (~10 ms) for instant barge-in. ) annotationsN)Path)keyboardTFMUTE_KEYz++m BREAK_KEYz++.cRtjtdtdy)z7Request an immediate abort of the current turn/control.u& BREAK — aborting current action ()N)_breaksetprint BREAK_HOTKEY CDrcVtjrtjyy)z@True (and clears) if a break was requested since the last check.TF)r is_setclearrrrbreak_requestedr2s }}  rct5|rtjntjt}ddd |j |yy#1swYxYw#t $r}td|Yd}~yd}~wwxYw)zCSet the mute flag AND release / re-acquire the physical mic device.Nz# [mute] mic device toggle failed: ) _mute_lock _mic_mutedr r _active_mic_on_mute_change Exceptionr )mutedmes r _apply_muter:ss   NN         } =  e $  = 7s; < < =s#2AA#A # B,A??Bctjt|k(ryt|t |rdydt dy)uHPublic entry — hotkey, HUD mic button, or control file all route here.Nu? MIC MUTED — device released (earbuds back to hi-fi output)u' MIC UNMUTED — device re-acquired (r )rrboolrr MUTE_HOTKEY)rs r set_mutedr#IsFd5k)  ME 4[M CErc@ttj yN)r#rrrrr _toggle_muter&Ss *##%%&rc~tr\ tjttt t i}d|_|jtdtdt dn tdd d }tj|d }|jy#t$r}td|dYd}~Id}~wwxYw) aGlobal hotkey (Ctrl+Alt+M) + terminal fallback ('m'+Enter). The global hotkey needs macOS Input Monitoring/Accessibility for the terminal app (System Settings -> Privacy & Security); if that's not granted it silently receives nothing, so the stdin fallback matters. Tz mute hotkey: u · break/abort: z; (global; needs Input Monitoring) or type m/stop+Enter herez [mute] global hotkey failed (z); use m+EnterNz; [mute] pynput missing; mute with m+Enter in this terminalcddl}|jD]>}|jj}|dvr t 0|dvs5t @y)Nr)rmuteunmute)stopbreakabortx)sysstdinstriplowerr&r)r/linews r stdin_loopz&_start_mute_hotkey..stdin_loopksCIID ""$A++55 rtargetdaemonreturnNone) _PYNPUT_OK_kb GlobalHotKeysr"r&r rr8startr r threadingThread)hkrr5ts r_start_mute_hotkeyrDWs G""K$0,$@ABBI HHJ OK=0A,POO P KL  48AGGI G 3A3nE F F GsAB B<#B77B<c*tjSr%)rrrrris_mutedrFxs    rc2ddl}|jdk7ry tjgdddd}t |j j }||kr0tjdd d |gdd td |d |yy#t$rYywxYw)uApple's VoiceProcessingIO permanently drags the system input gain down (documented behavior) — a day of sessions left it at 27/100 and the assistant went deaf. Self-heal at startup.rNdarwin) osascript-ez%input volume of (get volume settings)Tcapture_outputtexttimeoutrIrJzset volume input volume rMrOz input volume was u&/100 (VPIO gain-drag) — restored to ) r/platform subprocessrunintstdoutr1r r)floorr/outcurrents rrestore_input_volumerY|s ||x nn HdA cjj&&() U? NNd&>ug$FG#Q  'y1!!&) *     sA2B BBi>ihelperaecmicsysaudioc(eZdZdZddZddZddZy) _FrameQueuez8Shared drop-oldest frame delivery into the asyncio loop.cH||_tjd|_y)N)maxsize)_loopasyncioQueueframes)selfloops r__init__z_FrameQueue.__init__s 18s1K rc |jj|y#tj$rS |jj |jj|Yy#tj $rYYywxYwwxYwr%)re put_nowaitrc QueueFull get_nowait QueueEmptyrfframes r _put_nowaitz_FrameQueue._put_nowaitsm  KK " "5 )     &&( &&u-%%    s&B5A))B<B?BBcp |jj|j|y#t$rYywxYwr%)rbcall_soon_threadsaferp RuntimeErrorrns r_deliverz_FrameQueue._delivers3  JJ + +D,<,z%_pick_input_device..#s!qAvsd microphonemic headsetrKhostapiwasapiwdm-ks)sd query_devicesrosenvirongetr1rT ValueError enumerater2defaultdeviceanyquery_hostapis) devswantid default_inbadbest_ibest_ssapirs @r_pick_input_devicers! ::>>, + 1 1 3D  t9  ZZ&&q)  MCNFF$1 ! "a '  fIOO   #s# # HA 1  GA > FA ##AiL1&9??AC3QSQ ? FA v:FF- . MS   !$1*+a/ JJLAfIOO,==H(   ,   sYD+ D:F.rrrrrrrrKrrrrriT)reverse) rrrrrrr2rrappendsort) rscoredrrrrrr_srWrs @r_input_candidatesrs!')F MCZZ&&q) $1 ! "a '  fIOO   #s# # HA 1  GA > FA ##AiL1&9??AC3QSR ? FA s7 MM1a& !- . KKK,23F52qQFC3JJt JG v   &   4s:D2E 0 — an exact 0.0 means the endpoint is dead/silent.float32) sampleratechannelsdtyper) rrecrT SAMPLE_RATEwaitfloatnpabsmaxr)devsecondsrs r _probe_devicers_ffS;./Ky>  RVVC[__&'' sA-A00 A<;A<cheZdZdZdZdZdZd fd Zd dZdZ ddZ dd Z e dd Z dd ZxZS) MicStreamaiRaw mic capture (sounddevice) with device auto-pick + auto-gain. Auto-gain: wireless/USB headset mics on Windows often capture speech at ~0.03 peak, far below what the VAD reads as voice. We track the rolling peak and scale frames toward a working level before the VAD sees them. MIC_GAIN env forces a fixed gain instead (e.g. MIC_GAIN=6). g333333?g @g~jth?c"t||d|_d|_tj j ddjj}|r|dk7r t|nd|_ |jxsd|_ d|_ y)NMIC_GAINr}auto?r) superrh_stream_devicerrrr1r2r _fixed_gain_gain _roll_peak)rfrgg __class__s rrhzMicStream.__init__2ss .2 #' JJNN:r * 0 0 2 8 8 :'(Q&[58d%%, rc|j$tj||jzddSttj|j }t ||j dz|_|j |jkDrRt|j|j|j z }|xjd||jz zz c_ ||jz}ttj|j }|dkDr'|xjd|z zc_ ||jz}tj|ddS)NrrgX9v?g?g333333?) rrcliprrrr_FLOORmin _MAX_GAIN_TARGETr)rfropeakr7rWoutpeaks r_agczMicStream._agc;s     '7754#3#33T3? ?RVVE]&&()dDOOe$;< ??T[[ ()GHF JJ#$**!45 5Jdjj s )* T> JJ$. (J$**$CwwsD#&&rctjry|j|j|dddfj t j y)Nr)rrrtrastyperr)rfindata_frames_timestatuss r _callbackzMicStream._callbackNs=      diiq!t -44RZZ@Arc|r9|jdc}|_|" |j|jyy|jX t j |j tddt|j|_|jjyy#t$rYywxYw#t$r}td|Yd}~yd}~wwxYw)Nrrrrrr blocksizecallbackz$ [mic] reopen after unmute failed: ) rr+closerr InputStreamrr FRAME_SAMPLESrr?r )rfrrrs rrzMicStream._on_mute_changeSs "llDOAt|}FFHaggi \\ ! B!~~<D )223C3C3E)F:)FA 459#qy'88)F: J %+%%c* ' !J023 ,/K=J J')F(*$S)~~c*#:M$/?SzKL%%c* dV5%)S[mDFG3;MM#&+   f %"V %)C $!~~*#+!^^    ""$" " #'>>##6 8<8H8H'$"2"2!34#t'7'7&8G;<='03H:Q?@@y:  j $-dnnS.A-B"QCHI#  $s= I 2)II B$II II J')JJc ||ntjjd}tj|dS#t$rYywxYw)Nrrr)rrrrr)ridxs rrzMicStream._dev_namesI #bjj.?.?.BC##C(0 0  s8; AAc|j<|jj|jjd|_yyr%rr+rrfs rr+zMicStream.stop8 << # LL    LL   DL $rru)rorvr:rvrr!r:r;r9)r int | Noner:str)rwrxryrzrrrrhrrrr? staticmethodrr+ __classcell__rs@rrr%sPGI F'&B B*DAL rrcfeZdZdZd fd Zed dZd dZd dZd dZ d dZ d dZ d d Z xZ S) AECMicStreamugEcho-cancelled mic via helper/aecmic (Apple VoiceProcessingIO). Audio played by this Mac — including our own TTS — is subtracted from the mic signal in hardware-adjacent DSP, so barge-in detection never hears the assistant's own voice. Silence between utterances is gated to literal zeros by Apple's noise suppression; that's normal. ct||d|_d|_t j |_t j |_ttjjdd|_ y)NAEC_GAINz1.0) rrh_proc_threadr@Event _stopping_wakerrrrrrfrgrs rrhzAECMicStream.__init__sW .2 04 "*__& 2::>>*e<= rc*tjSr%) AEC_HELPERis_filerrr availablezAECMicStream.availables!!##rc|atjs|jt j |j d|_|jjy)NTr6) rrr_spawnr@rA_readerr r?rs rr?zAECMicStream.startsD   " KKM ''t||DI  rcp|jyttg}tjj ddk(r|j d tj|tjtjd|_y#t$r}td|d|_Yd}~yd}~wwxYw)z@Launch the aecmic helper (acquires the mic / VoiceProcessingIO).N AEC_BYPASS1z--bypassrrUstderrbufsizez [aecmic] spawn failed: ) r rrrrrrrRPopenPIPEDEVNULLrr )rfargsrs rrzAECMicStream._spawns :: ! J  ::>>, '3 . KK # #))Z__Z5G5GDJ  -aS1 2DJJ s:B B5B00B5cr|jdc}|_| |jyy#t$rYywxYw)uTerminate the helper — RELEASES the mic device so Bluetooth earbuds drop the call profile and go back to hi-fi output.N)r  terminaterrfps r_killzAECMicStream._killsA D 4: =     s * 66c\|r|j|jjyr%)r&rr )rfrs rrzAECMicStream._on_mute_changes  JJL rcvtdz}ttz }tjttj}d}|j j stj rY|jd}|j||jj||jj|j}|<|jd}|j}||jjd |jj!|}|s|j||z }t%||k\rtj&|d|tj(}||d}tj rnd|j+tj|j,dz z}|jtj.|ddt%||k\r|j j syy#t"$r|jYwxYw)Nrrrg?@rr)rrrzerosrrrrr&rtrrrr rrUreadrlen frombufferint16rrr) rf frame_bytes frame_dursilencebufprocdatapcm16ros rrzAECMicStream._readers#a' !K/ ((= ;..'')  "  g&  *   "::D| zz<JJOOC( {{'' 4  4KCc(k) c,;&7rxxH+,'$$& RZZ0DJJ4HI bggeT378 c(k)7..''))(   sHH87H8ct|urda|jj|jj|j yr%)rrr rr&rs rr+zAECMicStream.stop*s6 $ K   rrur:r!r9r)rwrxryrzrhrrr?rr&rrr+rrs@rrrs@ >$$ &9PrrcVeZdZdZdfd Zed dZd dZd dZd dZ d dZ xZ S) SystemAudioStreamuaSystem-audio (loopback) capture via helper/sysaudio (ScreenCaptureKit). Taps what the Mac is PLAYING — the remote voices of an online meeting come out of the speakers — cleanly and at full quality. This is the "them" side of a meeting: the AEC mic deliberately erases speaker output, so the far end is only audible here. Emits the same 16 kHz int16 mono frames as AECMicStream. Deliberately simple: NOT part of the mute-hotkey logic (a meeting recording must not be muted by the mic hotkey) and no AGC (digital audio is already leveled) — just start/stop and clip to [-1,1]. On SCK failure (no Screen-Recording grant when spawned from a plain terminal) the helper exits with a reason on stderr and NO frames arrive; last_error surfaces it so the caller can tell Ahmed instead of silently recording his side only. ct||d|_d|_d|_t j |_d|_y)Nr}) rrhr r  _errthreadr@r r last_errorrs rrhzSystemAudioStream.__init__Cs: .2 04 37"*rc*tjSr%)SYSAUDIO_HELPERrrrrrzSystemAudioStream.availableKs&&((rc  tjttgtjtjd|_tj|jd|_ |jjtj|jd|_|jjy#t $r/}t||_td|d|_Yd}~yd}~wwxYw)Nrrz [sysaudio] spawn failed: Tr6)rRrrr?rr rr=r r@rArr r? _drain_errr<)rfrs rr?zSystemAudioStream.startOs #))_%&z!DJ!''t||DI  $**$//$O  !!fDO /s3 4DJ   sAC D%C>>Dc|j}| |jyt|jjdD]O}|j ddj }|s&d|vs+|j ddj |_Qy)Nrzutf-8replacerunningz sysaudio:r})r riterreadlinedecoder1rCr=)rfr4rawr3s rrAzSystemAudioStream._drain_errasyzz <4;;.  ,,c2C::gy1779D$"&,,{B"?"E"E"G 3rcFtdz}|j}| |jyd}|jj s |jj |}|sy||z }t||k\rtj|d|tj}||d}|jtjdz }|jtj|ddt||k\r|jj syy#t $rYywxYw)Nrrr)r*rr)rr rUrrr,rr-rr.r/rrrtr)rfr0r4r3r5r6ros rrzSystemAudioStream._readerms#a' zz <4;;. ..'') {{'' 4 4KCc(k) c,;&7rxxH+,' RZZ07: bggeT378 c(k)..'')  sD D D c|jj|jdc}|_| |jyy#t$rYywxYwr%)rr r r#rr$s rr+zSystemAudioStream.stopsO  D 4: =     sA AArur8r9) rwrxryrzrhrrr?rArr+rrs@rr:r:3s6 )) $ H9(rr:cdeZdZdZd dZdZd ddZddZddZddZ dd Z e dd Z ddd Z y)Speakerz7Plays queued PCM chunks; stop() silences within ~10 ms.c||_tjdtj|_t j |_d|_d|_ y)Nrr)F) rrr+r_bufferr@Lock_lockr_active)rfrs rrhzSpeaker.__init__s;$xx4 ^^% /3  rc(|j5t|t|j}|jd||d|df<d||ddf<|j|d|_t|jdk(rd|_dddy#1swYyxYw)NrrF)rPrr-rNrQ)rfoutdatarer_statusrs rrzSpeaker._callbacks} ZZFC -.A!\\"1-GBQBEN GABEN<<+DL4<< A%$ ZZs A2BBNc tj|jdddd||j|_|jj y)Nrrrlow)rrrrlatencyrr)r OutputStreamrrrr?)rfrs r_openz Speaker._opensA^^   rc"ddl} |jy#t$r%}tdt |dddYd}~nd}~wwxYw|j dk(r ddl}|jdxsd}tjj|rvtj|d d d gd d d jj}td|Dd}|r,tj|d d d|gd d td|dn#t$rYnwxYwt!dD]l} |jy#t$rL}|dk(r(tdt |dddd|_Yd}~yddl}|j'dYd}~fd}~wwxYwy)unOpen the output stream. The default output can be a flaky Bluetooth device (e.g. disconnected CMF Buds) that fails with a PortAudio error — that used to CRASH the whole engine at startup. So on failure we switch the system default output to the built-in speakers and retry, and if even that fails we degrade to mute rather than die.rNz" speaker: default output failed (<u") — trying the built-in speakersrHSwitchAudioSourcez#/opt/homebrew/bin/SwitchAudioSourcez-az-toutputTrKrLc3K|]8}d|jvsd|jvr|j:yw)macbookzbuilt-inN)r2r1)ros rrz Speaker.start..s9$@t!'0AGGI'='1QWWY'>%&GGIts>Az-srPz speaker: switched output to ''rz& speaker: could not open any output (u6) — Jarvis will be MUTE until an output device worksg?)r/rYrr rrQshutilwhichrpathexistsrRrSrU splitlinesnextrangertimesleep) rfr/rrcsasallobuiltinattempt_ts rr?z Speaker.starts  2 JJL  2 6s1vcr{mD11 2 2 2 <<8 # ||$78@?77>>#&%>>3dH*E9=D2355;VJJL#$@t$@AEGG"T8T7'K6:AG ?yJK  QxG   a<B3q6#2;-PRRS#'DL!    sE AAAB.D DD%D77 F 'F-FF c|j<|jj|jjd|_yyr%rrs r stop_streamzSpeaker.stop_streamrrc|j5tj|j|j tj g|_d|_dddy#1swYyxYw)z.Queue audio (float32 mono at self.samplerate).TN)rPr concatenaterNrrrQ)rfpcms rplayz Speaker.plays@ ZZ>>4<<BJJ9O*PQDLDLZZs A A!!A*c|j5tjdtj|_d|_dddy#1swYyxYw)z6Barge-in: drop everything queued, silence immediately.rr)FN)rPrr+rrNrQrs rcutz Speaker.cuts0 ZZ88ARZZ8DL DLZZs 2AAc|jSr%)rQrs rspeakingzSpeaker.speakings ||rcKd}|jrQtj|d{||z }||k\r|jt dy|jrPyy79w)zWait for playback to drain. The timeout is a fail-safe: if the output device wedges (never drains), cut instead of hanging the whole conversation loop in 'speaking' forever.rNu7 [speaker: playback wedged — cut after timeout])rzrcrkrxr )rfpollrOwaiteds r wait_donezSpeaker.wait_donesXmm--% % % dNF  OP mm %s'A%A#6A%!A%)rrTr%r9)rurvr:r;r8)g?g^@)r|rrOrr:r;)rwrxryrzrhrrYr?rrrvrxpropertyrzr~rrrrLrLsBA% *X  !  rrLr9r8r)F)rVrTr:r;)r:r)r:zlist[int | None])g333333?)rrrrr:r)3rz __future__rrcrrRr@pathlibrnumpyr sounddevicerpynputrr=r< ImportErrorr rr rrOrrrr"r rrrr#r&rDrFrYrr__file__resolveparentrr?r^rrrrrr:rLrrrrs# &JY__    Y^^  jjnnZ)9: zz~~k+;< E  =E'B .  (^ # # % , , 3 3h > I x.((*11888CjP24n,^ U U ps;slU UpllgJsE%%E0/E0