aESj0 &dZddlmZddlZddlZddlmZddlZddl m Z m Z m Z dZ eejj j Zedz dz Zej&j)d d Zeej&j)d d Zid d dd dd dddddddddddddddddddddddddddddddddddd d d dd! Zehd"Zehd#ZdZd$\ZZd,d%Zd-d&Z d.d'Z!d/d(Z"d)Z#Gd*d+Z$y)0uPocket TTS (Kyutai, MIT) — the Mac voice: cloned, streaming, CPU-only. Chatterbox on Apple Silicon is structurally slow (MPS fallback ops, ~3GB, thermal throttle on the fanless Air). Pocket TTS is a 100M CALM model that runs ~7x realtime on TWO CPU cores of an M4 Air with ~40ms to first audio chunk — so the Mac gets the cloned Jarvis voice without touching the GPU or the RAM budget (~200MB). Voice: voices/jarvis_ref.wav is cloned when the gated HF weights are available (accept terms at https://huggingface.co/kyutai/pocket-tts, then `hf auth login`). Without them it falls back to a catalog voice (POCKET_VOICE, default "george") — never mute. Emotion: Pocket has no exaggeration dial, so the [emotion] tag protocol maps to *reference-clip swaps*: drop voices/jarvis_warm.wav, jarvis_excited.wav, jarvis_dry.wav, jarvis_sad.wav, jarvis_calm.wav (generate them once with Chatterbox on the RTX box, exaggeration dialed per mood) and each tag speaks through the matching clone. Missing clips just use the base voice. Emotion states preload in a background thread after startup so the first [excited] sentence doesn't stall. Env: POCKET_VOICE (catalog fallback voice), VOICE_REF (base clone wav, default voices/jarvis_ref.wav), POCKET_MAX_TOKENS (default 300 ≈ 24s cap). ) annotationsN)Path) _ANY_TAG_RE_TAG_RE split_emotioni]voiceszjarvis_ref.wav POCKET_VOICEgeorgePOCKET_MAX_TOKENS300calmflatseriouswarmhappyexcitedurgentalarmedsadtired sarcasticdryshocked surprisedcurious interested intriguedamusedannoyedtender) rplayfulcheekyr irritated impatienttestyr gentlesoftneutral>rrr"rr!>r%rrrrr$r#r)c6|duxr|tk\xs |tkSN) _LATE_START _LATE_END)hours >/Users/ahmed/devFolder/Ultron/claude-voice/voice/tts_pocket.py _late_nightr1Ms! t  I!4!Hy8HIcBddlm}|jjS)Nrdatetime)r5nowr/r4s r0 _local_hourr7Qs! <<>  r2ctj|xsd}|r6|jdj}|tj |fSt j|xsd}|rp|jdjddjj}|r|jdnd}|xsdtj |fSy)u(emotion word, mood-clip stem) from a leading [emotion] tag — the exact lookup _state_for did inline, factored out so tone-biasing can reuse it. Improvised tags map via their last word; unknown ones give (word, None).rN)NN) rmatchgrouplower _TAG_TO_STEMgetrstripsplit)textmwinners r0 _parse_tagrGVs  djb!A GGAJ   ,""1%%%$*"%A   "1R(..0668!&EKKM" B TL,,Q/// r2c|jry|jr|jrdSdS|jr(t |r |j ry|j rdSdSy)uNo usable brain tag → pick a mood clip from Ahmed's vocal tone. Returns a jarvis_ key, or None for the base voice (today's untagged delivery) when his tone is unremarkable.rrr r rN)laughinguphighdownr1slowlow)toner/s r0 _tone_stemrPfsR }} ww IIy383 yy t 88x// r2cf|$|tvr|tvr|jrtS|St ||S)u(Fuse the brain's tag with Ahmed's live tone. `tag_word` = the brain's emotion word (or None); `base_stem` = the clip it maps to (None = neutral / no clip). A specific tag wins — except a bouncy one softens to `warm` when he's clearly down; urgent/annoyed/shocked are never softened.) _BOUNCE_TAGS _NEVER_DAMPrL _DAMP_STEMrP)tag_word base_stemrOr/s r0 _biased_stemrWus9   $)DII  dD !!r2ceZdZdZdZd dZeddZddZd dZ e dZ e jdZ dd Z dd Zdd Zy ) PocketTTSzDrop-in for KokoroTTS/ChatterboxTTS: synth(text) -> float32 @ 24kHz. Also exposes synth_stream(text) yielding ~80ms chunks (~40ms latency).Tc.ddlm}|j|_t j |_i|_d|_d|_ tjjdddk7|_ tjjdtt}|j!||_|j%|j" |_|j)d t j*|j,d j/y) Nr)TTSModelFg?TONE_TTS10 VOICE_REFzWarm up.T)targetdaemon) pocket_ttsr[ load_model_model threadingLock_lock_states_cloned_speedosenvironr@ _tone_ttsstr _DEFAULT_REF _load_base _base_name _is_default_plainsynthThread_preload_emotionsstart)selfr[base_refs r0__init__zPocketTTS.__init__s'))+ ^^% *,    C8C?::>>+s_CATALOG_FALLBACK)rxrefemsgs r0rpzPocketTTS._load_bases 77>>#  4#';;#I#I##N R # -bgg.>.>s.C-DINO  ;;AA  R   4!f"ciik100 => 3CH:>/034 4sAB00 D 9A DD c @|jsytjdtj DD]W}t dz d|dz }|j s$ |jjt|}||j|<Y|jDcgc]}|s| }}|r(td d jt|d yy#t$r2}td|jdt|ddd Yd}~d}~wwxYwcc}w) zBuild voice states for whatever jarvis_.wav clips exist. Runs in the background after startup; each takes a few seconds.Nc3&K|] }|s| ywr,).0ss r0 z.PocketTTS._preload_emotions..s!H-Ba!-Bsrjarvis_z.wavz voice: mood clip failed (<)z voice: mood clones ready (z, )ridictfromkeysr?values_PROJECTis_filerdrrnrhr~rrjoinsorted)rxstemr|staterkmoodss r0rvzPocketTTS._preload_emotionss|| MM!H\-@-@-B!HHDh&74&)==D<<> P >>s4yI%* T" I!LL.LqAL.  06%=1I0J!L M  P+DII;iAs }ANOO P.s$!3C$D,D D&(DDc|jSr,)rq)rxs r0_voicezPocketTTS._voices r2c t|tr||jk(ry |j5|jj ||j d<ddd||_|j| |_tdtjj|d|jrdnddy#1swYexYw#t$r(}td|dt|dd dYd}~yd}~wwxYw) Nr9z voice: switched to z (uplain — moods offzjarvis + moodsrz voice: switch to rr) isinstancernrqrgrdrrhrrrsrrkr|rr~)rxvrs r0rzPocketTTS._voices!S!Q$//%9  F#';;#I#I!#L R DO"..q11DK )"''*:*:1*=)>?/3{{+@PQQRT U   F 'uIc!fSbk]!D E E Fs/ C)B;A#C;CC C8C33C8clt|ddrt|\}}||jdfSt|xsd\}}t|ddr+ddlm}t |||jt}n|}t|\}}||jj|xsd|jdfS)upStrip the [emotion] tag and pick the matching voice state. Improvised tags ("[Mildly excited]") map via their last word. With TONE_TTS on, Ahmed's live vocal tone also steers the pick when the line is untagged and softens a bouncy tag when he's plainly flat — while urgent/annoyed/shocked always speak at full tilt (see _biased_stem).rsFr9rmr)prosody) getattrrrhrGvoicerrW tone_stater7r@)rxrCclean_rUrVrrs r0 _state_forzPocketTTS._state_fors 45 )$T*HE1$,,r** *(4) 4e , %) ' 2 2 4kmEDD &qdll&&tzr4<<3CDDDr2c|j|\}}|js%tjdtjS|j 5|j j||t}dddjjjjtjjdS#1swYaxYw)z>text (optionally '[emotion] ...') -> float32 mono PCM @ 24kHz.r)dtype max_tokensNr;)rrAnpzerosfloat32rgrdgenerate_audio _MAX_TOKENSdetachcpunumpyastypereshape)rxrCrrwavs r0rtzPocketTTS.synthst, u{{}88ARZZ0 0 ZZ++,,u-6Czz|!'')00<DDRHHZs #CC"c#K|j|\}}|jsy|j5|jj ||t D]\}|j jjjtjjd^ dddy#1swYyxYww)uYield float32 PCM chunks (~80ms each) as they're generated — first chunk in ~40ms on an M4. Holds the model lock for the whole sentence; callers stream one sentence at a time anyway.Nrr;) rrArgrdgenerate_audio_streamrrrrrrrr)rxrCrrchunks r0 synth_streamzPocketTTS.synth_streamst, u{{}  ZZ::5[;:lln((*00299JJ ' ,:ZZs2C BC7 C C C N)returnNone)rrnrbool)rrnrrn)rCrn)rCrnrz np.ndarray)__name__ __module__ __qualname____doc__ accepts_tagsrz staticmethodrrrprvpropertyrsetterrrtrrr2r0rYrYssNLM&!.N& ]] F FE*I ,r2rY)r/ int | Nonerr)rint)rCrnrztuple[str | None, str | None])r/rrz str | None)%r __future__rrkrepathlibrrrvoice.tts_chatterboxrrr SAMPLE_RATE__file__resolveparentrrorlr@rrrr? frozensetrRrSrTr-r.r1r7rGrPrWrYrr2r0rs2# DD > ! ! # * * 1 1("%55 JJNN>8<"**..!4e<=  FF$-v FVy#I09) 5 5    u y&yy' 4? 8xyy (H 0LM GH   YJ   "I,I,r2