lukas/lektor-ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Initial commit: Polish AI dubbing pipeline (ComfyUI + Higgs Audio V3)

Browse Source 
Converts SRT subtitles into a Polish lektor-style voiceover using a local
ComfyUI instance running Higgs Audio V3, then muxes the result back into the
source video as a second audio track. Video and original audio are always
stream-copied; only the new voiceover track is encoded.

Contents:
  lektor_ai_comfy.py    main pipeline (standard library only, needs ffmpeg)
  lektor_ai_comfy_v2.py batched-context experiment (timing unresolved)
  lektor_ai.py          earlier version using the hosted Boson AI API
  install_comfyui.sh    reproduces the ComfyUI environment, versions pinned
  docs/                 requirements, installation, usage, architecture,
                        troubleshooting
  gudowski/             voice references (.wav) with their transcripts (.txt)

Source media and generated video are gitignored.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
claude
2026-08-09 14:29:53 +02:00
co-authored by Claude Opus 5
commit fc4b761f52
23 changed files with 4452 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
comfy_installation.txt
+57
View File
@@ -0,0 +1,57 @@
=============================================================================
NOTE: These are the original planning notes. Use install_comfyui.sh instead —
it reproduces what is ACTUALLY installed, with versions pinned.
Two things below do not match the real installation:
* "cu128 for your 3090" — the machine has an RTX 4070 Ti SUPER (16 GB).
The cu128 wheels are still correct; only the comment is wrong.
* The `conda install -c conda-forge portaudio libsamplerate ffmpeg espeak-ng
git` line was never actually applied. The environment contains only the 27
base Python packages from conda-forge. ffmpeg is used from the system
(/usr/bin/ffmpeg) and espeak-ng is not installed at all. Everything works
without them, so install_comfyui.sh does not install them either — it only
warns if ffmpeg is missing, since lektor_ai_comfy.py needs it (ComfyUI
itself does not).
=============================================================================
Option A — Conda/Mamba (cleanest match for "a virtual environment, no system changes")
Miniforge gives you its own Python and the native libs (portaudio, ffmpeg, espeak-ng…) inside the environment prefix, so there's no deadsnakes, no sudo apt, nothing in /usr.
bash
# Install Miniforge into its own dir — fully self-contained, removable
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh
bash Miniforge3-Linux-x86_64.sh -b -p ~/miniforge3
# Activate WITHOUT running `conda init` so it doesn't even touch your .bashrc:
source ~/miniforge3/etc/profile.d/conda.sh
conda create -n comfy-tts python=3.12 -y
conda activate comfy-tts
# The libs that were apt before — now inside the env, no sudo:
conda install -c conda-forge portaudio libsamplerate ffmpeg espeak-ng git -y
# PyTorch via pip wheels (more current than conda's channel), cu128 for your 3090:
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128
Then ComfyUI + the suite, all inside the env:
bash
mkdir -p ~/comfy-tts-app && cd ~/comfy-tts-app
git clone https://github.com/comfyanonymous/ComfyUI.git
cd ComfyUI && pip install -r requirements.txt
cd custom_nodes
git clone https://github.com/diodiogod/TTS-Audio-Suite.git
cd TTS-Audio-Suite && python install.py
Launch:
bash
source ~/miniforge3/etc/profile.d/conda.sh
conda activate comfy-tts
cd ~/comfy-tts-app/ComfyUI && python main.py --port 8189
To remove all of it: conda env remove -n comfy-tts, delete ~/comfy-tts-app, and if you want it truly gone, rm -rf ~/miniforge3. Your system Python and apt are never touched.