w3speech tool and lipsync generator
A set of tools for creating lipynced animations from audio and text, and combining them with audio to encode them into w3speech files.
Screenshots 6 screenshots
About this mod Machine translation
A set of tools for creating lipynced animations from audio and text, and combining them with audio to encode them into w3speech files.
w3speech tool and lipsync generator
This package contains a set of command line tools for creating lip animations from audio and text (or just text) and encoding them in combination with audio into w3speech files. The w3speech tool is intended to complement the w2scene encoder (as well as the Storyboard UI mod). The combination of these tools allows the creation of new content in the form of extensive interactive conversations, complete with voice.
There is no GUI for these tools and all adjustments are done by editing text files.
Please note: the quality of phoneme extraction varies greatly. How about the audio in the example
Become a better than expected extraction example.
feature
Packing/unpacking w3speech files
Optional comment for the audio filename, containing the first part of the text of the unpacked w3speech file
Generate some interesting animations from audio and text
Generate lip animation from text only (Unified Phoneme Timing)
Encode/decode lip sync animation to and from the game into a pose weight stream
The results of each step are saved as txt files and allow for multiple adjustment options
These tools are compiled for 64-bit windows. Start with --help to see all options.
limit
No gui, pure cli - but a set of batch files simplifying the build process
Manual timing adjustment is required in almost all cases to obtain usable results
Additional software required to convert audio to wem:
(Free to download) audiokinetic Wwise software for converting audio to wem format (HOWTO included in this package)
(Free) ww2ogg and revorb tools required to convert to ogg (HOWTO included in this package)
important
These are not beginner modification tools. You should have intermediate or advanced knowledge of W3 modification. While some step-by-step documentation is provided in the package, the results require manual tweaking and (in most use cases) cannot be used alone: something (like w2scene or a script) has to trigger replay in the game.
How to install
- Extract all contents into a folder of your choice. If you already have w2scene encoder installed, unzip the package into the same folder (two identical batch files will be overwritten)
- Download one of the repo.lipsync packages and extract it into the repo.lipsync subfolder
- You may need to install the VC++ 2015 Redistributable Package (vc_redist.x64.exe) to run the phoneme extractor
- View the HOW TOs in the docs.lipsync directory
How to uninstall
Delete the above folder.
Install & use Install: follow the bundled instructions
- Unzip the archive from playbuff and read the bundled readme / instructions first.
- There is no universal mod manager for this game: some mods replace game files directly, some go into a game-specific Mods folder, and some need a game-specific community loader or tool first — follow the bundled readme.
- Place the files exactly as the readme says; mods with listed dependencies need those installed too.
- Launch the game to confirm it loaded; some games require enabling mods in settings or an in-game mod menu.
Install locations vary a lot between games and mods — the bundled readme is the most reliable guide.