Engineer AlphaTwentyThree Posted February 5 Engineer Posted February 5 (edited) I had this idea some time ago already because I sometimes struggle to remember which standard tool I need to get a hold of different platforms, so I'm starting this list to have everything in one place. Also serves as a place to centralize some basic information for beginners to get started with VGM ripping or data mining in general. Of course this list is incomplete and doesn't include things like scripts for different engines. I'll add links to download or GitHub pages if I can find them. If you have another tool at the ready, post here and I'll edit this post. I'll leave out vgmstream and QuickBMS as those should be familiar enough. @admins - move to appropriate forum if this is the wrong place for such a post. ROM extractors/converters Nintendo: GameCube CISO > GCBM - https://github.com/AxionDrak/GameCube-Backup-Manager/releases Wii nkit & GameCube gcz > NKit - https://gbatemp.net/download/nkit.36157/ (or use Dolphin below) Wii rvz > Dolphin - https://dolphin-emu.org/ Config > Paths > add dir > right-click on image > Convert... Wii brsar (U-8 & containing .BIN Lz77 in some cases) > ShowMiiWads - https://github.com/WiiDatabase/showmiiwads-mod Tools > Unpack U8 Archive / Lz77 Decompress (needed for the icon music) WiiU wua > ZArchive - https://github.com/Exzap/ZArchive/releases drag wua onto exe WiiU wux > wudcompress - https://gbatemp.net/threads/wii-u-image-wud-compression-tool.397901/ drag wux onto WudComress.exe > open and extract with VGMToolbox (needs disckey.bin in same folder and ckey.bin in [vgmtoolbox]\external\wiiu) 3DS .3ds > Citra - https://citra-emulator.com/download/windows/ add game directory > right-click > Dump RomFS Switch NCA/XCI/RomFS > HACTool - https://github.com/SciresM/hactool, GUI: https://github.com/bodyXY/Ultimate-Material-Hactool-GUI/releases Switch NSP > Yuzu Sony: PSX bin/cue (PS2 in rare cases) > open .cue with ISOBuster and extract RAW right-click > Extract RAW Data (2352 bytes/block) (for .xa audio and .str video only) PSX, DC and old PC games with audio tracks (Red Book) > mount with Daemon Tools, then copy tracks with ExactAudioCopy (https://www.exactaudiocopy.de/) set up EAC with https://captainrookie.com/how-to-install-and-setup-eac-and-rip-cds-to-flac/ PSP umd > UMDGen - https://www.romhacking.net/utilities/1218/ PS2 chd > CHDman - https://onionui.github.io/docs/advanced/chdman PS2 & PC iso > WinRAR/7zip PS3 pkg > PS3GameExtractor - https://www.psx-place.com/resources/ps3-game-extractor.824/ PS3/PSP EBOOT.PBP (PSN/minis) > PSN PKG Decryptor and Extractor - https://wololo.net/talk/viewtopic.php?t=27773 (mostly for mini) or PBP Unpacker - https://www.psx-place.com/resources/pbp-unpacker-0-94.206/ PS4 pkg > PS4 PKG Tool - https://github.com/pearlxcore/PS4-PKG-Tool Clear directory list > add current dir > Load PKG > View & Extract in top menu > Extract full PKG leave passcode at `00000000000000000000000000000000` (works with already decrypted pkg files) PS4 pkg (alternative) > PS4PKGViewer- https://www.psxhax.com/threads/ps4pkgviewer-a-ps4-pkg-viewer-by-lman-theleecherman.4784/ (for titles with non-standard characters) Extra > Extract Package and Tools > Export Unencrypted Files > All Others: Microsoft Xbox 360 XBLA pirs > wxPirs - https://digiex.net/threads/wxpirs-extract-content-from-xbox-360-demos-video-dlc-and-arcade-game-containers.9464/ or http://gael360.free.fr/wxPirs.php Windows 16/32bit InstallShield installer CAB files > unshield - https://github.com/twogood/unshield (at least if you don't have a 32bit Windows VM set up anyway) all other iso archives are either supported by VGMToolbox (https://github.com/Manicsteiner/VGMToolbox) or can be opened/extracted with WinRAR/7zip Misc. Tools > Extraction Tools > Generic > ISO/Archive Extractor Video demuxing: ffmpeg - https://github.com/FFmpeg/FFmpeg (always use with options `-vn -acodec copy`) you can use this batch in the video folder (auto-trying the most common format where ffmpeg should be used; remove the trailing `_track1` for videos that only have a single audio track) for /L %%k in (1,1,5) do ( for %%i in (*.mp4, *.m4v, *.mov) do ( ffmpeg.exe -i "%%i" -vn -acodec copy -map 0:%%k "%%~ni_track%%k.m4a" ) for %%i in (*.avi) do ( ffmpeg.exe -i "%%i" -vn -acodec copy -map 0:%%k "%%~ni_track%%k.wav" ) for %%i in (*.bk2, *.bik2, *.bik) do ( ffmpeg.exe -i "%%i" -vn -acodec copy -map 0:%%k "%%~ni_track%%k.bik" ) for %%i in (*.mpg, *.mpeg) do ( ffmpeg.exe -i "%%i" -vn -acodec copy -map 0:%%k "%%~ni_track%%k.mp2" ) for %%i in (*.wmv) do ( ffmpeg.exe -i "%%i" -vn -acodec copy -map 0:%%k "%%~ni_track%%k.wma" ) ) VGMToolbox - https://github.com/Manicsteiner/VGMToolbox (mainly for bik, thp, sfd as well as EA and Sony formats) Misc. Tools > Stream Tools > Video Demultiplexer OGMDemuxer - https://www.bunkus.org/videotools/ogmtools/ (part of OGMTools) drag onto exe Unreal Engine: UE Viewer/UModel - https://github.com/gildor2/UEViewer (UE 1-4) FModel - https://github.com/4sval/FModel (needed for UE5) Wwise audio engine parser > Wwiser - https://github.com/bnnm/wwiser (needs Python installed) Unity: AssetBundleExtractor - https://github.com/SeriousCache/UABE AssetStudio.net - https://github.com/Perfare/AssetStudio File > Load Folder > select folder containing the .asset files (loading can take quite a while) Filter > Sounds Extract > Extract filtered selection same for video if available Other tools: Flash SWF > FFDec - https://github.com/jindrapetrik/jpexs-decompiler GameMaker > UndertaleModTool - https://github.com/UnderminersTeam/UndertaleModTool Scripts > Resource Unpackers > ExportAllSounds.csx > No > Yes Wwise sound engine > Wwiser - https://github.com/bnnm/wwiser Nova Extractor > https://gamebanana.com/tools/6569 (file format scanner) sometimes helpful for quick checks regarding the number of files when writing scripts, not to be used for proper rips in 99% of the cases batch-renaming files > Flexible Renamer (just a suggestion; been using it for around 15 years now and I'm used to the layout; doesn't properly scale to hires displays) Things to not forget Include all videos in properly demuxed format (= playable in vgmstream) careful, some demuxers in VGMToolbox don't work properly (like the XMV demuxer in some cases) if only the header is missing, you'll need to provide an accompanying .[ext].txth file (or one per file) > make sure you grab the playback info from the video header Make sure you check ALL audio files to not miss jingles/cues that are sitting in SFX folders or archives music files can be as short as 1-2 seconds, so make sure you're not missing those among the sounds! Old PC games > install/autostart music Don't use purely digital versions for rips (GOG/Steam) when the game was released in physical form! Music playing during install > exit installer > open %TEMP% and clear as much as possible > restart installer > check for new folders - usually a plain audio file is sitting in the temp folder Music playing in autostarter > check on disc; if it can't be located, you might need to parse the exe (there's a QuickBMS script for that) Wii, WiiU, PS3/PSP/PS4/Vita > icon music Wii > sound.bin inside opening.brstm > use ShowMiiWads, rename to opening.[ext] WiiU bootSound.btsnd > \meta\ PS3 snd0.at3 > \PS3_GAME\ PSP snd0.at3 > \PSP_GAME\ PS4 snd0.at9 > \Sc0\ (usually) Vita snd0.at9 > \sce_sys\ move into the main folder together with the txtp files, adding `icon - ` to the name start FSB archives > leave all of them untouched and provide TXTP files for playback; don't split them, this can lose information Quick Guide - Creating PROPER rips Keep all file names, extensions, headers and external instructions intact If any audio format isn't natively supported by vgmstream, but the audio codec itself is supported > provide .[ext].TXTH files in each folder necessary and make sure they play correctly (or ask in the HCS Discord if a format can be implemented in case it's used in enough games) Formats supported by vgmstream - https://github.com/vgmstream/vgmstream/blob/master/doc/FORMATS.md TXTH documentation - https://github.com/vgmstream/vgmstream/blob/master/doc/TXTH.md Keep the game's original folder structure! Extract everything into a `root/` subfolder, then delete all files and folders not needed (images, shaders etc.) until you're left with only the music, cutscenes and videos. Careful to not delete the following: external audio instruction files that provide info about loop points or references to the music system bigfiles that might contain additional music like jingles/stingers/cues Archive/bigfile extraction depends on the case: if it repeats an existing folder structure, integrate if it includes folders but doesn't repeat an existing folder structure (e.g. all assets in one file), extract into the same folder it is located if it doesn't include any folders, extract into a subfolder of the same name, delete the bigfile and add its extension to the folder name Properly demux all videos and make sure the resulting audio files are playable wma sometimes needs to be renamed to wma2 in order for vgmstream to recognize the format; wma_lossless still seems to be unsupported at the moment When everything is playing correctly, place one of the attached batch files in your game folder (i.e. the folder containing the root folder) and run it. Rename the txtp files (loosely sort by using `music - `, `video - `, `jingle - ` etc.) and manually split out FSB sub-tracks containing music make sure internal track names aren't lost when referencing sub-tracks Check if everything gets looped and faded correctly and if not, provide loop and fade markers inside your txtp files. Often times, ignoring a loop with `#i` or forcing a loop from start to end with `#E` is already enough. TXTP documentation - https://github.com/vgmstream/vgmstream/blob/master/doc/TXTP.md HAPPY RIPPING! txtp_creator.7z Edited Saturday at 04:54 PM by AlphaTwentyThree 3
Engineer AlphaTwentyThree Posted February 6 Author Engineer Posted February 6 Added a tool for PSN eboot.pbp decryption & dump. Converts into regular .iso.
Sparagas Posted February 6 Posted February 6 PSX .cue /.bin (or .cue / .bin in general, because some PS2 games and many PC games are also in CD format) can be opened directly through ISO Buster. You need to open .cue file and not .bin file.
Engineer AlphaTwentyThree Posted February 7 Author Engineer Posted February 7 15 hours ago, Sparagas said: PSX .cue /.bin (or .cue / .bin in general, because some PS2 games and many PC games are also in CD format) can be opened directly through ISO Buster. You need to open .cue file and not .bin file. Oh yeah, completely forgot that. Many PSX games have audio tracks as well, which is where Daemon Tools + Exact Audio Copy comes into play because of the proper log file. Added that to the guide with link to a proper EAC setup (most of it is for actual disc drives, this is more about the log and data read settings).
Engineer AlphaTwentyThree Posted February 7 Author Engineer Posted February 7 Added a check list of things to not forget (95% of rips out there are missing at least one point!) as well as a quick guide.
Engineer AlphaTwentyThree Posted February 7 Author Engineer Posted February 7 Small layout overhaul and some more links. This is getting pretty comprehensive now I think.
Engineer AlphaTwentyThree Posted February 7 Author Engineer Posted February 7 Moved the quick guides for the tools into their own lines. Any further suggestions are highly welcome - I'm not a machine that can remember everything (also, I'm getting old)!
Engineer AlphaTwentyThree Posted February 8 Author Engineer Posted February 8 Added yet another tool I forgot - CHDMan for compressed PS2 isos. Also: quick guides now in italics.
Sparagas Posted February 8 Posted February 8 "PSX, DC and old PC games with audio tracks (Reedbook)" Not ReedBook, but Red Book. Also PS2 iso -> not only PS2, but also PC games (IBM PC compatible to be exact) are also using regular ISO for DVD dics
Engineer AlphaTwentyThree Posted February 9 Author Engineer Posted February 9 Typo corrected (thanks) Adjusted ISO info Added Vita icon music info & location.
Engineer AlphaTwentyThree Posted February 10 Author Engineer Posted February 10 Added another tool for PS4 pkg as I just experienced a pkg with a non-standard character in its title id. The other tool (annoyingly!) has no option to change the extraction subfolder being the title id, so the Windows filesystem itself throws an error. Might not be any issue on OS or Linux.
Engineer AlphaTwentyThree Posted February 11 Author Engineer Posted February 11 Added tool for WiiU wux
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now