This topic was archived here:

https://web.archive.org/web/20230000000000fw_/https://www.zenhax.com/viewtopic.php?t=15053

eclipse00074, posted Mon Mar 29, 2021 1:48 pm (63119)

---

Hello! I need help to unpack files from .dat and pack back the modified ones. Here a .zip archive that contains a sample .dat file (0_DISC_INIT.dat).
Also here is a link to dat.ndx, maybe it contains all the filenames that are in .dat
https://www.mediafire.com/file/936xyj88 ... x.zip/file

aluigi, posted Wed May 12, 2021 6:07 pm (63960)

---

I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)

eclipse00074, posted Sun Jun 06, 2021 10:42 pm (64569)

---

aluigi wrote:

I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)

Thanks a lot for the script! Sorry for the late respond, only now I saw your post. It worked, but there are a couple of problems =(
1. In process of unpacking files at some point the following error appears: https://imgur.com/Mrtmobx But there is no 9_DISC_XB.dat file in the dat folder. That's all we have:

Code:

0_DISC_INIT.dat
1_DISC_DEV.dat
2_DISC_FPX.dat
3_DISC_FPX.dat
4_DISC_ARC.dat
5_DISC_ARC.dat
6_DISC_ARC.dat
7_DISC_AUC.dat
8_DISC_PS.dat
11_DISC_OTH.csv
11_DISC_OTH.dat
12_DISC_OTH.csv
12_DISC_OTH.dat
13_DISC_OTH.csv
13_DISC_OTH.dat
14_DISC_OTH.csv
14_DISC_OTH.dat
15_DISC_OTH.csv
15_DISC_OTH.dat
16_DISC_OTH.csv
16_DISC_OTH.dat
17_DISC_OTH.csv
17_DISC_OTH.dat
18_DISC_OTH.csv
18_DISC_OTH.dat
19_DISC_OTH.csv
19_DISC_OTH.dat
datfiles.version

2. It seems all the *.cfg or *.json or other text files are not readable (encrypted or compressed?). I've attach the zip archive with some of this files.

Is any chance to extract all files from .dat and make them readable? (*.cfg, *.json etc)

And thanks again for your hard work! Many times your scripts helped me to modify games =)

x1SlowSBCx, posted Wed Aug 11, 2021 9:38 pm (65683)

---

I get this error trying to unpack them:- enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat

- error in src\file.c line 615: fdnum_open()
Error: No such file or directory

Last script line before the error or that produced the error:
66 open FDSE TMP 1
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit

Edit: I tried a different method now i get a different error: - enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat
00000008 83849 00000000.dat

Error: incomplete input file 1: C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\0_DISC_INIT.dat
Can't read 64 bytes from offset 00000008.
Anyway don't worry, it's possible that the BMS script has been written
to exit in this way if it's reached the end of the archive so check it
or contact its author or verify that all the files have been extracted.
Please check the following coverage information to know if it's ok.


Last script line before the error or that produced the error:
70 log NAME OFFSET SIZE 1

- OFFSET 0x00000008
- SIZE 0x00014789
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit

aluigi, posted Fri Aug 27, 2021 4:04 pm (65931)

---

Please upload the index file.

x1SlowSBCx, posted Sat Sep 11, 2021 2:13 am (66264)

---

the website says .ndx isnt allowed

LokiReborn, posted Sat Sep 11, 2021 2:18 am (66265)

---

x1SlowSBCx wrote:

the website says .ndx isnt allowed

you can put it in a zip or add .bin to extension etc.

x1SlowSBCx, posted Sat Sep 11, 2021 2:28 am (66266)

---

its too big, its 28mb

aluigi, posted Tue Sep 14, 2021 11:09 am (66359)

---

Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?

restyy1967, posted Sun Dec 19, 2021 10:46 am (68361)

---

aluigi wrote:

Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?

I have uploaded the file. Is it possible this file unpack ?


https://www.mediafire.com/file/kixlflot ... at.7z/file

aluigi, posted Thu Jan 06, 2022 6:24 pm (68772)

---

The script seems to be correct and it expects 0_DISC_INIT.dat to be 931 Mb, isn't that size?
Can you provide a screenshot or directory list of the files in "C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat" ?

x1SlowSBCx, posted Sun Jan 09, 2022 5:19 pm (68913)

---

https://imgur.com/a/sjtePzz
https://imgur.com/a/Gf1DSSS
Heres the NDX file.
https://mega.nz/file/jBlCnBrZ#QHQ2nR3el ... d8EYjsQ4HE
Heres the error i get
https://imgur.com/a/wMJWpvq
Thanks

aluigi, posted Sun Jan 09, 2022 5:58 pm (68916)

---

Here is the explanation:
dat.ndx is a sort of incremental index file, everytime there is a patch that modifies or removes the "dat" archives, the new information are appended to this dat.ndx and the old information are simply made "unavailable" by setting FILE_ID to 0xffffffff.

For example the problem with 0_DISC_INIT.dat may have been caused by this patch https://steamdb.info/patchnotes/6239635/ that indeed seems to delete its content (and therefore keeping a 0bytes file), which is now like the one you took in the screenshot: https://steamdb.info/depot/1038251/

Long story short I just updated the script by checking if the filename is valid because I have no other simple way to check FILE_ID 0xffffffff handled in two different locations of the script, but the result is correct:
http://aluigi.org/bms/dirt5.bms

x1SlowSBCx, posted Sun Jan 09, 2022 6:05 pm (68918)

---

Interesting. So i ran the new script and this is what i got.
https://imgur.com/a/gr2PFTy

aluigi, posted Sun Jan 09, 2022 6:20 pm (68923)

---

Are you using the new script 0.1.1?

Code:

# Dirt 5 NDX/DAT (script 0.1.1)

x1SlowSBCx, posted Sun Jan 09, 2022 7:03 pm (68925)

---

aluigi wrote:

Are you using the new script 0.1.1?

Code:

# Dirt 5 NDX/DAT (script 0.1.1)

Ya, and i just double checked. Maybe im doing something wrong?

aluigi, posted Sun Jan 09, 2022 8:35 pm (68932)

---

I don't know what to say because I redownloaded the script and it works correctly in my test.
For sure it's impossible that it tries to dump the file 00000000.dat because there is a line in the script (line 65 'if NAME != ""') that doesn't allow empty skips empty filenames like the one in your screenshot.

x1SlowSBCx, posted Mon Jan 10, 2022 1:15 am (68941)

---

Hmm. Ill try and reinstall the game maybe??

aluigi, posted Mon Jan 10, 2022 8:06 am (68956)

---

Why reinstalling the game? It's a problem of the script.

Are you sure that the last screenshot is the correct one?
As already said, it's impossible that you get that error so maybe you posted an old screenshot?

x1SlowSBCx, posted Tue Jan 11, 2022 1:16 am (68981)

---

idk maybe the files were messed up somehow... anyways yep i just ran it again its the same error. Interesting.

x1SlowSBCx, posted Sat Jan 15, 2022 6:05 am (69094)

---

Okay i got the script to work, i put all the files on my desktop instead of in the game directory and it extracts them, but i dont see the 3d models in here..... now im sad

x1SlowSBCx, posted Tue Jan 18, 2022 3:05 am (69156)

---

Managed to extract the files, but i couldn't find the 3d models, i double checked BMS and it has this error:
https://imgur.com/a/YwQz6AK

aluigi, posted Wed Jan 19, 2022 4:43 pm (69179)

---

It's quite weird, both the problem solved by moving the files in a new directory and the last one.

In that screenshot the index file says that there are files in the 20_DISC_HI.dat archive but that archive doesn't exist.
It's not a problem of the script.
If you want to skip the files located in unexistent archives you can patch dirt5.bms in this way:

Old:

Code:

...
                    open FDSE TMP 1
                endif

                log NAME OFFSET SIZE 1
...

New:

Code:

...
                    open FDSE TMP 1 EXISTS
                endif

                if EXISTS != 0
                log NAME OFFSET SIZE 1
                endif
...

x1SlowSBCx, posted Wed Jan 19, 2022 4:48 pm (69180)

---

If I'm not mistaken, (im not entirely sure because im at work XD) that is the biggest file in the archive. I'll have to check when I get home. I appreciate your help.
Edit: nope its not there