aluigi, posted Tue May 08, 2018 6:30 am (34758)

---

Currently I have opted for writing ? or a char like <>|: in the entry. They are invalid chars for a filename, perfect for forcing this "special" clipboard mode.

Ah, the IPC mode is complete, it's probably totally useless since I think I'm going to release a dll but who cares:
- named pipe in message mode \\.\pipe\quickbms
- named pipe in byte mode \\.\pipe\quickbms_byte
- mailslot (not tested) \\.\mailslot\quickbms
- web IPC

They support just compression and encryption since there is nothing else interesting to offer.

Acewell, posted Tue May 08, 2018 6:32 am (34759)

---

Quote:

Error: the script uses more array indexes (7000) than supported (7000)

could you maybe increase support to at least 10000?

aluigi, posted Tue May 08, 2018 6:36 am (34760)

---

@Acewell
it's not a limitation of quickbms. you get that error because you have stored data in 7000 entries and you are trying to use the one after the last one.
my mistake is probably having used the word "supported" (like something referred to quickbms) instead of something else referred to the script itself.

Acewell, posted Tue May 08, 2018 6:53 am (34761)

---

ah okay, i see the mistake now, my bad

aluigi, posted Tue May 08, 2018 7:00 am (34762)

---

In the next version I'm going to use a lame work-around to retrieve the amount of elements in an array:
getarray ELEMENTS 0 -0x80000000

Basically a large negative index, in fact quickbms already supports negative indexes for reading elements at the end of the array, so this is the only work-around available to get the number of elements.

aluigi, posted Wed May 09, 2018 1:39 pm (34803)

---

Since I'm annoyed of Oodle changing the prototype of OodleLZ_Compress and OodleLZ_Decompress everytime (it reminds me what I did with my mydownlib library, I understand that), I have decided that from version 0.8.5 the whole operation (GetProcAddress scanning and calling) will be automatized and handled by my calling_convention library so it's no longer necessary for me to touch my code after I add the new dll

michalss, posted Fri May 11, 2018 6:06 pm (34880)

---

aluigi wrote:

Currently I have opted for writing ? or a char like <>|: in the entry. They are invalid chars for a filename, perfect for forcing this "special" clipboard mode.

Ah, the IPC mode is complete, it's probably totally useless since I think I'm going to release a dll but who cares:
- named pipe in message mode \\.\pipe\quickbms
- named pipe in byte mode \\.\pipe\quickbms_byte
- mailslot (not tested) \\.\mailslot\quickbms
- web IPC

They support just compression and encryption since there is nothing else interesting to offer.

Nice, any samples pls ?

aluigi, posted Fri May 11, 2018 8:31 pm (34884)

---

This is a portion of quickbms.txt that I'm still writing for quickbms 0.8.5 and it explains quite well how the IPC interface works:

Code:

D] web API and named pipe/mailslot IPC interface
------------------------------------------------

The -W command-line option starts the IPC mode which includes:
- web api running on the port specified with the -W option
- named pipe IPC in byte mode on \\.\pipe\quickbms_byte
- named pipe IPC in message mode on \\.\pipe\quickbms
- mailslot IPC on \\.\mailslot\quickbms\send with
  \\.\mailslot\quickbms\recv open in write mode (create it on your tool)

These interfaces have been successfully tested on both Windows and
Linux and the following is a quick set of examples for how using them
for decompressing data, those 302 and 1028 are only an example of input
and output size:

Example of web API:
POST http://127.0.0.1:1234/compress?algo=zlib&size=1028
attached Content is compressed input "as-is" (application/octet-stream)

Example of Named pipe (byte mode):
CreateFile      \\.\pipe\quickbms_byte
send: "comtype zlib\n"
send: "302\n"
send: 302 bytes of compressed data
send: "1028\n"
recv: "1028\n"
recv: 1028 bytes of decompressed data

Example of Named pipe (message mode):
CreateFile      \\.\pipe\quickbms
send: "comtype zlib"
send: "302"
send: 302 bytes of compressed data
send: "1028"
recv: "1028"
recv: 1028 bytes of decompressed data

Example of Mailslot:
CreateFile      \\.\mailslot\quickbms\send  GENERIC_WRITE
send: "comtype zlib"
send: "302"
send: 302 bytes of compressed data
send: "1028"
CreateMailslot  \\.\mailslot\quickbms\recv
recv: "1028"
recv: 1028 bytes of decompressed data

The IPC interface supports the encryption command too and other
features and commands may be added in future.
Currently the web API supports also /script and /file that are meant
mainly for debugging an input script and an input file based on the
script previously provided. In the latter case there will be no output
file generated just like with the -0 option (the TEMPORARY_FILE may be
the only exception).

If you need "code" it depends by your programming language, there are plenty of examples online since they are just a web API and a simple CreateFile ReadFile WriteFile( CreateMailSlot for mailslots) which are the basis of Windows programming

aluigi, posted Sat May 12, 2018 9:22 am (34900)

---

Just a note about filexor/filerot/filecrypt because the current quickbms.txt documentation lacks the FILENUM field after OFFSET:
filexor VAR [OFFSET] [FILENUM]

filexor is a command that works universally on all the files, that FILENUM is ONLY referred to the optional OFFSET field since it's used to calculate the position in the key you are using depending by the offset of the file.
Now there is a very rare event (happened yesterday) in which you may need to use a MEMORY_FILE or a file different than the main one (0) and after you set OFFSET you notice that the decryption is a mess... that's caused by the missing FILENUM field which is mandatory in this rare situation, example:

Code:

savepos CURRENT_OFFSET MEMORY_FILE
filexor KEY CURRENT_OFFSET MEMORY_FILE
get VAR long MEMORY_FILE

Don't think that being the author of quickbms makes me remember all the commands, options, features, caveats and bugs of the tool
I check quickbms.txt and even the source code of quickbms (damn "encryption random"...) very often...

michalss, posted Mon May 14, 2018 6:07 pm (34922)

---

aluigi wrote:

This is a portion of quickbms.txt that I'm still writing for quickbms 0.8.5 and it explains quite well how the IPC interface works:

Code:

D] web API and named pipe/mailslot IPC interface
------------------------------------------------

The -W command-line option starts the IPC mode which includes:
- web api running on the port specified with the -W option
- named pipe IPC in byte mode on \\.\pipe\quickbms_byte
- named pipe IPC in message mode on \\.\pipe\quickbms
- mailslot IPC on \\.\mailslot\quickbms\send with
  \\.\mailslot\quickbms\recv open in write mode (create it on your tool)

These interfaces have been successfully tested on both Windows and
Linux and the following is a quick set of examples for how using them
for decompressing data, those 302 and 1028 are only an example of input
and output size:

Example of web API:
POST http://127.0.0.1:1234/compress?algo=zlib&size=1028
attached Content is compressed input "as-is" (application/octet-stream)

Example of Named pipe (byte mode):
CreateFile      \\.\pipe\quickbms_byte
send: "comtype zlib\n"
send: "302\n"
send: 302 bytes of compressed data
send: "1028\n"
recv: "1028\n"
recv: 1028 bytes of decompressed data

Example of Named pipe (message mode):
CreateFile      \\.\pipe\quickbms
send: "comtype zlib"
send: "302"
send: 302 bytes of compressed data
send: "1028"
recv: "1028"
recv: 1028 bytes of decompressed data

Example of Mailslot:
CreateFile      \\.\mailslot\quickbms\send  GENERIC_WRITE
send: "comtype zlib"
send: "302"
send: 302 bytes of compressed data
send: "1028"
CreateMailslot  \\.\mailslot\quickbms\recv
recv: "1028"
recv: 1028 bytes of decompressed data

The IPC interface supports the encryption command too and other
features and commands may be added in future.
Currently the web API supports also /script and /file that are meant
mainly for debugging an input script and an input file based on the
script previously provided. In the latter case there will be no output
file generated just like with the -0 option (the TEMPORARY_FILE may be
the only exception).

If you need "code" it depends by your programming language, there are plenty of examples online since they are just a web API and a simple CreateFile ReadFile WriteFile( CreateMailSlot for mailslots) which are the basis of Windows programming

Thx im gonna try it out, but do u have any idea when DLL will be released ? I sure u dont know exactly but roughtly ?

aluigi, posted Mon May 14, 2018 9:59 pm (34924)

---

I guess I will release 0.8.5 (and its dll version) before the end of the month.
All the things in my todo list have been done.

michalss, posted Tue May 15, 2018 6:17 pm (34947)

---

aluigi wrote:

I guess I will release 0.8.5 (and its dll version) before the end of the month.
All the things in my todo list have been done.

Yeaah best news ever Thx man this will be a new rising day for modders

aluigi, posted Tue May 15, 2018 8:26 pm (34948)

---

Is it really so useful to use the compression algorithms of quickbms?

Most of them are known libraries (zlib, lz4, lzo and so on) or small algorithms easy to port to other languages.
The encryption algorithms are all known libraries.

michalss, posted Tue May 15, 2018 11:49 pm (34953)

---

aluigi wrote:

Is it really so useful to use the compression algorithms of quickbms?

Most of them are known libraries (zlib, lz4, lzo and so on) or small algorithms easy to port to other languages.
The encryption algorithms are all known libraries.

Yes it is for programmer like where i dont need to look for something, simply everything on 1 place and i believe that usage of the functions will be the same for all algos or compressions or at least very similar , so its also make thing easier.

aluigi, posted Sun May 27, 2018 6:47 pm (35337)

---

Anyone with new ideas?
Basically quickbms 0.8.5 is ready and I can release it when I desire, so any last-minute fix/improvement/feature is welcome.

P.S.: just fixed a lame bug in SortArray. Now the sorting time passed from N sections (even minutes) to 0 seconds.

aluigi, posted Wed May 30, 2018 9:35 am (35399)

---

In the meantime this is the output generated by a new feature of quickbms that can be invoked with the -t option and may be implemented in other fields in future (for example with the web api interface):

Code:

|- 
    |- file.txt
    |- files2
        |- folder1
            |- file7.txt
    |- files
        |- test_file.txt
        |- folder1
            |- file1.txt
            |- file2.txt
            |- file3.txt
        |- folder2
            |- file4.txt
            |- file5.txt
            |- file6.txt
        |- folder3
            |- file8.txt
        |- folder4
            |- file9.txt
            |- file10.txt
    |- a
        |- b
            |- c
                |- d
                    |- e
                        |- f
                            |- g
                                |- test.txt

Code:

| 
|__ file.txt
|__ files2
|____ folder1
|______ file7.txt
|__ files
|____ test_file.txt
|____ folder1
|______ file1.txt
|______ file2.txt
|______ file3.txt
|____ folder2
|______ file4.txt
|______ file5.txt
|______ file6.txt
|____ folder3
|______ file8.txt
|____ folder4
|______ file9.txt
|______ file10.txt
|__ a
|____ b
|______ c
|________ d
|__________ e
|____________ f
|______________ g
|________________ test.txt

Code:

{
"name":"",
"type":"folder",
"children": [
    {
    "name":"file.txt",
    "type":"file",
    "offset":0",
    "zsize":123456",
    "size":12345678",
    },
    {
    "name":"files2",
    "type":"folder",
    "children": [
        {
        "name":"folder1",
        "type":"folder",
        "children": [
            {
            "name":"file7.txt",
            "type":"file",
            "offset":0",
            "zsize":123",
            "size":123",
            },
        ]},
    ]},
    {
    "name":"files",
    "type":"folder",
    "children": [
        {
        "name":"test_file.txt",
        "type":"file",
        "offset":0",
        "zsize":123",
        "size":123",
        },
        {
        "name":"folder1",
        "type":"folder",
        "children": [
            {
            "name":"file1.txt",
            "type":"file",
            "offset":0",
            "zsize":123",
            "size":123",
            },
            {
...

Code:

 Directory of 

30-May-18  09:29              files2
30-May-18  09:29              files
30-May-18  09:29              a
30-May-18  09:29    12345678       file.txt

 Directory of files2

30-May-18  09:29              folder1

 Directory of files2/folder1

30-May-18  09:29    123            file7.txt

 Directory of files

30-May-18  09:29              folder1
30-May-18  09:29              folder2
30-May-18  09:29              folder3
30-May-18  09:29              folder4
30-May-18  09:29    123            test_file.txt

 Directory of files/folder1

30-May-18  09:29    123            file1.txt
30-May-18  09:29    123            file2.txt
30-May-18  09:29    123            file3.txt

 Directory of files/folder2

30-May-18  09:29    123            file4.txt
30-May-18  09:29    123            file5.txt
30-May-18  09:29    123            file6.txt

 Directory of files/folder3

30-May-18  09:29    123            file8.txt

 Directory of files/folder4

30-May-18  09:29    123            file9.txt
30-May-18  09:29    123            file10.txt

 Directory of a

30-May-18  09:29              b

 Directory of a/b

30-May-18  09:29              c

 Directory of a/b/c

30-May-18  09:29              d

 Directory of a/b/c/d

30-May-18  09:29              e

 Directory of a/b/c/d/e

30-May-18  09:29              f

 Directory of a/b/c/d/e/f

30-May-18  09:29              g

 Directory of a/b/c/d/e/f/g

30-May-18  09:29    123            test.txt

Code:

Index of /

Icon  Name                                                             Last modified              Size  Description
[PARENTDIR] Parent Directory
[DIR] files2/                                                          30-May-18  09:29              -  files2
[DIR] files/                                                           30-May-18  09:29              -  files
[DIR] a/                                                               30-May-18  09:29              -  a
[txt] file.txt                                                         30-May-18  09:29       12345678  file.txt

Index of /files2

Icon  Name                                                             Last modified              Size  Description
[PARENTDIR] Parent Directory
[DIR] folder1/                                                         30-May-18  09:29              -  files2/folder1

Index of /files2/folder1

Icon  Name                                                             Last modified              Size  Description
[PARENTDIR] Parent Directory
[txt] file7.txt                                                        30-May-18  09:29            123  files2/folder1/file7.txt

Index of /files

Icon  Name                                                             Last modified              Size  Description
[PARENTDIR] Parent Directory
[DIR] folder1/                                                         30-May-18  09:29              -  files/folder1
[DIR] folder2/                                                         30-May-18  09:29              -  files/folder2
[DIR] folder3/                                                         30-May-18  09:29              -  files/folder3
[DIR] folder4/                                                         30-May-18  09:29              -  files/folder4
[txt] test_file.txt                                                    30-May-18  09:29            123  files/test_file.txt

These outputs have been generated from the following files information:

Code:

"file.txt",                 0, 123456, 12345678
"files/folder1/file1.txt",  0, 123, 123
"files/folder1/file2.txt",  0, 123, 123
"files/folder1/file3.txt",  0, 123, 123
"files/folder2/file4.txt",  0, 123, 123
"files/folder2/file5.txt",  0, 123, 123
"files/folder2/file6.txt",  0, 123, 123
"files2/folder1/file7.txt", 0, 123, 123
"files/folder3/file8.txt",  0, 123, 123
"files/folder4/file9.txt",  0, 123, 123
"files/folder4/file10.txt", 0, 123, 123
"files/test_file.txt",      0, 123, 123
"a/b/c/d/e/f/g/test.txt",   0, 123, 123

Currently this feature is totally useless, it's one of the many unknown features that are available (or are going to be available) in quickbms and even I don't remember them

P.S.: yes the json output needs some small fixes, this was just a quick test.

AnonBaiter, posted Wed May 30, 2018 12:40 pm (35402)

---

so i did this to my script

Code:

get unix_timestamp time

and i want to implement this "timecode" into the extracted files

perhaps it would be better if quickbms had this kind of feature in which "log"/"clog" gets a "timecode" argument, such as if the "unix_timestamp" variable has this 32bit time value then said argument would need at least that variable so it can implement a "timecode" into the extracted file
if the "timecode" argument has nothing else to stick into then it'll be just assigned as "" or something

aluigi, posted Wed May 30, 2018 1:21 pm (35404)

---

It's something that is rare and not useful in my opinion.
Additionally there are tons of factors that would make it a hell to use and creating a simple "syntax": creation, modification or access time or all or a combo? unix 32bit time (from what year? many implemenations), 64bit Windows FILETIME, floating point timestamps, other variants of timestamps...

I try to avoid to add new commands for keeping the language as simple as possible.

AnonBaiter, posted Wed May 30, 2018 1:21 pm (35405)

---

oh okay then

michalss, posted Sun Jun 03, 2018 6:28 am (35534)

---

Hi Luigi,

Is this dll done pls i did not find it in release notes this change..

thx

aluigi, posted Sun Jun 03, 2018 12:18 pm (35539)

---

I already said that it will be part of quickbms 0.8.5 which is not available yet.

michalss, posted Sun Jun 03, 2018 2:02 pm (35546)

---

aluigi wrote:

I already said that it will be part of quickbms 0.8.5 which is not available yet.

ok but u said it will be done before end of last month, not a problem, was not sure..

aluigi, posted Sun Jun 03, 2018 6:02 pm (35552)

---

Right, I have continued to fix and implement new stuff so I decided to postpone the new release.
I guess it's better if I will release it in less than 2 weeks, just the time for checking if everything works correctly and no bugs have been introduced

aluigi, posted Fri Jun 08, 2018 10:32 pm (35739)

---

This is a feature of the upcoming quickbms:

Code:

get BACKUP_NAME filename
savepos BACKUP_OFF
open "." TEMPORARY_FILE
... do your stuff ...
open FDSE2 BACKUP_NAME
goto BACKUP_OFF

Code:

open "." TEMPORARY_FILE 1
open 1
... do your stuff ...
open 0

These 2 scripts do the exact same thing in two different ways:

• saving the current offset, closing the file, open the new one, reopen the original file (FDSE2 is new), restore the offset
• redirect all the operations of the current file to another one (file 1 in the example, it can work with MEMORY_FILEs too)

It's a feature that is useless in 99.9% of the scripts, but extremely useful when needed and it's also a good alternative (double alternative) to using a FILENUM variable for every instruction.

In case you are asking what is FDSE2, well it's the forced original input folder which is opposed to FDSE that is the folder of the current file, so if you open (for example) the TEMPORARY_FILE you will not be able to open files in the original folder, with FDSE2 you can.

Dima Bilan, posted Sat Jun 09, 2018 4:55 pm (35745)

---

And you can add a function so that when you reimport files, it skips all files that are larger than the original size at a time so that you do not press a button y every time. I know that the files should be smaller than the original size, but still I ask to add it. I would also like to trim a file if it is larger than the original size, but I think you do will not want to add this function.