These are chat archives for arenanet/api-cdi

19th
Jul 2017
Archomeda
@Archomeda
Jul 19 2017 07:54

okay apparently my gw2 decompression code is broken somehow... spent a few hours trying to figure out what's wrong, and it seems that constructing a huffman tree is failing at a specific spot of a compressed file, but i can't figure out why (also, i'm slowly starting to understand this code again); does anyone have a working decompression algorithm at hand by any chance that i can compare to? :P

i need a break...

this code is heavily based on the code of gw2browser, although with a few modifications; but this also means that that code has the same annoying issue :/
BoyC
@BoyC
Jul 19 2017 11:08
that decompression code should have a taxonomy of its own at this point :)
Edgar Doiron
@Coffee4cr
Jul 19 2017 15:01
you know when your working with a business that only cares about saving money
so the easiest/cheapest solution is always the one taken
Recently we've put a patch on our system that upped the security of password, requiring letters (including capital) and numbers and symbols... at least one of each
and we had a subsytem that was massively generating password for massive person creation. and it kept failing since the patch was applied, cause it couldn't generate a valid password (it was only doing small letters and numbers)
the solution?
l_password := l_password || 'R*';
:thumbsup:
:laughing:
instead of fixing the generator
BoyC
@BoyC
Jul 19 2017 15:11
i wish we could get official word on directx proxy dll overlays being ok or not
Edgar Doiron
@Coffee4cr
Jul 19 2017 15:12
isn't that what those dps meters do? and also reshade and gemfx and all those graphic injectors?
Archomeda
@Archomeda
Jul 19 2017 15:12
@BoyC is the gw.dat compression the same as the gw2.dat?
that you know of?
BoyC
@BoyC
Jul 19 2017 15:13
as far as i know all the decompression algorithms out there are based on my old gw.dat decompressor yeah
Archomeda
@Archomeda
Jul 19 2017 15:14
since you mentioned that your decompressor was still linked from the gw1 wiki... but it's 404'ing :D
do you still have the source for that?
BoyC
@BoyC
Jul 19 2017 15:14
yeah my old site has been down for years :D
no idea i'd have to check, i'm still at work
Archomeda
@Archomeda
Jul 19 2017 15:14
alright
BoyC
@BoyC
Jul 19 2017 15:14
but that code was a mess
Archomeda
@Archomeda
Jul 19 2017 15:14
gw2browser's code is a mess too
and i somehow understood it
BoyC
@BoyC
Jul 19 2017 15:15
well that old code had variable names like eax ebx ecx for a reason ;)
Archomeda
@Archomeda
Jul 19 2017 15:15
oh rip
BoyC
@BoyC
Jul 19 2017 15:16
people cleaned it up and figured it out from what little i saw on the xentax forums
i remember when i was doing that decompressor and i first found the songs from the game and started decompressing them
Archomeda
@Archomeda
Jul 19 2017 15:17
i suppose it's where gw2browser is derived from
BoyC
@BoyC
Jul 19 2017 15:17
it was awesome, but they had these glitches in them
i was looking for the bug for 2 days when i realized that i fopened a text file and for all the \n-s i was writing out it also put a \r in there :D
Archomeda
@Archomeda
Jul 19 2017 15:17
like, it's working for 99% of the files, but somehow there's at least that one file i stumbled upon that it somehow can't read a huffman tree properly from
lol
BoyC
@BoyC
Jul 19 2017 15:18
i never really had a look at the gw2 decompressor
so i'm not sure if it's the same or not
and at any rate it's been 10 years at least :)
Archomeda
@Archomeda
Jul 19 2017 15:19
maybe i can at least figure something out
argh, i probably need to compare the algorithm by hand
windwarrior
@windwarrior
Jul 19 2017 15:23
what does GW2 gain with this huge single dat file approach
why do they need to put a filesystem in a filesystem
Archomeda
@Archomeda
Jul 19 2017 15:24
well... otherwise there's a lot of small files
windows's filesystem is trash for many small files
windwarrior
@windwarrior
Jul 19 2017 15:24
yeah files are 4k by default
arent they?
BoyC
@BoyC
Jul 19 2017 15:25
it was 512 byte chunks in gw1 if i recall
Archomeda
@Archomeda
Jul 19 2017 15:25
also, for that one file you also need one file handle
instead of many
windwarrior
@windwarrior
Jul 19 2017 15:25
yeah but you do too for this dat file, that also has a file table
BoyC
@BoyC
Jul 19 2017 15:25
it's a good way of tracking updates and making sure the data hasn't been tampered with
windwarrior
@windwarrior
Jul 19 2017 15:26
well but a hash of my .dat is probably not equal to yours
BoyC
@BoyC
Jul 19 2017 15:27
that's the point
it's a file system
windwarrior
@windwarrior
Jul 19 2017 15:29
yeah right, its a more specific filesystem than the one windows can provide, sure. But having files in folders should be just as viable and allows you to not worry about writing your own filesystem. I dont know it feels like a lot of work for marginal gain
BoyC
@BoyC
Jul 19 2017 15:31
you wouldn't want to have 360k files in a folder structure for a game
it'd cause performance problems when downloading the game, when patching and when uninstalling
Archomeda
@Archomeda
Jul 19 2017 15:33
the chinese client doesn't have one big dat file btw
it's split up in chunks :P
BoyC
@BoyC
Jul 19 2017 15:34
interesting
BoyC
@BoyC
Jul 19 2017 15:39
damn the more i think about the d3d proxy overlay solution the better it'd be... taco could run in full screen, it could render markers into the actual game world (hidden by objects, affected by post-processes, drawn behind the ui), and i could make all the keyboard handling issues go away as well
@lye is there any way we could get official confirmation if it's ok to create an API compliant overlay in a directx proxy dll format? It's done by sweetfx, and overwolf does something like this as well, so do some of the dps counters, it'd just be nice to have official word on this.
smiley
@codemasher
Jul 19 2017 16:10
uhh, i think we had that before and stuff like that was ok afaik (i could be totally wrong...)
BoyC
@BoyC
Jul 19 2017 16:20
it's tolerated as a practice but i've not seen an explicit approval
smiley
@codemasher
Jul 19 2017 16:29
that's basically the canon - you won't get an official approval
but we had that case in this chat before - you might try searching

is there any way we could get official confirmation if it's ok to create an API compliant overlay in a directx proxy dll format?

@BoyC probably not :<

windwarrior
@windwarrior
Jul 19 2017 17:02
officially confirming is just a can of worms I guess
smiley
@codemasher
Jul 19 2017 17:10
image.png
fun fact: the weather in my hometown is different than in the rest of the country
BoyC
@BoyC
Jul 19 2017 17:11
@lye was worth a try to ask ;)
Eearslya Sleiarion
@Eearslya
Jul 19 2017 17:52
Wait, probably not allowed? Or probably not getting confirmation either way?
probably not getting confirmation either way
Edgar Doiron
@Coffee4cr
Jul 19 2017 17:52
so do it @BoyC
:)
It's not illegal if you don't get caught
windwarrior
@windwarrior
Jul 19 2017 17:54
thats not how illegal works
driving 200km/h in a city is very illegal, even if you dont get caught
smiley
@codemasher
Jul 19 2017 17:58
having hi-res digital imaging devices is a curse.
the amount of data produced is insane... i might get me an amazon dash button for new HDDs
Werdes
@werdes
Jul 19 2017 18:24
@smiley /r/datahoarder is your friend. think a 40tb nas is large? time to come across someone who backed up 400tb of stuff asking for advice on how to move away from external hdds
BoyC
@BoyC
Jul 19 2017 18:25
@Coffee4cr yeah I'm thinking about it, it's just I need to backport my ui engine to dx9 to do it and it's a lot of work
If this ever happens I'll have 2 versions, the safe one and the "use at own risk for better integration" one :)
smiley
@codemasher
Jul 19 2017 18:29
@werdes i read about a 50TB SSD yesterday... - (btw. my tag is @codemasher)
wonder what such a thing would cost
smiley
@codemasher
Jul 19 2017 18:51
ahrg, now that i made some space on my storage disk, steam attempts to download a 35GB update for DOOM
Archomeda
@Archomeda
Jul 19 2017 19:12
steam is kind of annoying that it copies the whole game to a temporary folder, downloads the update, applies it and moves everything back again
at least, that's how i think it works
smiley
@codemasher
Jul 19 2017 19:14
yea, most likely - steam is so old, streamed downloads weren't invented back then :D
ChieftainAlex
@ChieftainAlex
Jul 19 2017 20:08
I spent too long today being impressed by my colleague when he said he had a phd in trepanning... he doesn't even drill skulls.
reactor samples seem boring by comparion >_
Eearslya Sleiarion
@Eearslya
Jul 19 2017 23:01
how dare they copy our /v2/quaggans