Filename extensions changed ??
-
However 115 path/filename may be - in the thread you linked to
Okay, but that was dated 11-07-2005, surely PA has been improved since then ?
Also, the total of 115 I gave included the full pathname/filename source, but if I deduct the path length from were the source files are, it is 12 less, so total 103. That is, the total pathname/filename in the actual archive is 103 chars. This relates to an archive that PA created, where the filename extension is corrupt.
Also …. from the other thread
how do you mean strange abbrevations? Keep in mind that windows file system limit is 256 characters, everything above that will simply not get extracted properly and probably create small havoc in Windows (wont be deletable by Windows Explorer).
Yet I just totalled up the path/filename that PA had extracted from a tar.gz and where the filename extension is ‘corrupt’ and the total length us 140 bytes, way less than 256.
-
There are two seperate/different limits being discussed…
When PA creates the TAR file (compression) the 110 char limit is for the complete path/filename length (so you cannot subtract filename to get below 110.
When PA extracts from a TAR archive (created by another application) it should only be limited by OS - this is the 256 limit.
So the compression name length limit may explain the problem you recreated - when creating the TAR using the two sample files.
However, it does NOT explain the problem you encounter when extracting the other file (created by Cpanel ?) - this is now a seperate problem.
Unfortunately, we “know” this was fixed in PA 9.5; but maybe further changes re-introduced the extraction problem :confused:
We will have to wait for spwolf or Ivan to confirm I’m afraid.
-
Hi,
can you attach example file? Just make it as small as possible.
thank you!
-
Having tried a few different things, decided to set the config. to ‘default’.
Tried the compression again, and the filename extensions are okay, but the pathname is not correct for uploading to the website.
I always need to have the option “use normal relative path” checked, to make the pathname ‘valid’ for uploading.
So, is this a ‘clue’ to the problem ?
Under PA settings:
-Config
–-misc
------use normal relative path-
When checked, file extensions are messed up
-
When unchecked they are okay, but the pathname is not ‘suitable’.
I can re-arrange folders locally so that the correct pathname is included as the first one (highest), …BUT I think the only way I can get ‘empty paths’ into an archive is to have this option set on (checked). :(
This is only a small test, with those 2 files, but they are part of a substantial (path) heirarchy.
Just tested a considerable number of files (3250) with the option “use normal relative path” unchecked, and all the filename extensions are okay. Now I can see the full pathname/filename for one of these is 91 chars. If I include the “full” source pathname/filename, it is 149 chars.
Have now used the same files to create an archive, with the option “use normal relative path” checked, and the filename extensions are messed up. Even with the additional pathname added, it is still only 103 chars
So, could that option be the cause of the ‘bug’ ??
-
-
There are two seperate/different limits being discussed…
When PA creates the TAR file (compression) the 110 char limit is for the complete path/filename length (so you cannot subtract filename to get below 110.
Depends if the limit includes the “full” path/filename ‘source’ or not.
When ‘adding’ a path to an archive, is the path/s above that path, included in the limit ??
When PA extracts from a TAR archive (created by another application) it should only be limited by OS - this is the 256 limit.
Again, does the 256 limit only include the pathname shown in the archive, or the “full” pathname to where the destination files are uncompressed/extracted ??
Neither of these “limits” are clear.
However, it does NOT explain the problem you encounter when extracting the other file (created by Cpanel ?) - this is now a seperate problem.
I don’t see that as a seperate problem. The file created by Cpanel ‘backup’ checked out 100% okay on the Linux machine, using 'Tar" command. It also checked out okay using “7-Zip” on Win XP pro, BUT PA failed to read many of the filename extensions correctly.
That is exactly the same problem as PA being unable to create correct filenames.
In both cases, the problem only occurs in PA. :D
-
can you attach example file? Just make it as small as possible.
I can already see from Archive files that the information contained in the archive would compromise our website security.
It’s a bit like someone asking me for the keys to my house; I’m sure you understand. :)
I could send you (privately) these 2 files, and supply the directory structure I have here. If that was setup on a Win xp pro box, with the same version of PA, all things being equal (and config settings the same), the ‘problem’ should be able to be replicated.
-
can you attach example file?
I have sent a PM, with all the details needed to create the 2 files, plus replicate the same local directory structure I have.
-
My understanding of the limits are:-
@peterr:Depends if the limit includes the “full” path/filename ‘source’ or not.
When ‘adding’ a path to an archive, is the path/s above that path, included in the limit ??
When compressing, the limit is the information to be stored in the archive (creating the TAR file).
@peterr:Again, does the 256 limit only include the pathname shown in the archive, or the “full” pathname to where the destination files are uncompressed/extracted ??
It is an OS limit so must include “everything” - not just the archive contents.
@peterr:I don’t see that as a seperate problem. The file created by Cpanel ‘backup’ checked out 100% okay on the Linux machine, using 'Tar" command. It also checked out okay using “7-Zip” on Win XP pro, BUT PA failed to read many of the filename extensions correctly.
I wasn’t suggesting that the archive was in any way corrupt, but that the decompression by PA is incorrect.
@peterr:That is exactly the same problem as PA being unable to create correct filenames.
In both cases, the problem only occurs in PA. :D
No, I believe the "problems are different because of the different limits when compressing and decompressing.
If the 110 limit is still present in the TAR engine - then when exceeding the 110 limit, PA creates an incorrect archive. So the problem appears after decompressing but is “inherent” in the archive - would also appear with other decompressing utilities.
With a correct archive (from another application), the decompression problem has a different cause in PA - even if the result is the same in both cases. It is this case that may need an example archive!!
Still, I’m confident Ivan will be able to “sort it out” :D
-
If the 110 limit is still present in the TAR engine - then when exceeding the 110 limit, PA creates an incorrect archive. So the problem appears after decompressing but is “inherent” in the archive - would also appear with other decompressing utilities.
Not too sure what you are saying here, but I think you mean if PA was used to compress the tar.gz, and incorrect file extensions are in that archive, then other decompression utilities would also show the (incorrect) file extension.
Yes, of course.
Found some info on path lengths at Naming a File …
In the Windows API, the maximum length for a path is MAX_PATH, which is defined as 260 characters. A path is structured in the following order: drive letter, colon, backslash, components separated by backslashes, and a null-terminating character, for example, the maximum path on the D drive is D:<256 chars>NUL.
I can only get to 247 as the max, after that an error message.
Just why there is a 110 limit I don’t know though, if it was a Win API limitation, then other archiving tools (e.g. “7-Zip”) would demonstrate the same problem I’m experiencing. However 7-Zip compresses the same folder without the incorrect filename extensions.
-
Just used “PeaZip” to create a tar.gz, using the same path/folder to add, the filename extensions are valid.
Also, just tried PACL, and it created the archive correctly.
-
I have sent a PM, with all the details needed to create the 2 files, plus replicate the same local directory structure I have.
thanks - we will check it out and see if we have any questions.
We didnt mean for you to send confidential data, you could have re-created same filename in same folder and that should have created same error… this will work too.
thank you!
-
thanks - we will check it out and see if we have any questions.
Okay thanks. I guess seeing the command line versions of PA work, I could use ‘pacomp’ and ‘paext’ in the interim period.
Thanks. :)
-
Something else that PA is doing with archives I created, with the extension .tar.gz
It makes additional paths in the archive, the paths are not on my local system at all, the archive has all these additional paths , named with a backslash ??
There were 15 additional paths, in the last archive I created, unfortunately I didn’t see the ‘garbage’ until the archive was used to load part of a website.
Of course when viewing an archive in ‘flat’ mode, only files are shown, so no pathnames appear. When viewing in Explorer mode, with the ‘2 window’ view, I could then see the additional paths.
There were 1635 files and 172 folders in the path that was archived locally. However the archive added 1635 files, and 187 folders/paths, the extra 15 wouldn’t even display properly when viewing the archive, but they sure made a nice mess of the website. :(
-
OK, just done a quick test.
3 files with 100, 110 and 115 chars in filename.
Each has “txt” extension (so length is 104, 114 and 119). Files are in sub-Folder with 16 char name.Create Tar with PA (no paths stored) - corruption occurs with all three filenames !!
Create Tar with 7-Zip (relative path stored)- PA displays and extracts this correctly (including pathname).
Note: no Gzip compression - this is simply TAR.
-
Thanks for doing that test. I also found if I used ZIP compression, the archive was okay.
-
Yes, the problem is with TAR compression.
Further tests show that even 100 chars corrupt.
The maximum length that TARs OK in PA 10 seems to be 99 chars (not 110 as suggested by other thread). -
The 99 max seems to indicate a V7 version of TAR, from a few search results here
-
With you guys doing all the work, there is nothing else for us to do…
;-)
-
With you guys doing all the work, there is nothing else for us to do…
:D
It seems the length limitations is the version of tar that PA must be using. Any chance of going to another version of the code that uses tar files ?? ;)
-
With you guys doing all the work, there is nothing else for us to do…
;-)
Except, analyse why the decompression/extraction failed from the Cpanel backup - that bit has me :confused:
