Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

Is the expansion of a wildcard in Bash guaranteed to be in alphabetical order? I am forced to split a large file into 10 Mb pieces so that they can be be accepted by my Mercurial repository.

So I was thinking I could use:

split -b 10485760 Big.file BigFilePiece.

and then in place of:

cat BigFile | bigFileProcessor

I could do:

cat BigFilePiece.* | bigFileProcessor

in its place.

However, I could not find anywhere that guaranteed that the expansion of the asterisk (aka wildcard, aka *) would always be in alphabetical order so that .aa came before .ab (as opposed to be timestamp ordering or something like that).

Also, are there any flaws in my plan? How great is the performance cost of cating the file together?

share|improve this question
2  
For sure you are taking the wrong approach. If the admin put a limit for the size of files you have in the repository, then you should talk with him. Talking about expansion - I have always saw that the expansion is alphanumerical. –  Mircea Vutcovici Mar 15 '10 at 19:58
1  
You can always pipe through sort if you need any additional order manipulation. –  Warner Mar 15 '10 at 20:45
2  
Please note that Mercurial can manage files of any size, limited by the amount of RAM you have. You get a warning if you add a big file, since Mercurial assumes that it can hold the file in memory. For merges, Mercurial needs to hold two files in memory. Machines with small amounts of RAM may therefore have trouble checking out the file. I just tested it, and hg commit on a N MB file requires about 3 * N MB of RAM and hg update requires about 2 * N MB of RAM. This is with Mercurial 1.5 on Linux. –  Martin Geisler Mar 16 '10 at 9:16

3 Answers 3

up vote 18 down vote accepted

Yes, globbing expansion is alphabetical.

From the Bash man page:

Pathname Expansion

   After  word  splitting,  unless  the -f option has been set, bash scans
   each word for the characters *, ?, and [.  If one of  these  characters
   appears,  then  the word is regarded as a pattern, and replaced with an
   alphabetically sorted list of file names matching the pattern.
share|improve this answer
    
@Dennis Williamson, Any idea if this would still be true if a user has a different language set? –  Zoredache Mar 15 '10 at 22:35
3  
@Zoredache: It's actually specified by POSIX: opengroup.org/onlinepubs/007908775/xsh/glob.html "The pathnames are in sort order as defined by the current setting of the LC_COLLATE category, see the XBD specification, LC_COLLATE [opengroup.org/onlinepubs/007908775/xbd/…; and it's why you should do things like ls -l [[:lower:]] instead of ls -l [a-z]. –  Dennis Williamson Mar 16 '10 at 0:31
    
Note that the order is alphabetical so BigFilePiece.10 will come before BigFilePiece.2 –  Ken 2 days ago

It is documented behavior for bash so you can depend upon it in your scripts. It also has been true of other Bourne compatible shells for a very long time ... though there may be corner cases regarding case folding or non-alphanumeric characters.

(The resulting list, in bash will be in almost "ASCII-betical" order --- except that lower and upper case letters will be collated together as if there were no case differences but with lower case collated before their upper case equivalents. All non-alphabetics should collate into the same order as they appear in ASCII).

As others have pointed out this could be perturbed by your language related environment settings: LANG generally and LC_COLLATE more specifically. In might be safest to run commands that depend on glob expansion ordering under an env command to clear the environment (using -i or -u as appropriate) or to pipe the results through sort to ensure robust sequencing.

share|improve this answer
    
It appears that all non-alphanumerics are ignored in the sorting process. So "=", "_", "~" cannot be used to force a file to start or end (respectively) the list. –  Otheus Jan 20 '12 at 11:46

While glob expansions are sorted alphabetically, they also obey the shell's langage setting.

Make sure to set this to "C" in your script if you intend this to be portable.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.