Differences between revisions 14 and 17 (spanning 3 versions)
Revision 14 as of 2009-11-04 15:22:51
Size: 1986
Editor: GreyCat
Comment: add non-loop POSIX trick
Revision 17 as of 2013-08-23 15:09:01
Size: 2828
Editor: ghoti
Comment: add a clearer whitespace option in POSIX and Bash, at the top of the page.
Deletions are marked like this. Additions are marked like this.
Line 4: Line 4:

For simple variables, you can trim whitespace (or other characters) using this trick:
{{{
   # POSIX
   junk="${var##*[! ]}" # match prefixed spaces
   var="${var%%$junk}" # trim the match
   junk="${var%%[! ]*}" # match affixed spaces
   var="${var##$junk}" # trim the match
}}}

Bash can do the same thing, but without the need for a throw-away variable, by using [[glob|extglob]]'s more advanced pattern matching:
{{{
   # Bash
   shopt -s extglob
   var="${var##*( )}" # trim the left
   var="${var%%*( )}" # trim the right
}}}
Line 25: Line 42:
   shopt -u extglob
Line 27: Line 43:

This also works in KornShell, without needing the explicit `extglob` setting:
{{{
   # ksh
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}
}}}
Line 34: Line 57:
This also works in KornShell, without needing the explicit `extglob` setting: Another way to remove leading zeroes from a number in bash is to treat it as an integer, in a [[ArithmeticExpression|math context]]:
Line 36: Line 59:
   # ksh
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}
   # Bash
   x=$((10#$x))
   # However, this fails if x contains anything other than digits.
Line 51: Line 75:
Or this trick: Or this trick (covered in more detail in [[BashFAQ/100|FAQ #100]]):
Line 63: Line 87:
Solutions based on external programs like sed are well suited to trimming large files, rather than shell variables. Solutions based on external programs like sed are better suited to trimming large files, rather than shell variables.

How can I trim leading/trailing white space from one of my variables?

There are a few ways to do this. Some involve special tricks that only work with whitespace. Others are more general, and can be used to strip leading zeroes, etc.

For simple variables, you can trim whitespace (or other characters) using this trick:

   # POSIX
   junk="${var##*[! ]}"   # match prefixed spaces
   var="${var%%$junk}"    # trim the match
   junk="${var%%[! ]*}"   # match affixed spaces
   var="${var##$junk}"    # trim the match

Bash can do the same thing, but without the need for a throw-away variable, by using extglob's more advanced pattern matching:

   # Bash
   shopt -s extglob
   var="${var##*( )}"   # trim the left
   var="${var%%*( )}"   # trim the right

Here's one that only works for whitespace. It relies on the fact that read strips all leading and trailing whitespace when IFS isn't set:

   # POSIX, but fails if the variable contains newlines
   read -r var << EOF
   $var
   EOF

Bash can do something similar with a "here string":

   # Bash
   read  -rd '' x <<< "$x"

Using an empty string as a delimiter means the read consumes the whole string, as NUL is used. (Remember: BASH only does C-string variables.) This is entirely safe for any text, including newlines.

Here's a solution using extglob together with parameter expansion:

   # Bash
   shopt -s extglob
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}

This also works in KornShell, without needing the explicit extglob setting:

   # ksh
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}

This solution isn't restricted to whitespace like the first few were. You can remove leading zeroes as well:

   # Bash
   shopt -s extglob
   x=${x##+(0)}

Another way to remove leading zeroes from a number in bash is to treat it as an integer, in a math context:

   # Bash
   x=$((10#$x))
   # However, this fails if x contains anything other than digits.

If you need to remove leading zeroes in a POSIX shell, you can use a loop:

   # POSIX
   while true; do
     case "$var" in
       0*) var=${var#0};;
       *)  break;;
     esac
   done

Or this trick (covered in more detail in FAQ #100):

   # POSIX
   zeroes=${var%%[!0]*}
   var=${var#$zeroes}

There are many, many other ways to do this, using sed for instance:

   # POSIX, suppress the trailing and leading whitespace on every line
   x=$(echo "$x" | sed -e 's/^[[:space:]]*//' -e 's/[[:space:]]*$//')

Solutions based on external programs like sed are better suited to trimming large files, rather than shell variables.

BashFAQ/067 (last edited 2018-11-29 15:32:42 by GreyCat)