Differences between revisions 15 and 27 (spanning 12 versions)
Revision 15 as of 2011-02-04 19:17:46
Size: 2285
Editor: GreyCat
Comment: math context for trimming leading zeroes, etc.
Revision 27 as of 2018-11-29 15:32:42
Size: 3195
Editor: GreyCat
Comment: Fix comments on first example, because they were backwards and misleading. Also reverse the steps because humans expect leading before trailing.
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
Here's one that only works for whitespace. It relies on the fact that `read` strips all leading and trailing whitespace when `IFS` isn't set: For simple variables, you can trim whitespace (or other characters) using this trick:

{{{
# POSIX
junk=${var%%[! ]*} # remove all but leading spaces
var=${var#"$junk"} # remove leading spaces from original string

junk=${var##*[! ]} # remove all but trailing spaces
var=${var%"$junk"} # remove trailing spaces from original string
}}}

Bash can do the same thing, but without the need for a throw-away variable, by using [[glob|extglob]]'s more advanced pattern matching:

{{{
   # Bash
   shopt -s extglob
   var=${var##*( )} # trim the left
   var=${var%%*( )} # trim the right
}}}
Here's one that only works for whitespace. It relies on the fact that `read` strips all leading and trailing whitespace (tab or space character) when `IFS` isn't set:
Line 12: Line 32:
Bash can do something similar with a "here string":
Line 13: Line 34:
Bash can do something similar with a "here string":
Line 18: Line 38:
Using an empty string as a delimiter means the read consumes the whole string, as NUL is used. (Remember: BASH only does C-string variables.) This is entirely safe for any text, including newlines. Using an empty string as a delimiter means the read consumes the whole string, as NUL is used. (Remember: BASH only does C-string variables.) This is entirely safe for any text, including newlines (which will also be stripped from the beginning and end of the variable with the default value of IFS).
Line 21: Line 41:
Line 25: Line 46:
   shopt -u extglob
Line 27: Line 47:
(where `[[:space:]]` includes space, tab and all other horizontal and vertical spacing characters, the list of which varies with the current [[locale]]).
Line 29: Line 50:
Line 33: Line 55:
This solution isn't restricted to whitespace like the first few were. You can remove leading zeroes as well:
Line 34: Line 57:
This solution isn't restricted to whitespace like the first few were. You can remove leading zeroes as well:
Line 40: Line 62:
Another way to remove leading zeroes from a number in bash is to treat it as a decimal integer, in a [[ArithmeticExpression|math context]]:
Line 41: Line 64:
Another way to remove leading zeroes from a number in bash is to treat it as an integer, in a [[ArithmeticExpression|math context]]:
Line 45: Line 67:
   # However, this fails if x contains anything other than digits.    # However, this fails if x contains anything other than decimal digits.
Line 47: Line 69:
If you need to remove leading zeroes in a POSIX shell, you can use a loop:
Line 48: Line 71:
If you need to remove leading zeroes in a POSIX shell, you can use a loop:
Line 58: Line 80:
Or this trick (covered in more detail in [[BashFAQ/100|FAQ #100]]):
Line 59: Line 82:
Or this trick (covered in more detail in [[BashFAQ/100|FAQ #100]]):
Line 63: Line 85:
   var=${var#$zeroes}    var=${var#"$zeroes"}
Line 65: Line 87:
There are many, many other ways to do this, using sed for instance:
Line 66: Line 89:
There are many, many other ways to do this, using sed for instance:
Line 69: Line 91:
   x=$(echo "$x" | sed -e 's/^[[:space:]]*//' -e 's/[[:space:]]*$//')    x=$(printf '%s\n' "$x" | sed -e 's/^[[:space:]]*//' -e 's/[[:space:]]*$//')

How can I trim leading/trailing white space from one of my variables?

There are a few ways to do this. Some involve special tricks that only work with whitespace. Others are more general, and can be used to strip leading zeroes, etc.

For simple variables, you can trim whitespace (or other characters) using this trick:

# POSIX
junk=${var%%[! ]*}   # remove all but leading spaces
var=${var#"$junk"}   # remove leading spaces from original string

junk=${var##*[! ]}   # remove all but trailing spaces
var=${var%"$junk"}   # remove trailing spaces from original string

Bash can do the same thing, but without the need for a throw-away variable, by using extglob's more advanced pattern matching:

   # Bash
   shopt -s extglob
   var=${var##*( )}   # trim the left
   var=${var%%*( )}   # trim the right

Here's one that only works for whitespace. It relies on the fact that read strips all leading and trailing whitespace (tab or space character) when IFS isn't set:

   # POSIX, but fails if the variable contains newlines
   read -r var << EOF
   $var
   EOF

Bash can do something similar with a "here string":

   # Bash
   read  -rd '' x <<< "$x"

Using an empty string as a delimiter means the read consumes the whole string, as NUL is used. (Remember: BASH only does C-string variables.) This is entirely safe for any text, including newlines (which will also be stripped from the beginning and end of the variable with the default value of IFS).

Here's a solution using extglob together with parameter expansion:

   # Bash
   shopt -s extglob
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}

(where [[:space:]] includes space, tab and all other horizontal and vertical spacing characters, the list of which varies with the current locale).

This also works in KornShell, without needing the explicit extglob setting:

   # ksh
   x=${x##+([[:space:]])} x=${x%%+([[:space:]])}

This solution isn't restricted to whitespace like the first few were. You can remove leading zeroes as well:

   # Bash
   shopt -s extglob
   x=${x##+(0)}

Another way to remove leading zeroes from a number in bash is to treat it as a decimal integer, in a math context:

   # Bash
   x=$((10#$x))
   # However, this fails if x contains anything other than decimal digits.

If you need to remove leading zeroes in a POSIX shell, you can use a loop:

   # POSIX
   while true; do
     case "$var" in
       0*) var=${var#0};;
       *)  break;;
     esac
   done

Or this trick (covered in more detail in FAQ #100):

   # POSIX
   zeroes=${var%%[!0]*}
   var=${var#"$zeroes"}

There are many, many other ways to do this, using sed for instance:

   # POSIX, suppress the trailing and leading whitespace on every line
   x=$(printf '%s\n' "$x" | sed -e 's/^[[:space:]]*//' -e 's/[[:space:]]*$//')

Solutions based on external programs like sed are better suited to trimming large files, rather than shell variables.

BashFAQ/067 (last edited 2018-11-29 15:32:42 by GreyCat)