Differences between revisions 1 and 15 (spanning 14 versions)
Revision 1 as of 2007-05-02 23:20:44
Size: 673
Editor: redondos
Comment:
Revision 15 as of 2018-07-26 21:28:38
Size: 2797
Editor: GreyCat
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
[[Anchor(faq32)]] <<Anchor(faq32)>>
Line 3: Line 3:
The reason that 'time' needs special care for redirecting its output is one of those mysteries of the universe. The answer will probably be solved around the same time we find dark matter. Bash's {{{time}}} keyword uses special trickery, so that you can do things like
Line 5: Line 5:
 * File Redirection
Line 7: Line 6:
     bash -c "time ls" > /path/to/foo 2>&1
     ( time ls ) > /path/to/foo 2>&1
     { time ls; } > /path/to/foo 2>&1
time find ... | xargs ...
}}}
and get the execution time of the entire pipeline, rather than just the simple command at the start of the pipe. (This is different from the behavior of the external command {{{time(1)}}}, for obvious reasons.)

Because of this, people who want to redirect {{{time}}}'s output often encounter difficulty figuring out where all the file descriptors are going. It's not as hard as most people think, though -- the trick is to call {{{time}}} in a SubShell or block, and then capture stderr of the subshell or block (which will contain {{{time}}}'s results). If you need to redirect the actual command's stdout or stderr, you do that inside the subshell/block. For example:

 * File redirection:
 {{{
bash -c "time ls" 2>time.output # Explicit, but inefficient.
( time ls ) 2>time.output # Slightly more efficient.
{ time ls; } 2>time.output # Most efficient.

# The general case:
{ time some command >stdout 2>stderr; } 2>time.output
Line 12: Line 22:
 * Variable Redirection
{{{
     foo=$( bash -c "time ls" 2>&1 )
     foo=$( ( time ls ) 2>&1 )
     foo=$( { time ls; } 2>&1 )
 * CommandSubstitution:
 {{{
foo=$( bash -c "time ls" 2>&1 ) # Captures *everything*.
foo=$( { time ls; } 2>&1 ) # More efficient version.

# Keep stdout unmolested.
# The shell's original FD 1 is saved in FD 3, which is inherited by the subshell.
# Inside the innermost block, we send the time command's stdout to FD 3.
exec 3>&1
foo=$( { time bar 1>&3; } 2>&1 ) # Captures stderr and time.
exec 3>&-

# Keep both stdout and stderr unmolested.
exec 3>&1 4>&2
foo=$( { time bar 1>&3 2>&4; } 2>&1 ) # Captures time only.
exec 3>&- 4>&-

# same thing without exec
{ foo=$( { time bar 1>&3- 2>&4-; } 2>&1 ); } 3>&1 4>&2
}}}
 See FileDescriptor for full explanations of the redirection juggling.

 * Pipe:
 {{{
# Make time only output elapsed time in seconds
TIMEFORMAT=%R
# Keep stdout and stderr unmolested
exec 3>&1 4>&2
{ time foo 1>&3 2>&4; } 2>&1 | awk '{
    printf "The task took %d hours, %d minutes and %.3f seconds\n",
           $1/3600, $1%3600/60, $1%60
}'
exec 3>&- 4>&-
Line 19: Line 57:
Note: Using 'bash -c' and ( ) creates a subshell, using { } does not. Do with that as you wish. A similar construct can be used to capture "core dump" messages, which are actually printed by the shell that launched a program, not by the program that just dumped core:

{{{
./coredump >log 2>&1 # Fails to capture the message
{ ./coredump; } >log 2>&1 # Captures the message
}}}

The same applies to job control messages:

{{{
$ { sleep 1 & } >log 2>&1
$ cat log
[1] 10316
[1]+ Done sleep 1
}}}

Of course you may opt to redirect to `/dev/null` instead of a file.

----
CategoryShell CategoryExampleCode

How can I redirect the output of 'time' to a variable or file?

Bash's time keyword uses special trickery, so that you can do things like

time find ... | xargs ...

and get the execution time of the entire pipeline, rather than just the simple command at the start of the pipe. (This is different from the behavior of the external command time(1), for obvious reasons.)

Because of this, people who want to redirect time's output often encounter difficulty figuring out where all the file descriptors are going. It's not as hard as most people think, though -- the trick is to call time in a SubShell or block, and then capture stderr of the subshell or block (which will contain time's results). If you need to redirect the actual command's stdout or stderr, you do that inside the subshell/block. For example:

  • File redirection:
    bash -c "time ls" 2>time.output      # Explicit, but inefficient.
    ( time ls ) 2>time.output            # Slightly more efficient.
    { time ls; } 2>time.output           # Most efficient.
    
    # The general case:
    { time some command >stdout 2>stderr; } 2>time.output
  • CommandSubstitution:

    foo=$( bash -c "time ls" 2>&1 )       # Captures *everything*.
    foo=$( { time ls; } 2>&1 )            # More efficient version.
    
    # Keep stdout unmolested.
    # The shell's original FD 1 is saved in FD 3, which is inherited by the subshell.
    # Inside the innermost block, we send the time command's stdout to FD 3.
    exec 3>&1
    foo=$( { time bar 1>&3; } 2>&1 )      # Captures stderr and time.
    exec 3>&-
    
    # Keep both stdout and stderr unmolested.
    exec 3>&1 4>&2
    foo=$( { time bar 1>&3 2>&4; } 2>&1 )  # Captures time only.
    exec 3>&- 4>&-
    
    # same thing without exec
    { foo=$( { time bar 1>&3- 2>&4-; } 2>&1 ); } 3>&1 4>&2

    See FileDescriptor for full explanations of the redirection juggling.

  • Pipe:
    # Make time only output elapsed time in seconds
    TIMEFORMAT=%R
    # Keep stdout and stderr unmolested
    exec 3>&1 4>&2
    { time foo 1>&3 2>&4; } 2>&1 | awk '{
        printf "The task took %d hours, %d minutes and %.3f seconds\n",
               $1/3600, $1%3600/60, $1%60
    }'
    exec 3>&- 4>&-

A similar construct can be used to capture "core dump" messages, which are actually printed by the shell that launched a program, not by the program that just dumped core:

./coredump >log 2>&1           # Fails to capture the message
{ ./coredump; } >log 2>&1      # Captures the message

The same applies to job control messages:

$ { sleep 1 & } >log 2>&1
$ cat log
[1] 10316
[1]+  Done                    sleep 1

Of course you may opt to redirect to /dev/null instead of a file.


CategoryShell CategoryExampleCode

BashFAQ/032 (last edited 2018-07-26 21:28:38 by GreyCat)