HiveBrain v1.2.0
Get Started
← Back to all entries
patternbashMinor

Log Retrieval Script

Submitted by: @import:stackexchange-codereview··
0
Viewed 0 times
scriptretrievallog

Problem

I wrote a simple script to retrieve the logs from my website, and place them in a subdirectory called logs. It fetches the logs using sftp. I would like help with the error handling. I'm sure that there are errors I did not see, and I would like to make it so that it fails gracefully.

#!/bin/bash
# gets the logs

# Location to place downloaded logs
PlaceLogs=./logs
# ssh connection to sftp files from
SSHLocation=hjsblog
# Location and pattern of logs
GetLogs=../logs/access*

#######################################
#######################################

CWD=$(pwd)

# move to get location
if [ "$(ls -A $PlaceLogs)" ] 
then
    echo $PlaceLogs is not empty
    return
fi
mkdir -p $PlaceLogs
cd $PlaceLogs

# perform the get operation
sftp $SSHLocation << EOF
cd $(dirname $GetLogs)
get $(basename $GetLogs)
EOF

# uncompress files
bunzip2 *.bz2

# return to script dir
cd $CWD

Solution

handle more possibilities

Anything touching the file system can fail.

  • mkdir You could have permission problems or something else. Do mkdir foo || exit 3. Feel free to replace the exit with your own function for error handling.



  • cd is the same deal as mkdir



  • check for the existance of your directory before lsing it: if [[ -d $PlaceLogs ]]



Also, do any bz2 exist after the sftp? You should check before bunzip'ing them.

You can safely ignore all of these things too, but since you specifically asked about error handling it seemed good to point them out. If this is a critical piece of software then I would build a way for these failures to raise alerts with your DevOps team.

shellcheck.net

Run all of your scripts through http://www.shellcheck.net/ until you get in better habits.

use double square brackets

Double square brackets are better than single square brackets. They have less surprises. The primary one is that if you have an empty variable you can do

if [[ $FOO == "" ]]


where single brackets require a placeholder so none of the arguments disappear if missing:

if [ x$FOO == "x" ]


Without the xs the $FOO would disappear as a shell argument when empty.

Code Snippets

if [[ $FOO == "" ]]
if [ x$FOO == "x" ]

Context

StackExchange Code Review Q#163194, answer score: 2

Revisions (0)

No revisions yet.