extract multiple words from git log

Question

I need to extract multiple words from git log.

I need the commit id and ticket number for each commit, I then need to run this through a loop and do some further processing for each commit.

commit 87b56bbd6496802bbc97c8abd0346597d7a15810 (HEAD -> main, tag: app_v4.151.6, origin/main, origin/HEAD)
Author: daniel-johns-99 <[email protected]>
Date:   Thu Mar 27 21:11:18 2025 +1000

    CI-451-template-change (#4497)

commit 45bec837a19ac33822da2033bf1fb192b8cf2945 (tag: uk_v46, tag: app_v4.151.5)
Author: Leon Duffus <[email protected]>
Date:   Thu Mar 27 09:16:51 2025 +0000

    DTE-602 dsc breadcrumb component design changes (#4457)
:

given the above, I would need the following array that I could process

CI-451:87b56bbd6496802bbc97c8abd0346597d7a15810
DTE-602:45bec837a19ac33822da2033bf1fb192b8cf2945

the following is my current attempt:

commits=$(git log "$previous_tag".."$tag")

for i in $commits; do
    commit=$(echo $i | sed 's/^.*commit //')
    ticket=$(echo $i | grep --extended-regexp --only-matching --ignore-case "(${proj_regex})[ -][0-9]{2,5}")
    echo $commit
done

Get used to copy/pasting your shell scripts into shellcheck.net and fixing the issues it tells you about. — Ed Morton
– Ed Morton, Commented Mar 27 at 17:25

bxm · Accepted Answer · 2025-03-28 11:15:57Z

3

I wouldn't process the "default" log, ever.

You can get halfway there just with a different log format. In this case printing the Hash and Commit message only.

git log --pretty=format:'%H %s'

And then use awk to finish up (making the assumption that ticket refs appear at the start of the commit message)

git log --pretty=format:'%H %s' | \
  awk -F"[^a-zA-Z0-9]" '$2"-"$3 ~ /^[A-Z]+-[0-9]+$/ {print $2"-"$3":"$1}'

Explaining that awk:

-F"[^a-zA-Z0-9]"

Everything that isn't alpha or numeric is a field delimiter

$2"-"$3 ~ /^[A-Z]+-[0-9]+$/

In cases where field 2 and 3 (first two "words" of the commit message) look like they are probably a ticket ref, we continue

{print $2"-"$3":"$1}

Print the first 3 fields in the desired order.

More robust alternative, based heavily on Ed Morton's answer (adapted lightly for the simpler custom log format):

git log --pretty=format:'%H %s' \
  | awk -v OFS=: \
    '
      match($2, /^[[:upper:]]+-[[:digit:]]+/)
      { print(substr($2, 1, RLENGTH), $1) }
    '

edited Mar 28 at 11:15

answered Mar 27 at 14:40

bxm

5,2101 gold badge22 silver badges26 bronze badges

can you change it so that the whole message is included and seprated by a pipe instead of just the number: ci-488: fetch blueprint (#4741)|f0fd5dc0f5e051e75b841b3830e3a54cdf779200

xerxes
– xerxes

2025-05-07 16:48:49 +00:00
Commented May 7 at 16:48
Just use the basic git command and fiddle with the tokens git log --pretty=format:'%s|%H'. However, putting the tokens in this order could be problematic; IE if you have a | in a commit message it will make processing the output harder.

bxm
– bxm

2025-05-13 13:29:37 +00:00
Commented May 13 at 13:29

Add a comment |

Ed Morton · Accepted Answer · 2025-03-27 17:21:26Z

This might be what you want, using any POSIX awk:

$ cat file |
    awk -v OFS=':' '
        /^commit/ { c=$2 }
        match($1, /^[[:upper:]]+-[[:digit:]]+/) {
            print substr($1,1,RLENGTH), c
        }
    '
CI-451:87b56bbd6496802bbc97c8abd0346597d7a15810
DTE-602:45bec837a19ac33822da2033bf1fb192b8cf2945

Replace cat file with whatever command produces the sample input you show at the top of the question:

$ cat file
commit 87b56bbd6496802bbc97c8abd0346597d7a15810 (HEAD -> main, tag: app_v4.151.6, origin/main, origin/HEAD)
Author: daniel-johns-99 <[email protected]>
Date:   Thu Mar 27 21:11:18 2025 +1000

    CI-451-template-change (#4497)

commit 45bec837a19ac33822da2033bf1fb192b8cf2945 (tag: uk_v46, tag: app_v4.151.5)
Author: Leon Duffus <[email protected]>
Date:   Thu Mar 27 09:16:51 2025 +0000

    DTE-602 dsc breadcrumb component design changes (#4457)
:

Stack Exchange Network

extract multiple words from git log

2 Answers 2

You must log in to answer this question.

Hot Network Questions

extract multiple words from git log

2 Answers 2

You must log in to answer this question.

Related

Hot Network Questions