How to extract JSON string from a longer mixed string in a shell script

Question

Given the following string:

arn:aws:secretsmanager:us-east-1:3264873466873:secret:foo/bar 1564681234.974 foo/bar {"username":"admin","password":"admin123","secret_key":"KASJDFJHAKHFKAHASDF"} 4e397333-3797-4f0b-ad7e-8c1cc0ed041c VERSIONSTAGES AWSCURRENT

Within a shell script, how do you extract just the JSON portion to end up like this:

{"username":"admin","password":"admin123","secret_key":"KASJDFJHAKHFKAHASDF"}

I was able to do it using two sed commands:

echo $longString | sed 's/^.*{/{/' | sed 's/}.*$/}/'

but was wondering if there is a way to do it using only one command.

grep -o '{.*}' maybe?

choroba
– choroba

2019-08-01 20:58:40 +00:00
Commented Aug 1, 2019 at 20:58 — choroba
– choroba, Commented Aug 1, 2019 at 20:58

choroba · Accepted Answer · 2019-08-01 22:44:05Z

3

To extract continuous part of the input, you can use grep with its -o option (if supported on your system). It tells grep to only output the matching part.

grep -o '{.*}'

answered Aug 1, 2019 at 22:44

choroba

245k27 gold badges221 silver badges304 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

bishop · Accepted Answer · 2019-08-01 20:59:50Z

1

For extracting columns, use awk:

echo $longString | awk '{print $4}'

Or cut:

echo $longString | cut -f 4 -d ' '

Beware if you have spaces in your JSON data. You might be better off using jq to process the results of aws secretsmanager list-secrets and similar.

answered Aug 1, 2019 at 20:59

bishop

39.8k14 gold badges116 silver badges150 bronze badges

Comments

fedemengo · Accepted Answer · 2019-08-01 21:25:20Z

0

You can use

echo $longString | sed -n 's|.*\({.*}\).*|\1|p'

to match and print the desired pattern

answered Aug 1, 2019 at 21:25

fedemengo

6962 gold badges10 silver badges26 bronze badges

Comments

gilwo · Accepted Answer · 2019-08-01 21:31:52Z

0

you can just join the sed commands to a single command sed 's/^.*{/{/;s/}.*$/}/'

answered Aug 1, 2019 at 21:31

gilwo

1,7611 gold badge10 silver badges10 bronze badges

Comments

Jotne · Accepted Answer · 2019-08-02 04:28:49Z

0

This awk should do. I will handle if there are any space in the string.

echo $string | awk -F"[{}]" '{print $2}'
"username":"admin","password":"admin123","secret_key":"KASJDFJHAKHFKAHASDF"

answered Aug 2, 2019 at 4:28

Jotne

41.7k13 gold badges54 silver badges58 bronze badges

Collectives™ on Stack Overflow

How to extract JSON string from a longer mixed string in a shell script

5 Answers 5

Comments

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

Comments

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related