How do I select multiple fields in jq?
My input file is newline delimited JSON (ndjson) looking something like this:{"login": "dmaxfield","id": 7449977, ...}{"login": "dmaxfield","id": 7449977, ...}I can get all the login names with this :...
View ArticleUsing jq to create JSON objects/dictionaries
In my bash script I have a dictionary/map like:k1: v1k2: v2k3: v3Can I possibly use jq --slurp or jq --raw-input to actually convert this to JSON like this:{"k1": "v1","k2": "v2","k3": "v3"}possibly by...
View ArticleJQ:How to remove items from json array with conditions?
I have the following few json array objects that Id like to filter using a single jq command.{"Sid": "bla1","Effect": "Allow","Principal": {"AWS": "*" },"Action": "blabla","Resource":...
View Articlejq Conditional output
I'm using jq to play with json. I was wondering how to conditionally print something in that.Say I am interested in a field call geo. I used the following command and find out there is only one entry...
View Articlejq select elements with array not containing string
Now, this is somewhat similar to jq: select only an array which contains element A but not element B but it somehow doesn't work for me (which is likely my fault)... ;-)So here's what we have:[...
View ArticleJQ Select items that do not match string
I've got a group of AWS instances that I'm parsing via aws ec describe-instances. I'm looking to trim out all the records whose IP's do not start with '10.10'.aws ec2 describe-instances --no-paginate...
View ArticleUsing jq with Jenkins pipeline
In my use case i'm running a pipeline which calls aws cli via the withAWS plugin. I use jq to get the needed data, Now the sh returns the output as String. How do i convert this output to json object...
View ArticleHow to prettify json with jq given a string with escaped double quotes
I would like to pretty print a json string I copied from an API call which contains escaped double quotes.Similar to this:"{\"name\":\"Hans\", \"Hobbies\":[\"Car\",\"Swimming\"]}"However when I execute...
View ArticleGet intersection of arrays in JQ
I'm new to jq,and would like to get the intersection of two arrays (similar question BUT with different approach: link).I managed to get the union of two arrays and addition of two...
View ArticleParsing JSON with Unix tools
I'm trying to parse JSON returned from a curl request, like so:curl 'http://twitter.com/users/username.json' | sed -e 's/[{}]/''/g' | awk -v k="text"'{n=split($0,a,","); for (i=1; i<=n; i++) print...
View ArticleExtract "packages" key from skopeo output with jq
I'm trying to extract the list of packages from skopeo inspect output, but this does not seem to work:❯ skopeo inspect docker://ghcr.io/ublue-os/bluefin-dx:gts | jq...
View ArticleSplit a JSON array into multiple files using command line tools
Suppose we have a JSON array of length 5 and we want to split the array into multiple arrays of length 2 and save the grouped items into different files, using linux command line tools. I tried it by...
View ArticleSorting and comparing json files with ./jq
I am trying to compare two long json files with WinMerge by using QueryJSON plugin.Properties in those files are in random order.That parameter for .\jq does work, but nested objects are not...
View ArticleHow to convert a json string into an individual character array in bash?
I have a json string that I need to convert into an array for passing a password in. Current issue is I need to do this for many usersCurrent json looks like this which was generated from [...
View ArticleAssigning incrementing numbers in order-preserving way
Using jq, I want to assign an incrementing number num to each element in the order they appear in the input, but keep the same number for elements that share a ref value with other elements.So...
View ArticleHow to use jq to merge a list of dictionaries into one dictionary
I'm developing jq expressions on the command line. (I plan to use the expression with pyjq in python to parse http requests.)The following command line:$ cat some.json | jq...
View ArticleFlatten a JSON document using jq
I'm considering the following array of JSON objects:[ {"index": "index1","type": "type1","id": "id1","fields": {"deviceOs": ["Android" ],"deviceID": ["deviceID1" ],"type": ["type" ],"country": ["DE" ]...
View ArticleInclude element only if present
I am implementing a program accessing a REST API, which can be filtered server-side by passing in a jq-statement. My issue is with writing a jq filter that includes an element called...
View ArticleHow to convert a json response into yaml in bash
I read data from a json file with jq. I wanna append the results into a yaml file, but I dont get it working. I am quite new to shell programming. My goal is to append that "users" to an existing...
View ArticleProcess large JSON stream with jq
I get a very large JSON stream (several GB) from curl and try to process it with jq.The relevant output I want to parse with jq is packed in a document representing the result structure:{"results":[...
View ArticleHow to iterate and pick the each element in {} blocks
{ __name__: sc_pcd_g2version, container: mgmtbroker, endpoint: vxexporter, instance: 10.42.24.132:9116, job: prometheus, namespace: delivery, pod: chn1-d1-ac-0, service: prometheus }{ __name__:...
View ArticleHow to insert JSON into table beside a specific value using JQ
In this JSON snippet[ {"user":"user-1","videos":[ {"key":"key1","url":"url1" } ] }, {"user":"user-2","videos":[ {"key":"key2","url":"url2" } ] }]I want to add {"key":"key3","url":"url3"} under videos...
View ArticleHow to recursively print the path of all keys in jq
I'd like to get a list of all paths available in a JSON document, just to get an idea of the layout of a big json document.One liners preferred, of course a big jq/python program can do the...
View Articlehow to parse a JSON String with jq (or other alternatives)?
I'm trying to get jq to parse a JSON structure like:{"a" : 1,"b" : 2,"c" : "{\"id\":\"9ee ...\",\"parent\":\"abc...\"}\n"}That is, an element in the JSON is a string with escaped json.So, I have...
View Articlesort json object numerically by key
I have the following json format. It's basically a representation of the calendar:{"month1": {"day1":{...}, "day2": {...}}, "month2": {...}}I'd like to sort it such that both the months and the days...
View ArticleHow can I put integer as an argument in jq?
I have been trying to use jq to parse a json file returned from the aws cli, but I'm stuck with the problem of referencing an array using the index number. I need to do this because I want to export a...
View Articlehow to get the intersection of two JSON arrays using jq
Given arrays X and Y (preferably both as inputs, but otherwise, with one as input and the other hardcoded), how can I use jq to output the array containing all elements common to both? e.g. what is a...
View ArticleThe entire object gets duplicated in output when trying to parse array nested...
I have the following json data:{"Country": "India","States": [ {"Name": "TN","Cities": ["city1","city2" ] }, {"Name": "KL","Cities": ["city3","city4" ] } ]}jq expression:{ country:.Country,states:...
View Articlejq: adding nested object to a JSON
I have a json file containing several profiles:{"profile1": {"user": "user1","channel": "channel1","hook": "hook1" },"default": {"user": "user1","channel": "channel1","hook": "hook2" }}I want to use jq...
View ArticleHow to sort a json file by keys and values of those keys in jq
We're building a website using the Pentaho CTools library, which has a graphical dashboard editor which writes out JSON-format files for part of the dashboard.I'd like to apply a transform to these...
View Article