[SOLVED] transform multiline text into csv with awk sed and grep

Issue

I run a shell command that returns a list of repeated values like this (note the indentation):

Name:               vm346
  cpu                1 (12%)      6150m (76%)
  memory             1130Mi (7%)  1130Mi (7%)
Name:               vm847
  cpu                6 (75%)        30150m (376%)
  memory             12980Mi (87%)  12980Mi (87%)
Name:               vm848
  cpu                3500m (43%)   17150m (214%)
  memory             6216Mi (41%)  6216Mi (41%)

I am trying to transform that data like this (in csv):

vm346,1,(12%),6150m,(76%),1130Mi,(7%),1130Mi,(7%)
vm847,6,(75%),30150m,(376%),12980Mi,(87%),12980Mi,(87%)
vm848,3500m,(43%),17150m,(214%),6216Mi,(41%),6216Mi,(41%)

The problem is that any given dataset like the one above is always on more than one line.

when I pipe that into it awk it drives me mad because even if I use:

BEGIN{ FS="\n" }

to try and stitch the data together in one line, it doesn't work. No matter what I do, awk keeps the name value as a separated line above everything else.

I am sorry I haven't much code to share but I have been spinning my wheels with this for a few hours now and I am running out of ideas...

Solution

I can solve this in Perl:

perl -ane 'print join ",", @F[1 .. $#F]; print $F[0] eq "memory" ? "\n" : ","'

It should be easy to translate it to awk if you need it.

How does it work?

• -a splits each line on whitespace into the @F array
• -n reads the input line by line and runs the code specified after -e for each line
• We print all the elements but the first one separated by commas (see join)
• We then look at the first column, if it's memory, we are at the last line of the block, so we print a newline, otherwise we print a comma

Answered By - choroba

Answer Checked By - Terry (WPSolving Volunteer)