awk - transposing output of program 1

[dlicheri]

hello awk gurus;

I have the following problem which I am having difficulties with.

I have a file that is produced on a hourly basis which I would like to friendly format so that it is easier to interpret. Currently, the contents of file is presented on four lines:

header: startdate and time and some other fields
physical-memory: data
virtual-memory: data
footer : enddate and time

Output is colon ) delimited.

example:

eport-high:header:20211223T010100Z:20211223T020100Z:10:7200
report-highhysical-memory:mem_default:[total]:97124608K:72.36%:-:-
report-high:virtual-memory:vm_default:[total]:102675472K:61.19%:-:-
report-high:footer:20211223T020100Z10:7200

Data is produced in groups of four rows with header and footer containing start and end time. I would like to display each group of four lines as a single line in a new file so it looks like below (comma delimited and transposed):

Startdate,time,Enddate,time,%physicalmemory,physicalmemory,%virtualmemory,virtualmemory;
20211223,T010100Z,20211223,T020100Z10,72.36%,97124608K,61.19%,102675472K;


How do i do this with awk or gawk in solaris ?

Any help appreciated.

Thanks in advance!
dean

 

[mikrom]

Hi dlicheri,

Something like this should do the work:
dlicheri.awk

[COLOR=#0000ff]# run:[/color]
[COLOR=#0000ff]# awk -f dlicheri.awk dlicheri.txt[/color]

[COLOR=#6a5acd]BEGIN[/color] {
  [COLOR=#6a5acd]FS[/color] [COLOR=#6a5acd]=[/color] [COLOR=#ff00ff]":"[/color]
}

[COLOR=#6a5acd]$2[/color] [COLOR=#6a5acd]~[/color] [COLOR=#ff00ff]/header/[/color] {
  startdate [COLOR=#6a5acd]=[/color] [COLOR=#008b8b]substr[/color]([COLOR=#6a5acd]$3[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]1[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]8[/color])
  starttime [COLOR=#6a5acd]=[/color] [COLOR=#008b8b]substr[/color]([COLOR=#6a5acd]$3[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]9[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]8[/color])
}

[COLOR=#6a5acd]$2[/color] [COLOR=#6a5acd]~[/color] [COLOR=#ff00ff]/physical-memory/[/color] {
  physicalmemory_total [COLOR=#6a5acd]=[/color] [COLOR=#6a5acd]$5[/color]
  physicalmemory_proc [COLOR=#6a5acd]=[/color] [COLOR=#6a5acd]$6[/color]
}

[COLOR=#6a5acd]$2[/color] [COLOR=#6a5acd]~[/color] [COLOR=#ff00ff]/virtual-memory/[/color] {
  virtualmemory_total [COLOR=#6a5acd]=[/color] [COLOR=#6a5acd]$5[/color]
  virtualmemory_proc [COLOR=#6a5acd]=[/color] [COLOR=#6a5acd]$6[/color]
}

[COLOR=#6a5acd]$2[/color] [COLOR=#6a5acd]~[/color] [COLOR=#ff00ff]/footer/[/color] {
  enddate [COLOR=#6a5acd]=[/color] [COLOR=#008b8b]substr[/color]([COLOR=#6a5acd]$3[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]1[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]8[/color])
  endtime [COLOR=#6a5acd]=[/color] [COLOR=#008b8b]substr[/color]([COLOR=#6a5acd]$3[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]9[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]8[/color])
}

[COLOR=#6a5acd]END[/color] {
  [COLOR=#a52a2a][b]printf[/b][/color] [COLOR=#ff00ff]"[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#6a5acd]\n[/color][COLOR=#ff00ff]"[/color][COLOR=#6a5acd],[/color]
    [COLOR=#ff00ff]"startdate"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"starttime"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"eddate"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"endtime"[/color][COLOR=#6a5acd],[/color] 
    [COLOR=#ff00ff]"%physicalmemory"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"physicalmemory"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"%virtualmemory"[/color][COLOR=#6a5acd],[/color] [COLOR=#ff00ff]"virtualmemory"[/color]
  [COLOR=#a52a2a][b]printf[/b][/color] [COLOR=#ff00ff]"[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#ff00ff],[/color][COLOR=#6a5acd]%s[/color][COLOR=#6a5acd]\n[/color][COLOR=#ff00ff]"[/color][COLOR=#6a5acd],[/color]
    startdate[COLOR=#6a5acd],[/color] starttime[COLOR=#6a5acd],[/color] enddate[COLOR=#6a5acd],[/color] endtime[COLOR=#6a5acd],[/color] 
    physicalmemory_proc[COLOR=#6a5acd],[/color] physicalmemory_total[COLOR=#6a5acd],[/color] virtualmemory_proc[COLOR=#6a5acd],[/color] virtualmemory_total
}

Now when we have your input file
dlicheri.txt

report-high:header:20211223T010100Z:20211223T020100Z:10:7200
report-high:physical-memory:mem_default:[total]:97124608K:72.36%:-:-
report-high:virtual-memory:vm_default:[total]:102675472K:61.19%:-:-
report-high:footer:20211223T020100Z10:7200

after running this command

$ awk -f dlicheri.awk dlicheri.txt > dlicheri_output.txt

we get this output file
dlicheri_output.txt

startdate,starttime,eddate,endtime,%physicalmemory,physicalmemory,%virtualmemory,virtualmemory
20211223,T010100Z,20211223,T020100Z,72.36%,97124608K,61.19%,102675472K

I don't have Solaris, I tried it on Linux.

 

[dlicheri]

hello mikrom;

that's great, it works. If i wanted to pipe the output directly to the awk script what would need to change ?

eg:
# collect-stats | dlicheri.awk >> /var/tmp/report-today

 

[mikrom]

If i wanted to pipe the output directly to the awk script what would need to change ?

this works for me:

$ cat dlicheri.txt | awk -f dlicheri.awk > dlicheri_output.txt

 

[mikrom]

Hi blicheri,

or, if you insert on the 1st line of the script the awk shebang, i.e. depending on the location of awk, e.g.
in case of

$ which awk
/usr/bin/awk

you set this shebang

#!/usr/bin/awk -f
...
the awk script
...

and then change mode of the script to executable

$ chmod +x dlicheri.awk

then you will be able to call that like this:

$ cat dlicheri.txt | ./dlicheri.awk > dlicheri_output.txt