Just say no to CSV

[lars-t-hansen]

The JSON encoding of sonar ps data on a Fox login node is nearly 40% smaller than the CSV encoding (b/c records do not carry redundant version, timestamp and hostname for every record, and b/c the hostname is fairly long on the login node). When I looked at these data the other day I got this reversed: I thought the CSV was smaller.

[ec-larstha@login-3 sonar-main]$ target/debug/sonar ps --exclude-system-jobs --load | wc
    614     646   94470
[ec-larstha@login-3 sonar-main]$ target/debug/sonar ps --exclude-system-jobs --load --json | wc
      1      33   59042

Obviously if we really care about data size we'll use some binary encoding or make sure that data are compressed somehow for transmission, ideally very cheaply.

[bast]

You make a good point that we should drop CSV in favor of JSON.