shell_scripting
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| shell_scripting [2023-09-21 04:45 pm] – [Merging CSV files in the current directory] hcho | shell_scripting [2023-09-21 05:15 pm] (current) – hcho | ||
|---|---|---|---|
| Line 15: | Line 15: | ||
| # because we don't want to skip the head line from the first file | # because we don't want to skip the head line from the first file | ||
| first=1 | first=1 | ||
| + | # for each of *.csv file names, assign it to i | ||
| for i in *.csv; do | for i in *.csv; do | ||
| # if you repeat this script, we don't want to merge | # if you repeat this script, we don't want to merge | ||
| Line 34: | Line 35: | ||
| done > merged.csv # forward any outputs from the above for loop | done > merged.csv # forward any outputs from the above for loop | ||
| # to merged.csv | # to merged.csv | ||
| + | </ | ||
| + | |||
| + | ===== Finding the order of a column in a CSV file ===== | ||
| + | |||
| + | <code bash> | ||
| + | head -1 merged.csv | | ||
| + | sed ' | ||
| + | awk '{ | ||
| + | for(i=1; i<=NF; i++) | ||
| + | if($i == " | ||
| + | print i | ||
| + | }' | ||
| + | </ | ||
| + | |||
| + | ===== Counting non-null records in a column in a CSV file ===== | ||
| + | |||
| + | <code bash> | ||
| + | tail -n +2 merged.csv | | ||
| + | sed ' | ||
| + | awk '{ | ||
| + | if($57 != "" | ||
| + | count++ | ||
| + | } | ||
| + | END{ | ||
| + | print count | ||
| + | }' | ||
| </ | </ | ||
shell_scripting.1695336339.txt.gz · Last modified: 2023-09-21 04:45 pm by hcho