text processing with streaming method on linux is very flexiable. you konw, there are sed & awk & shell & python and etc. and sometime we need to determine the file format & convert the file encoding, then file & iconv is helpful.
1, file - determine file type.
2, iconv - convert encoding of given files from one encoding to another.