根据第三列去重

sort -t $',' -k3,3 -u file1.txt >> file_new.txt

原文地址:https://www.cnblogs.com/redBack/p/13803992.html