[SOLVED] Is there a way to 'uniq' by column?

Issue

I have a .csv file like this:

[email protected],2009-11-27 01:05:47.893000000,domain.example,127.0.0.1
[email protected],2009-11-27 00:58:29.793000000,domain2.example,255.255.255.0
[email protected],2009-11-27 00:58:29.646465785,domain2.example,256.255.255.0
...

I have to remove duplicate e-mails (the entire line) from the file (i.e. one of the lines containing [email protected] in the above example). How do I use uniq on only field 1 (separated by commas)? According to man, uniq doesn't have options for columns.

I tried something with sort | uniq but it doesn't work.

Solution

sort -u -t, -k1,1 file

• -u for unique
• -t, so comma is the delimiter
• -k1,1 for the key field 1

Test result:

[email protected],2009-11-27 00:58:29.793000000,xx3.net,255.255.255.0
[email protected],2009-11-27 01:05:47.893000000,xx2.net,127.0.0.1

Answered By - Carl Smotricz

Answer Checked By - Cary Denson (WPSolving Admin)