remove duplicate records
Posted: Tue Jun 21, 2016 12:21 pm
Hi
I need to remove duplicate records from a file
Input file
field timestamp
123 2016-06-16-08.39.38.523669
123 2016-06-20-07.39.38.523669
456 2016-06-16-08.39.38.523669
the ouput file should be i.e., it should contain latest record from duplicate records,as in the input file we can see the duplicate record is not having same timestamp,in the output file i need data with 2016-06-20-07.39.38.523669 timestamp not 2016-06-16-08.39.38.523669.
Output file:
field timestamp
123 2016-06-20-07.39.38.523669
456 2016-06-16-08.39.38.523669
Thanks
I need to remove duplicate records from a file
Input file
field timestamp
123 2016-06-16-08.39.38.523669
123 2016-06-20-07.39.38.523669
456 2016-06-16-08.39.38.523669
the ouput file should be i.e., it should contain latest record from duplicate records,as in the input file we can see the duplicate record is not having same timestamp,in the output file i need data with 2016-06-20-07.39.38.523669 timestamp not 2016-06-16-08.39.38.523669.
Output file:
field timestamp
123 2016-06-20-07.39.38.523669
456 2016-06-16-08.39.38.523669
Thanks