It can be a very hard problem. The first problem is the jitter in the packet timestamping process that Guy and I explained you. The second problem is having the clocks of the two machines synchronized. Are you using GPS or similar to sync the two clocks?
I'm trying to measure one way delay.