Hi,
this post may be of interest, it talks to some process patterns to detect and deal with duplicates…
regards
Rob