Prevent duplicates with different non-alphanum characters
Posted: July 22nd, 2011, 3:09 am
Hi
I've noticed that duplicates are downloaded if they come from separate RSS feeds and only have differing non alphanumeric characters. For instance some are separated with a dot, others with a dash. SAB currently doesn't recognise these as duplicates.
Is it possible to add this or would it cause problems elsewhere?
Thanks

I've noticed that duplicates are downloaded if they come from separate RSS feeds and only have differing non alphanumeric characters. For instance some are separated with a dot, others with a dash. SAB currently doesn't recognise these as duplicates.
Is it possible to add this or would it cause problems elsewhere?
Thanks
