The deal will remove an estimated £580m worth of tariffs from British exports, but rights groups are critical