Combine 2 tablespoons of the oil with the garlic in a small heavy saucepan over medium- low heat. Cook shaking the pan occasionally until the garlic browns. Season with a little bit of salt. Remove from the heat and add 2 tablespoons of lime juice and let set.
Meanwhile in a heavy bottomed pan add the chopped mangoes, pineapple chunks with the juice, brown sugar, honey, white wine, onions, grated ginger, parsley and raisins. Cook over medium heat for about 20 minutes. Taste and season with salt and pepper. Add the garlic with the oil and lemon to the mangoes and stir together. Cook over low heat for another minute or so.
In a large skillet place 2 tablespoons of oil over medium heat. Add the fish and cook each side for 2 minutes. Add the remaining lemon juice and season with salt and pepper.