In a large bowl, combine cauliflower florets, olives and half the lemon slices (reserve as many lemon slices as you have pieces of fish, or 3-4 slices for a large salmon fillet). Drizzle the leftover marinade onto the vegetables, and mix well to combine.