In a medium bowl, combine 1/2 cup of flour, semolina, salt, and pepper and mixes well. Dredge the fish in the buttermilk and then in the flour mixture. In a medium sized pot or deep fryer, heat 3 to 4 inches of oil and deep fry the fish until golden brown and becomes crisp. Remove fish and drain on paper towels. Serve with skordalia and a wedge of lemon.
Put the potatoes through a food mill or ricer and place in a bowl for mixing. Whisk in the cream, minced garlic, olive oil, lemon juice, red wine vinegar and a little water if necessary mix until mixture is smooth. Season with salt and pepper to taste. Keep cool until ready to use.