In a large skillet, melt the butter over medium heat and stir in apples, raisins, and golden raisins. Saute for about 5 to 7 minutes until they begin to caramelize. Add pears, peaches, vanilla, cinnamon, and brown sugar and cook for 5 more minutes. Remove from heat and allow to cool to room temperature.
Preheat oven to 350 degrees F.
If phyllo was defrosted, make sure it is completely defrosted before handling it. Once removed from package, you will need to cover phyllo with waxed paper and a damp towel to prevent it from drying out. Working with 1 sheet at a time, lay out a dough sheet on a baking sheet and brush on butter. Lay another sheet on top and butter again, repeating for all the phyllo sheets, until you have a stack of 10. Start another stack of 10 on a separate baking sheet and butter in between each sheet in the same way.
Fold cubed pound cake and bread crumbs into the fruit mixture. (This will absorb enough of the moisture to prevent the phyllo from breaking down.)
Spread the fruit mixture evenly over each stack of prepared phyllo and gently roll up the dough from the longest side, folding the ends shut as you go. Brush with egg wash and sprinkle with granulated sugar. Bake in oven until golden brown, about 30 to 40 minutes. Remove from oven and cool completely.
Serve at room temperature with a scoop of vanilla ice cream and warm caramel sauce.