Preheat oven to 375 degrees. In a small saucepan over medium heat, melt butter. Stir in cocoa and vanilla. Pour mixture in to a large bowl and add eggs, sugar, and flour.
Pour half of the batter into a 8x8 pan lined with foil. Scatter chopped milky way bites over the batter. Top with remaining batter and make 30-35 minutes or until an inserted toothpick comes out clean.
Drizzle with melted caramel and allow to cool completely. Cut into squares and store in an airtight container.
Notes
Pro tip: I prefer to under-bake my brownies slightly so they are really chewy.