Combine the vanilla pudding mix with the milk and whisk for two minutes; set aside.
Beat the cream cheese on medium speed until smooth and creamy, 2 to 3 minutes. Reduce the speed to low and gradually add the powdered sugar. Beat for 1 minute, or until thoroughly combined and smooth.
Add the prepared pudding to the cream cheese mixture and gently fold and stir with a rubber spatula until completely combined. Add the Cool Whip to the bowl and fold it into the mixture until no white streaks remain.
To assemble the trifle, alternate layers of angel food cake, blueberries, the pudding mixture, strawberries and so on, until you get the top. Add a final layer of the pudding mixture, then arrange the remaining strawberries and blueberries in a decorative pattern. Serve immediately or cover and refrigerate until ready to serve.