Prepare the tropical filling by simmering all the ingredients in a small saucepan for 15 minutes until thickened to a jam consistency. Stir occasionally. Remove from heat and allow to cool completely.
In a large bowl, at medium speed, beat the cream cheese and the sugar until smooth. Scrape the bowl as needed. Add the vanilla. Reduce the speed and gradually add the cream. Increase the speed and beat the mixture until stiff peaks form. Reserve one third of the mixture in the refrigerator to finish the cake after chill time.
Line one 10x5-inch loaf pan with plastic wrap. Place one layer of graham crackers at the bottom of the pan. If needed, break the crackers to fit. Evenly spread cream over the crackers. Add one layer of fruit filling. Repeat the layering process, finishing with a layer of graham crackers. Cover with plastic wrap and place in the freezer for at least 4 hours.
When ready to serve, invert the cake over a serving platter and remove plastic wrap. Cover the cake with the reserved cream cheese cream. Decorate with pieces of mango, raspberries, and mint.