Stir together sugar, nuts and brandy. Place cheese on an oven proof platter and bake at 500 degrees for 4 to 5 minutes until cheese is softened. Mound sugar mixture over top. Bake 2 to 3 minutes more until sugar is melted.
For microwave: place sugar mixture in glass measuring cup and cook uncovered on high for 1 minute or until sugar is melted. Place cheese on microwave safe plate, pour sugar mixture over and cook uncovered on medium about 2 minutes. Cheese should be heated through but not melted.
Serve with the crackers or baguette. Delicious!