In a large mixing bowl or bowl of a stand mixer, cream 1/2 cup unsalted butter, softened and 1 1/2 cups packed brown sugar until fluffy, about 2 minutes.
Add in 1 large egg and 1 tsp vanilla extract.
In small bowl, sift or whisk 2 cup all-purpose flour, 1 tsp baking soda, 1/4 tsp salt and ½ tsp ground nutmeg.
Slowly alternate adding dry ingredients and 1 cup sour milk or buttermilk to batter, starting and ending with dry ingredients.
Fold in 2 cups diced fresh or frozen rhubarb (see tips if using frozen rhubarb) with a spatula.
Pour batter into a greased 9"x13" pan. Combine topping ingredients: 1/2 cup packed brown sugar, 1 tsp ground cinnamon, 1/2 cup nutmeats (such as chopped walnuts or pecans). Sprinkle evenly on top of batter.
Bake at 350°F for 40 minutes, or until a toothpick inserted in the center of cake comes out clean. Cool before cutting to serve.