How to Store: Store unfrosted cupcakes in an airtight container at room temperature for up to 3 days, or freeze them (wrapped individually) for up to 2 months. Frosted cupcakes can sit at room temp for up to 2 days. They can be refrigerated for up to 5 days, but they might dry out a little. Bring them to room temperature before serving. For longer storage, freeze frosted cupcakes after chilling them until firm, then wrap and freeze for up to 2 months. Lemon buttercream frosting can be stored in the fridge for up to a week or frozen for 2 months; let it come to room temp and re-whip before using.