Allow the potatoes to cool completely before adding the rest of the ingredients as the residual heat will melt the mayonnaise and make the salad overly greasy. To speed up cooling, arrange the potatoes in a single layer on a baking sheet and refrigerate.