Place eggs in pot and cover with 1" of water over the top of the eggs. Add 2 tsp of baking soda.
Bring to a boil over medium high heat. Remove from the heat, cover for 7 minutes.
Submerge in cold water, continuing to run cold water over the eggs until they are cool to the touch.
Peel and place in a large mixing bowl. Mash with a potato masher.
Add mayo, mustard, cayenne, onion, celery, salt and pepper. Mix to combine.
Taste for salt and pepper; adjust accordingly.
Serve immediately or refrigerate in an airtight container.