Preheat the oven to 350 degrees F.
Combine cayenne, white pepper, salt, dry mustard, Worcestershire, lemon juice, seafood seasoning, mayonnaise, bread crumbs, and eggs in a large bowl and mix until thoroughly combined. Place crabmeat in another large bowl and gently fold egg mixture into crabmeat, being careful not to break up large crab pieces. Shape into 4 crab cakes.
Heat olive oil in a large skillet over medium-high heat. Add the crab cakes, in batches if necessary, and cook until lightly browned, approximately 1 minute on each side. Transfer crab cakes to a sheet pan (or place skillet in oven if oven-safe) and finish cooking the crab cakes in the oven until heated through. Serve with lemon wedges and tartar sauce, if desired.
*Cook's Note: If removing fresh cooked crabmeat from shells, be careful not to break large crabmeat nuggets.