Preheat oven to 425°F. In a bowl, mix cut sweet potatoes, olive oil, garlic powder, paprika, 1/2 tsp salt, and 1/4 tsp pepper. Mix to combine thoroughly. Place the seasoned sweet potatoes on a baking sheet and bake for 30-35 minutes.
For the dipping sauce, combine mayo, Dijon mustard, grated garlic, lime juice, lime zest, smoked paprika, 1/2 tsp salt, and 1/4 tsp pepper in a bowl. Mix until all ingredients are well combined.
Serve the baked sweet potato fries immediately with the garlic lime dipping sauce.