Add 1-2" of vegetable oil to a tall sided skillet set over medium heat, and heat oil to 350 degrees.
Add eggs and milk to a small dish and beat together with a fork until well blended.
In a separate shallow bowl, mix flour with crushed crackers, salt, paprika, black pepper, and cayenne pepper, until well combined.
Working in batches, dredge the fish fillets in the egg wash, letting any excess drip off, and then dredge them through the cracker crumb mixture until evenly coated on all sides.
Add breaded perch fillets to the hot oil in a single layer, working in batches as needed. Flip the fillets halfway through cooking and fry until golden-brown. Approximately 3-4 minutes per side.
Remove the fried fish from the hot oil and set them on a wire wrack to drain while frying the remaining fish, then serve with tartar sauce and lemon wedges.