Evaluating Trustworthiness and Racial Bias in Face Recognition APIs Using Deepfakes

We evaluate the racial bias in face recognition application programming interfaces (APIs) using real and deepfake celebrity images. We use deepfake generation methods to introduce small, imperceptible changes to the real images to shift the racial class of predictions, showing how deepfake images exacerbated racial bias in web-based face recognition APIs.