Midjourney is an amazing tool but it can struggle when dealing with faces. Using MedianMerge and a lot of generated images you can combine them with the median operation to do a lot of the heavy lifting of cleaning up rogue elements to create a smooth and consistent image.
You can learn more about MedianMerge here!