Meh, Lovecraft was scared of everything... Some say he was a racist xenophobe, which he was... But remember that he was also scared of "Non-Euclidean Mathematics" because he couldn't understand it (it's really just Euclidean Mathematics when applied to a curved 2D surface) and also freaked out when he heard that there were "light-waves we couldn't perceive with our human senses" and wrote "The Color Out Of Space" in response.
Dude was scared of everything, including people of other skin-tone or culture. Everything!