Skip to yearly menu bar Skip to main content


Poster

Seeing Faces in Things: A Model and Dataset for Pareidolia

Mark T Hamilton · Simon Stent · Vasha G DuTell · Anne Harrington · Jennifer E Corbett · Ruth Rosenholtz · William T. Freeman

Strong blind review: This paper was not made available on public preprint services during the review process Strong Double Blind
[ ]
Thu 3 Oct 7:30 a.m. PDT — 9:30 a.m. PDT

Abstract:

The human visual system is well-tuned to detect faces of all shapes and sizes. While this brings obvious survival advantages, such as a better chance of spotting unknown predators in the bush, it also leads to spurious face detections. Face pareidolia'' describes the perception of face-like structure among otherwise random stimuli: seeing faces in coffee stains or clouds in the sky. In this paper, we study face pareidolia from a computer vision perspective. We present an image dataset ofFaces in Things'', consisting of five thousand images from the web with human-annotated pareidolic faces. Using this dataset, we examine the extent to which a state-of-the-art human face detector exhibits pareidolia, and find a significant behavioral gap between humans and machines. We explore a variety of different strategies to close this gap and discover that the evolutionary need for humans to detect animal faces, as well as human faces, explains some of this gap. Finally, we propose a simple statistical model of pareidolia in images. Through studies on human subjects and our pareidolic face detectors we confirm a key prediction of our model regarding what image conditions are most likely to induce pareidolia.

Live content is unavailable. Log in and register to view live content