← back

I swear the UFO is coming any minute

Ariarule | 2026-02-17 22:10 UTC | source

This is the quarterly links ‘n’ updates post, a selection of things I’ve been reading and doing for the past few months.

First up, a series of unfortunate events in science:

When Prophecy Fails is supposed to be a classic case study of cognitive dissonance: a UFO cult predicts an apocalypse, and when the world doesn’t end, they double down and start proselytizing even harder: “I swear the UFO is coming any minute!”

A new paper finds a different story in the archives of the lead author, Leon Festinger. Up to half of the attendees at cult meetings may have been undercover researchers. One of them became a leader in the cult and encouraged other members to make statements that would look good in the book. After the failed prediction, rather than doubling down, some of the cultists walked back their statements or left altogether.

Between this, the impossible numbers in the original laboratory study of cognitive dissonance, and a recent failure to replicate a basic dissonance effect, things aren’t looking great for the phenomenon. But that only makes me believe in it harder!


Another classic sadly struck from the canon of behavioral/brain sciences: the neurologist Oliver Sacks appears to have greatly embellished or even invented his case studies. In a letter to his brother, Sacks described his blockbuster The Man Who Mistook His Wife for a Hat as a book of “fairy tales [...] half-report, half-imagined, half-science, half-fable”.

This is exactly how the Stanford Prison Experiment and the Rosenhan experiment got debunked—someone started rooting around in the archives and found a bunch of damning notes. I’m confused: back in the day, why was everybody meticulously documenting their research malfeasance?


If you ever took PSY 101, you’ve probably heard of this study from 1974. You show people a video of a car crash, and then you ask them to estimate how fast the cars were going, and their answer depends on what verb you use. For example, if you ask “How fast were the cars going when they smashed into each other?” people give higher speed estimates than if you ask, “How fast were the cars going when they hit each other?” (Emphasis mine). This study has been cited nearly 4,000 times, and its first author became a much sought-after expert witness who testifies about the faultiness of memory.

A blogger named Croissanthology re-ran the study with nearly 10x as many participants (446 vs. 45 in the original). The effect did not replicate. No replication is perfect, but no original study is either. And remember, this kind of effect is supposed to be so robust and generalizable that we can deploy it in court.

I think the underlying point of this research is still correct: memory is reconstructed, not simply recalled, so what we remember is not exactly what we saw. But our memories are not so fragile that a single word can overwrite them. Otherwise, if you ever got pulled over for speeding, you could just be like, “Officer, how fast was I going when my car crawled past you?”


In one study from 1995, physicians who were shown multiple treatment options were more likely to recommend no treatment at all. The researchers thought this was a “choice overload” effect, like “ahhh there’s too many choices, so I’ll just choose nothing at all”. In contrast, a new study from 2025 found that when physicians were shown multiple treatment options, they were somewhat more likely to recommend a treatment.

I think “choice overload” is like many effects we discover in psychology: can it happen? Yes. Can the opposite also happen? Also yes. When does it go one way, and when does it go the other? Ahhh you’re showing me too many options I don’t know.


Okay, enough dumping on other people’s research. It’s my turn in the hot seat.

In 2022, my colleague Jason Dana and I published a paper showing that people don’t know how public opinion has changed. Like this:

A new paper by Irina Vartanova, Kimmo Eriksson, and Pontus Strimling reanalyzes our data and finds that actually, people are great at knowing how public opinion has changed.

What gives? We come to different conclusions because we ask different questions. Jason and I ask, “When people estimate change, how far off are they from the right answer?” Vartanova et al. ask, “Are people’s estimates correlated with the right answer?” These approaches seem like they should give you the same results, but they don’t, and I’ll show you why.

Imagine you ask people to estimate the size of a house, a dog, and a stapler. Vartanova’s correlation approach would say: “People know that a house is bigger than a dog, and that a dog is bigger than a stapler. Therefore, people are good at estimating the sizes of things.” Our approach would say: “People think a house is three miles long, a dog is two inches, and a stapler is 1.5 centimeters. Therefore, people are not good at estimating the sizes of things.”

I think our approach is the right one, for two reasons. First, ours is more useful. As the name implies, a correlation can only tell you about the relationships between things. So it can’t tell you whether people are good at estimating the size of a house. It can only tell you whether people think houses are bigger than dogs.

Second, I think our approach is much closer to the way people actually make these judgments in their lives. If I asked you to estimate the size of a house, you wouldn’t spontaneously be like, “Well, it’s bigger than a dog.” You’d just eyeball it. I think people do the same thing with public opinion—they eyeball it based on headlines they see, conversations they have, and vibes they remember. If I asked you, “How have attitudes toward gun control changed?” you wouldn’t be like, “Well, they’ve changed more than attitudes toward gender equality.”

While these reanalyses don’t shift my opinion, I’m glad people are looking into shifts in opinions at all, and that they found our data interesting enough to dig into.


“it also works if you shake your head a little.”


THE LOOP is a online magazine produced by my friends Slime Mold Time Mold. The newest issue includes:

  • a study showing that people maybe like orange juice more when you add potassium to it

  • a pseudonymous piece by me

  • scientific skepticism of the effectiveness of the Squatty Potty, featuring this photo:

This issue of THE LOOP was assembled at Inkhaven, a blogging residency that is currently open for applications. I visited the first round of this program and was very impressed.


Also at Inkhaven, I interviewed the pseudonymous blogger Gwern about his writing process. Gwern is kind of hard to explain. He’s famous on some parts of the internet for predicting the “scaling hypothesis”—the fact that progress in AI would come from dumping way more data into the models. But he also writes poetry, does self-experiments, and sustains himself on $12,000 a year. He reads 10 hours a day every day, and then occasionally writes for 30 minutes. Here’s what he said when I was like, “Very few people do experiments and post them on the internet. Why do you do it?”

I did it just because it seemed obviously correct and because… Yeah. I mean, it does seem obviously correct.

For more on what I learned by interviewing a bunch of bloggers, see I Know Your Secret.


I really like this article by the artist known as fnnch: How to Make a Living as an Artist. It’s super practical and clear-headed writing on a subject that is usually more stressed about than thought about. Here’s a challenge: which of these seven images became successful, allowing fnnch to do art full time?

I’ll give the answer at the bottom of the post.


Anyone who grew up in the pre-internet days probably heard the myth that “you swallow eight spiders every year in your sleep”, and back then, we just had to believe whatever we heard.

Post-internet, anyone can quickly discover that this “fact” was actually a deliberate lie spread by a journalist named Lisa Birgit Holst. Holst included the “eight spiders” myth in a 1993 article in a magazine called PC Insider, using it as an example of exactly the kind of hogwash that spreads easily online.

That is, anyway, what most sources will tell you. But if you dig a little deeper, you’ll discover that the whole story about Lisa Birgit Holst is also made up. “Lisa Birgit Holst” is an anagram of “This is a big troll”; the founder of Snopes claims he came up with it in his younger and wilder days. The true origin of the spiders myth remains unknown.


In 2015, Reagan National Airport in DC received 8,760 noise complaints; 6,852 of those complaints (78%) came from a single household, meaning the people living there called to complain an average of 19 times a day. This seems to be common both across airports and across complaint systems in general: the majority of gripes usually comes from a few prolific gripers. Some of these systems are legally mandated to investigate every complaint, so this means a handful of psychotic people with telephones—or now, LLMs—can waste millions of dollars. I keep calling to complain about this, but nobody ever does anything about it.


dynomight:

Did you know that this is the most compact known way to pack 11 squares together into a larger square?

Really makes you think about the mindset of whoever made the universe, am I right?

(More here.)


Malmesbury digs up the “world’s saddest cookbook” and finds that it’s…pretty good?

how does she make the milkshake in the microwave??

He successfully makes steak and eggs, two things that are supposed to be impossible in the microwave. The only thing you can’t make? Multiple potatoes.

There’s a reason the book is called Microwave Cooking for One and not Microwave Cooking for a Large, Loving Family. […] It’s because microwave cooking becomes exponentially more complicated as you increase the number of guests. […] Baking potatoes in the microwave is an NP-hard problem.



And finally, the answer to the question I posed earlier: the art that made fnnch famous was the honey bear. Go figure!

112 points | 31 comments | original link

Comments

keyle | 2026-02-17 23:26 UTC
What is this supposed to be about? Looks like rambling of a man in his personal blog. Some context would help.

Why do people upvote this en-masse while actually interesting tech related blogs just fly by without a vote?

(genuinely trying to understand).

Are you all sitting on Discord channels, chilling each other's posts for karma points?

EA-3167 | 2026-02-17 23:32 UTC
My first reflexive thought, and I suspect possibly yours too, was "Oh wow it's the same pattern I've seen here for years every time the new get-rich-quick career path drops!" Remember when people would look you dead in the eye and swear to God that you'd have your OS "running on the chain" and PoW would solve the energy hogging problems of crypto? It would be the new money, goodbye fiat, everything would change!

Well a lot of the same players are cashing in on AI, but I'm sure the UFO will show up any day now.

hard_times | 2026-02-17 23:53 UTC
I wholeheartedly agree. Doesn't look organic at all. Guess it's the quality of Hacker News these days: blog spam.
bigbuppo | 2026-02-18 00:54 UTC
Wait until you find out most of the comments are shitposts.
judah | 2026-02-18 00:05 UTC
I upvoted it after reading it. I thought there were a number of amusing, counter-intuitive studies in the post. Worth the read.
dcminter | 2026-02-18 00:24 UTC
Same; I liked it so much I added it to my rss feed reader so I don't miss future posts.
dooglius | 2026-02-18 00:37 UTC
Explained in the very first sentence, "This is the quarterly links ‘n’ updates post, a selection of things I’ve been reading and doing for the past few months."
joemi | 2026-02-18 02:25 UTC
I missed that sentence too. I guess the large heading starting with "(1)" drew my eyes first and felt like the natural place to start reading, while the short sentence or two above it in smaller text subconsciously felt skippable (and was skipped). Even when I went back to read the first sentence, I had to kind of force myself to read the stuff above the first large heading. How odd!
MarkusQ | 2026-02-17 23:29 UTC
Surprisingly many things seem to be spoiled by the "too many of the people being studied were actually other researchers trying to study the same thing" (or even more commonly, students being taught about the thing).

I suspect the ability to post/apply for jobs with AI "to study ___" has played a part in getting us into our present predicament. If only one researcher did it, the results would be negligible, but if a significant number try it, all those negligibles add up.

smsm42 | 2026-02-18 00:55 UTC
There's a common joke that defines psychology as the scientific discipline studying the undergraduate psychology students. That is obviously due to the fact that a lot of research subjects are found where it's easiest to find them - right on campus, and a lot of people who have time and desire to participate in studies (instead of, you know, working) are the students themselves.
clickety_clack | 2026-02-18 01:48 UTC
I heard there’s a requirement to participate in the studies if you’re in some psychology undergrads.
maxbond | 2026-02-18 01:51 UTC
I don't know about the others referenced in the article or what else you might be referring to, but that wasn't the case with When Prophesy Fails or the Stanford Prison Experiment though. That was more or less fraud. The researchers put their thumb on the scale significantly.
MarkusQ | 2026-02-18 01:56 UTC
Oh yeah. I'm not saying that's the only way things can go off the rails. But with regard to "When Prophesy Fails" specifically, TFA says:

"A new paper finds a different story in the archives of the lead author, Leon Festinger. Up to half of the attendees at cult meetings may have been undercover researchers. One of them became a leader in the cult and encouraged other members to make statements that would look good in the book."

nicbou | 2026-02-17 23:45 UTC
Experimental History is such a consistently pleasant read. It's one of the few publications I read religiously.
zahlman | 2026-02-18 02:51 UTC
This is the first I've heard of it but I was very impressed. Multiple outbound links captured my attention.
jongjong | 2026-02-17 23:53 UTC
You can never know if/when an unraveling event will occur.

A problem may be real but you can't know what the resolution will be or when it will come, if ever. The problem (or feeling of doom or whatever) could disappear on its own without even being acknowledged. Also, you could have identified a valid symptom but not the root cause. You could die before the problem is acknowledged by others. The problem could just affect you and people like you and not be universal.

A related concept in economics is "The market can remain irrational longer than you can remain solvent."

If you think a UFO is coming to destroy you, you might be vaguely right in a metaphorical sense that a complex system (or some mysterious adversary) is coming to crush you and your tribe in the next few years due to mysterious reasons though it's not going to be a literal UFO, it may feel like a UFO because you can't fully explain the approaching force but you can feel it intensifying. Without sufficient info and intelligence, the mind will try to transform complex problems that it cannot fully grasp into simple concepts that it can understand and that you can react to and communicate with your tribe (that they can also understand).

A UFO may be a metaphor for a powerful, mysterious, hidden adversary whose capabilities you do not understand. In any case, the correct response is to prepare, hide and flee.

themafia | 2026-02-18 00:38 UTC
> so what we remember is not exactly what we saw.

Yet there are savants with nearly perfect recall which has been tested multiple times. I strongly doubt there is a single model for memory or even a single mechanism for forming memories and as a result personal understandings of it poorly generalize across any random section of the population.

stavros | 2026-02-18 01:32 UTC
99.9% of people understood that sentence to be correct, in the spirit in which it was written. Yet there are people who don't, but we still wouldn't say the sentence is false.
themafia | 2026-02-18 02:48 UTC
> but we still wouldn't say the sentence is false.

Yes "we" do. It's false. It's false not because it's a lie but because it's very poorly worded and under specified. Inside of a work attempting to communicate a highly specific idea it's a genuine mistake. It invites ambiguity and misunderstanding.

> 99.9% of people

Good for them. What's the point here? Are you attempting to bully me by suggesting I'm not part of your crowd?

> in the spirit in which it was written.

Uh huh. And what spirit are you writing in?

pnw | 2026-02-18 00:53 UTC
IDK how many people on HN have read When Prophecy Fails, but it's a seminal paper as I understand it. If you want a more contemporary and readable book on the same topic, When Prophecy Never Fails: Myth and Reality in a Flying-Saucer Cult by Diana Tumminia is very readable and covers the same ground.

Super interesting to see the original research challenged.

jacquesm | 2026-02-18 00:57 UTC
> And remember, this kind of effect is supposed to be so robust and generalizable that we can deploy it in court.

This goes for a lot of things that are utter bullshit. Lie detectors, handwriting, many others and the big bad bogeyman of the court: statistics.

Eyewitnesses being unreliable is one thing, but expert witnesses believing their own bs should be a liability if they are found to be wrong after the fact.

wildzzz | 2026-02-18 00:58 UTC
For the DCA noise complaints, a household (probably the same one as 2015) submitted 19000 complaints in 2016. That's 52 times a day or 3-4 per waking hour.
dylanpyle | 2026-02-18 02:20 UTC
Reminds me of this stat from the NYT: in 2022, “Nearly a third of all shoplifting arrests in New York City […] involved just 327 people”

https://www.nytimes.com/2023/04/15/nyregion/shoplifting-arre...

bigbuppo | 2026-02-18 01:08 UTC
One of the more recent "the UFO is coming" events were those people that sold their houses and traveled around in RVs because they thought the rapture was happening on a specific date... or at least that was the message. Turns out most of them just sort of liked the idea of selling their houses and traveling around in RVs.
Animats | 2026-02-18 01:57 UTC
Mandatory XKCD: https://xkcd.com/1235/

It's interesting that the proliferation of cell phone cameras has not improved the quality of UFO reports much.

Nor has the availability of automatic UFO-spotting cameras.[1] They pick up drones, flocks of birds, and the International Space Station. But no good UFO shots.

LINEAR and GEODSS, which find near-earth objects and satellites using a pair of large telescopes at each site, have been running for decades, somehow don't seem to be picking up UFOs.

[1] https://www.space.com/spotting-ufos-sky-hub-surveillance