OKCupid Admits to Experiments with Users

If you find this useful please share it!



 

OKCupid is the latest online company to admit that it experimented on its users. However, in this instance one can make the case that experimenting was necessary in order to get their online dating matching algorithms right. And they weren’t intentionally trying to influence their users’ emotions, like Facebook did.

Also, most of their experiments took the form of system-wide (and therefore user-wide) experiments. For example, with the launch of their wildly unpopular “blind date” app, they removed all photos from the site for 7 hours. So everyone was still on a level playing field.

However, not all of their experiments were user-wide, which suggests that at some point, as an OKCupid user, you have had a better than 0 chance that you were part of an experiment that singled you out. For example, in one experiment, to see as between your profile pictures and your text, which receives more weight, OKC used a small sample of their users’ profiles, and half the time that they showed the profile they hid the text, so that only the pictures were displayed. That had the effect of creating two different sets of scores for each profile, one score for the “picture only” version, and one for the “picture and text” version.


 

And guess what they discovered? Perhaps not surprisingly, 90% of what people respond to is your profile pictures.

In a long, and very open [Page no longer available – we have linked to the archive.org version instead], OKCupid co-founder Christian Rudder explains that “We noticed recently that people didn’t like it when Facebook “experimented” with their news feed. Even the FTC is getting involved. But guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

(Article continues below)
Read Internet Patrol Articles Right in Your Inbox
as Soon as They are Published! Only $1 a Month!

Imagine being able to read full articles right in your email, or on your phone, without ever having to click through to the website unless you want to! Just $1 a month and you can cancel at any time!
OKCupid Admits to Experiments with Users
Or get notified of new Internet Patrol articles for free!

In another not system-wide experiment, to see whether the very existence of high match numbers could influence people to be more predisposed to like each other, OKCupid intentionally displayed inflated match percentage numbers between people. So, for example, if Joe and Jane were really only a 30% match, the system told them that they were a 90% match. They also did it in the other direction, deflating match scores that were actually much higher.


 

Using a benchmark of “exchanged at least four messages” (as that is a metric that OKC says indicates the likelihood of a good match, or at least some compatibility), OKCupid found that it all evened out – if people were told they were only a 30% match, but were really a 90% match, they still got to that four message threshold, in nearly the same numbers as if they were told they were a 90% match and actually were a 90% match.

That said, it seems to us that users may have completely passed over someone they were led to believe was a 30% match but was really a 90% match. But that said, OKC makes a point of saying that “Once the experiment was concluded, the users were notified of the correct match percentage.”

The full [Page no longer available – we have linked to the archive.org version instead] makes for very interesting (and amusing) reading.

We’d love to hear from you readers on this question: do you think that what OKCupid did is comparable to what Facebook did, or more or less acceptable?

No Paywall Here!
The Internet Patrol is and always has been free. We don't hide our articles behind a paywall, or restrict the number of articles you can read in a month if you don't give us money. That said, it does cost us money to run the site, so if something you read here was helpful or useful, won't you consider donating something to help keep the Internet Patrol free? Thank you!

OKCupid Admits to Experiments with Users

Get notified of new Internet Patrol articles!

If you find this useful please share it!

Leave a Reply

Your email address will not be published. Required fields are marked *