<p>This is obviously a very open ended question, but so as to stay on topic, here is one CS theory approach to the idea of "fairness" and how to enforce it.</p>

<p>"Fairness Through Awareness" Dwork, Hardt, Pitassi, Reingold, Zemel
<a href="http://arxiv.org/abs/1104.3913" rel="nofollow">http://arxiv.org/abs/1104.3913</a></p>

CC BY-SA 3.0
2012-01-31T03:53:47.940Z
2012-01-31T03:53:47.940Z
Aaron Roth
<p>Search engines are increasingly being relied on as information gatekeepers, yet the criteria used by search engines to rank results is opaque to users. How can users be sure their results aren't biased or tampered with in some way to benefit some interest at the expense of search result quality?</p>

<p>Governments routinely demand that search providers remove or lower the ranking of websites deemed politically undesirable. Businesses may pay providers to boost certain results over others to increase their revenues. Firewalls may meddle with results before they're transmitted back to users.</p>

<p>Even seemingly innocuous changes to ranking algorithms that might not on the surface appear to be biased, could actually be deviously designed to harm websites that share some common attribute (unrelated to actual quality).</p>

<p>Is it possible to detect search engine bias, by say monitoring results over a period of time and evaluating whether some "hidden variable" (perhaps a political affiliation) is a driving factor in the change in website rankings?</p>

<p>A sneaky provider may gradually over time lower the ranking of targeted websites (and perhaps random websites as well to distract users). What are the limits on how much bias a provider can introduce without detection? Or is it possible to always conceal such interference by deviously selecting weighted ranking criteria that incidentally produce the intended result (by way of "data snooping").</p>

<p>Does any of this change if the ranking criteria is made public? Do we need to open-source the criteria search engines use?</p>

<p>This reminds me of the result that detecting whether or not a complex financial instrument such as a CDO has been tampered with by the seller is equivalent to solving the densest-subgraph problem:</p>

<p><a href="http://www.cs.princeton.edu/~rongge/derivative.pdf">http://www.cs.princeton.edu/~rongge/derivative.pdf</a></p>

<p>Thanks!</p>

CC BY-SA 3.0
2012-01-31T01:25:16.193Z
this is a cool question, but I would revise it by making sure to only ask one cstheory related question. The most obvious is to make this a reference request and ask "has anyone already looked at this?". If you are sure nobody has, then something like "how can this be modeled formally?" might be a good question. If you keep too many questions around, with some of them being potentially non-cstheory related, then it might be closed as "not a real question".
Artem Kaznatcheev
CC BY-SA 3.0
2012-01-31T16:45:32.673Z
Note that making a ranking scheme public opens it up to attack by spammers. An interesting variant would be: "is there a 'public-key' equivalent for rankings"
Suresh Venkat
CC BY-SA 3.0
2012-01-31T18:13:43.357Z
@SureshVenkat "making a ranking scheme public opens it up to attack" sounds like you are suggesting <s>security</s> unbiasedness through obscurity ;).
Artem Kaznatcheev
CC BY-SA 3.0
2012-02-01T03:04:41.030Z
no, but that's why I asked about public-key versions of ranking schemes.
Suresh Venkat
CC BY-SA 3.0
2012-02-02T07:49:50.340Z
Since non of the parties participating in the search process are supposed to be malicious users, a normal solution is to model the process as a game with selfish users. If modeled correctly, we can find out whether it is beneficial for the search engines to do such a thing or not. Then we can design a mechanism to prevent such a tampering.
Helium
<ds.algorithms><data-mining>
Is there a way to detect search engine bias?
han d.
# Is there a way to detect search engine bias?

(Asked by: username_0 on 2012-01-31)

Search engines are increasingly being relied on as information gatekeepers, yet the criteria used by search engines to rank results is opaque to users. How can users be sure their results aren't biased or tampered with in some way to benefit some interest at the expense of search result quality?

Governments routinely demand that search providers remove or lower the ranking of websites deemed politically undesirable. Businesses may pay providers to boost certain results over others to increase their revenues. Firewalls may meddle with results before they're transmitted back to users.

Even seemingly innocuous changes to ranking algorithms that might not on the surface appear to be biased, could actually be deviously designed to harm websites that share some common attribute (unrelated to actual quality).

Is it possible to detect search engine bias, by say monitoring results over a period of time and evaluating whether some "hidden variable" (perhaps a political affiliation) is a driving factor in the change in website rankings?

A sneaky provider may gradually over time lower the ranking of targeted websites (and perhaps random websites as well to distract users). What are the limits on how much bias a provider can introduce without detection? Or is it possible to always conceal such interference by deviously selecting weighted ranking criteria that incidentally produce the intended result (by way of "data snooping").

Does any of this change if the ranking criteria is made public? Do we need to open-source the criteria search engines use?

This reminds me of the result that detecting whether or not a complex financial instrument such as a CDO has been tampered with by the seller is equivalent to solving the densest-subgraph problem:

<http://www.cs.princeton.edu/~rongge/derivative.pdf>

Thanks!

**Tags:** ds.algorithms, data-mining

> **Comments:**
> **username_1**: this is a cool question, but I would revise it by making sure to only ask one cstheory related question. The most obvious is to make this a reference request and ask "has anyone already looked at this?". If you are sure nobody has, then something like "how can this be modeled formally?" might be a good question. If you keep too many questions around, with some of them being potentially non-cstheory related, then it might be closed as "not a real question".  
> **username_2**: Note that making a ranking scheme public opens it up to attack by spammers. An interesting variant would be: "is there a 'public-key' equivalent for rankings"  
> **username_1**: @SureshVenkat "making a ranking scheme public opens it up to attack" sounds like you are suggesting <s>security</s> unbiasedness through obscurity ;).  
> **username_2**: no, but that's why I asked about public-key versions of ranking schemes.  
> **username_3**: Since non of the parties participating in the search process are supposed to be malicious users, a normal solution is to model the process as a game with selfish users. If modeled correctly, we can find out whether it is beneficial for the search engines to do such a thing or not. Then we can design a mechanism to prevent such a tampering.  

---

## 1 answers

### Answer by username_4 on 2012-01-31. Score: 3

This is obviously a very open ended question, but so as to stay on topic, here is one CS theory approach to the idea of "fairness" and how to enforce it.

"Fairness Through Awareness" Dwork, Hardt, Pitassi, Reingold, Zemel
<http://arxiv.org/abs/1104.3913>


---

