<blockquote>
<p>a) What is the definition of completeness?</p>
</blockquote>
<hr />
<p>Completeness is the number of objects in a data set that are detected over the number that exist.  In astronomy, completeness is often estimated for a particular apparent magnitude or flux density.  As an example, for sources that are as bright as the Sun (-27 magnitude), we have a completeness of 1.  That is, we’ve discovered all sources in the celestial sphere with the Sun’s magnitude.  As we get down to very dim objects like tiny pieces of space junk in Earth orbits, our completeness ratio drops dramatically.</p>
<blockquote>
<p>b) How do you calculate the completeness of an observation?</p>
</blockquote>
<hr />
<p>On a <a href="https://en.wikipedia.org/wiki/Receiver_operating_characteristic" rel="nofollow noreferrer">ROC curve</a>, completeness is the True Positive Rate or the y-axis if all the objects have been observed (thanks @ProfRob!). If only a fraction of the objects have been observed, completeness is that fraction times the true positive rate. Note that a classifier only yields better completeness at the cost of higher false positive rates.  <a href="https://www.astroml.org/book_figures/chapter9/fig_star_quasar_ROC.html" rel="nofollow noreferrer">Here</a> is an excellent example of ROC curves for different algorithms which differentiate quasars from stars:</p>
<blockquote>
<p>The left panel shows data used in color-based photometric
classification of stars and quasars. Stars are indicated by gray
points, while quasars are indicated by black points. The right panel
shows ROC curves for quasar identification based on u - g , g - r , r - i
, and i - z colors.</p>
</blockquote>
<p><a href="https://i.sstatic.net/DyBvr.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/DyBvr.png" alt="enter image description here" /></a></p>
<p>If you don’t know the true positive rate, you may be able to run a simulation in which you inject objects into your data set and determine what portion of these are found by your algorithm.  This will give you an estimate of your completeness.  Matlab has a specific <a href="https://www.mathworks.com/help/phased/ug/monte-carlo-roc-simulation.html" rel="nofollow noreferrer">function for ROC curve Monte Carlo simulation</a>, for example.</p>

CC BY-SA 4.0
2021-01-26T00:07:20.580Z
The true positive rate only tells you the completeness of your sample if you've observed all the objects. e.g. I work on cluster membership and can produce ROC curves. They do not tell me how complete my sample is. For that I need to know what fraction of objects were observed.
ProfRob
CC BY-SA 4.0
2021-01-26T07:11:51.503Z
Thank you for your comment! I have a follow-up question. How does one simulate the data? I expect something like: 1. removing real sources from the data leaving just the noise and artifacts, 2. injecting fake sources. How does one find the correct distribution for 2. and does the source's morphology play a role? (if possible an answer in the radio astronomy context would be best).
kelpfish
CC BY-SA 4.0
2021-01-26T16:28:19.667Z
@kelpfish You are quite welcome!  In my opinion, your follow-up question exceeds the scope of the comment section.  I would suggest posing it as a separate Astronomy Stack Exchange Question.
Connor Garcia
CC BY-SA 4.0
2021-01-25T17:37:50.337Z
2021-01-26T16:22:32.253Z
2021-01-26T16:22:32.253Z
Connor Garcia
<p>Many publications write about &quot;completeness&quot;. I have a vague idea that it has to do with the ratio of how many sources from an observation are detected and how many sources are actually in that field. However, can someone please explain to me:</p>
<p>a) What is the definition of completeness?<br />
b) How do you calculate the completeness of an observation?</p>
<p>As an example: Smolčić et al. 2008 are writing about completeness. Please have a look at <a href="http://adsabs.harvard.edu/abs/2008ApJS..177...14S" rel="nofollow noreferrer">A New Method to Separate Star-forming from AGN Galaxies at Intermediate Redshift: The Submillijansky Radio Population in the VLA-COSMOS Survey</a></p>

CC BY-SA 4.0
2021-01-25T15:25:07.590Z
I was going to ask for a block quote from where "completeness" appears in the linked paper, but it occurs *27 times!* For example; "Section 4.1.2. Completeness and contamination due to the photometric selection"
uhoh
<observational-astronomy><sky-survey><definition>
What is the completeness of an observation and how do I calculate it?
kelpfish
# What is the completeness of an observation and how do I calculate it?

(Asked by: username_0 on 2021-01-25)

Many publications write about "completeness". I have a vague idea that it has to do with the ratio of how many sources from an observation are detected and how many sources are actually in that field. However, can someone please explain to me:

a) What is the definition of completeness?  
b) How do you calculate the completeness of an observation?

As an example: Smolčić et al. 2008 are writing about completeness. Please have a look at [A New Method to Separate Star-forming from AGN Galaxies at Intermediate Redshift: The Submillijansky Radio Population in the VLA-COSMOS Survey](http://adsabs.harvard.edu/abs/2008ApJS..177...14S)

**Tags:** observational-astronomy, sky-survey, definition

> **Comments:**
> **username_1**: I was going to ask for a block quote from where "completeness" appears in the linked paper, but it occurs *27 times!* For example; "Section 4.1.2. Completeness and contamination due to the photometric selection"  

---

## 1 answers

### Answer by username_2 on 2021-01-25. Score: 5

> a) What is the definition of completeness?

---

Completeness is the number of objects in a data set that are detected over the number that exist. In astronomy, completeness is often estimated for a particular apparent magnitude or flux density. As an example, for sources that are as bright as the Sun (-27 magnitude), we have a completeness of 1. That is, we’ve discovered all sources in the celestial sphere with the Sun’s magnitude. As we get down to very dim objects like tiny pieces of space junk in Earth orbits, our completeness ratio drops dramatically.

> b) How do you calculate the completeness of an observation?

---

On a [ROC curve](https://en.wikipedia.org/wiki/Receiver_operating_characteristic), completeness is the True Positive Rate or the y-axis if all the objects have been observed (thanks @username_3!). If only a fraction of the objects have been observed, completeness is that fraction times the true positive rate. Note that a classifier only yields better completeness at the cost of higher false positive rates. [Here](https://www.astroml.org/book_figures/chapter9/fig_star_quasar_ROC.html) is an excellent example of ROC curves for different algorithms which differentiate quasars from stars:

> The left panel shows data used in color-based photometric
> classification of stars and quasars. Stars are indicated by gray
> points, while quasars are indicated by black points. The right panel
> shows ROC curves for quasar identification based on u - g , g - r , r - i
> , and i - z colors.

[![enter image description here](https://i.sstatic.net/DyBvr.png)](https://i.sstatic.net/DyBvr.png)

If you don’t know the true positive rate, you may be able to run a simulation in which you inject objects into your data set and determine what portion of these are found by your algorithm. This will give you an estimate of your completeness. Matlab has a specific [function for ROC curve Monte Carlo simulation](https://www.mathworks.com/help/phased/ug/monte-carlo-roc-simulation.html), for example.

> **Comments:**
> **username_3**: The true positive rate only tells you the completeness of your sample if you've observed all the objects. e.g. I work on cluster membership and can produce ROC curves. They do not tell me how complete my sample is. For that I need to know what fraction of objects were observed.  
> **username_0**: Thank you for your comment! I have a follow-up question. How does one simulate the data? I expect something like: 1. removing real sources from the data leaving just the noise and artifacts, 2. injecting fake sources. How does one find the correct distribution for 2. and does the source's morphology play a role? (if possible an answer in the radio astronomy context would be best).  
> **username_2**: @username_0 You are quite welcome!  In my opinion, your follow-up question exceeds the scope of the comment section.  I would suggest posing it as a separate Astronomy Stack Exchange Question.  

---

