<p>I'm going to assume that you mean courses in which face to face presence is required, as opposed to MOOCs in which it is not. </p>

<p>There isn't likely to be much true <em>research</em> on such things, partly due to the recentness of their creation, but mostly due to the difficulty of formulating and answering appropriate questions. What data there is is pretty scattered and is subject to taint by financially interested parties. </p>

<p>However, opinion surveys are available, as well as reports by interested but not <em>financially interested</em> groups. </p>

<p>A set of reports can be found here:
<a href="https://www.coursereport.com/resources/research-reports" rel="nofollow noreferrer">https://www.coursereport.com/resources/research-reports</a></p>

<p>Kyle Thayer and Andrew Ko recently interviewed a collection of students concerning  barriers faced by bootcamp students: <a href="http://www.kylethayer.com/assets/papers/BarriersFacedByCodingBootcampStudents-Thayer-Ko.pdf" rel="nofollow noreferrer">http://www.kylethayer.com/assets/papers/BarriersFacedByCodingBootcampStudents-Thayer-Ko.pdf</a>. The study is small and so not definitive. It is also situated in time as these things change. </p>

<p>Of course, an online search for "value of programming bootcamps" will bring you a lot of opinions, but little research. The wisdom seems to be that bootcamps are good for making you better at your current job than they are for helping you move into a new profession. Employers may downplay the value of a bootcamp for valid or invalid reasons, but it still falls on the individual. If your resume shows no success in the new field, a bootcamp isn't likely to help you much. </p>

<p>But that is just another opinion, of course. </p>

<p>Still more opinion, but possibly useful: <a href="https://www.bloomberg.com/news/features/2016-12-06/want-a-job-in-silicon-valley-keep-away-from-coding-schools" rel="nofollow noreferrer">https://www.bloomberg.com/news/features/2016-12-06/want-a-job-in-silicon-valley-keep-away-from-coding-schools</a></p>

CC BY-SA 3.0
2017-09-19T13:42:28.393Z
2017-09-19T14:43:25.103Z
2017-09-19T14:43:25.103Z
Buffy
<p>There's not much out there, unfortunately, and what there is is either suspect or sparse.</p>

<ul>
<li>CIRR has probably created the <a href="https://cirr.org/data" rel="nofollow noreferrer">best data that we have</a>, as they engage in 3rd-party verification. These results are actually rather positive for the industry, although participation is voluntary, and there aren't many Bootcamps that participate.</li>
<li>The US Federal Government created the EQUIP initiative to convince schools to provide government-quality data in return for student attendees being eligible for financial aid.  <a href="https://www.ed.gov/news/press-releases/fact-sheet-ed-launches-initiative-low-income-students-access-new-generation-higher-education-providers" rel="nofollow noreferrer">Only five organizations</a> qualified.  While I have been unable to locate the data itself, I would presume that those five organizations are probably fairly good.</li>
<li><a href="https://www.coursereport.com/resources/research-reports" rel="nofollow noreferrer">Course Report</a> is an independent organization that creates an annual survey of outcomes, and it shows consistently good results for Bootcamps nationally, but all of the results are self-reported, so they are not entirely trustworthy.  Also, the organization is very obviously friendly to the industry itself, with founders and employees who attended bootcamps themselves. Their "reports" simply <a href="https://www.coursereport.com/reports/2016-coding-bootcamp-job-placement-demographics-report" rel="nofollow noreferrer">look and read like ad copy</a>.</li>
<li>There is a recent initiative by <a href="https://www.wsj.com/articles/coding-boot-camps-band-together-to-boost-accountability-1488364381" rel="nofollow noreferrer">the schools themselves</a> to create more accountability, presumably in order to counteract rumors that the institutions are <a href="http://www.nclnet.org/coding_bootcamp_claims_the_truth_behind_the_numbers" rel="nofollow noreferrer">simply fraudulent diploma-mills</a>.</li>
</ul>

<p>If you are considering a Bootcamp, I would strongly recommend only considering schools that have good results with CIRR, as that will both discourage fraud, and encourage Bootcamps to partipate in the process.</p>

CC BY-SA 3.0
2017-09-15T14:30:49.773Z
2017-09-15T14:36:56.010Z
2017-09-15T14:36:56.010Z
Ben I.
<p>Bootcamps have become an increasingly popular alternative for starting or transitioning to a career in tech over the past 5 years or so. As a result, a common question I get when interacting with beginners is whether bootcamps are indeed worth it.</p>

<p>Unfortunately, after conducting some preliminary research myself, I found it challenging to find hard data that supports a conclusion either way. Most online sources (such as <a href="https://www.coursereport.com/" rel="noreferrer">coursereport.com</a>) seem very marketing-y and don't seem to analyze the more existential question of whether bootcamps are a good idea in the first place, compared to other options. And of course, there are plenty of anecdotes, but anecdotes are not data.</p>

<p>Analyzing this situation is complicated by several other factors:</p>

<ol>
<li>Bootcamps may be suitable for some, but not all: for example, professionals with an unrelated degree trying to <em>transition</em> to tech vs high school graduates trying to <em>enter</em> tech.</li>
<li>The quality of individual bootcamps can vary wildly (but then again, I suspect, though cannot confirm, the quality of university CS degrees can also vary just as wildly).</li>
<li>Bootcamps are incentivized to report skewed data. Even something as simple as "% of people who graduate with a job" can be complicated. (If the bootcamp hires you back as a TA, does that count? What if you get a job in a non-tech field? What if you get a job after a year of additional self-study?).</li>
</ol>

<p>This brings me to my core question: <strong>What research has been conducted so far regarding how effective bootcamps are at helping their attendees obtain a full-time job in tech in a timely manner?</strong></p>

<p>For this question, we can assume that the bootcamp attendees are people who either have completed a degree in an unrelated major and want to switch careers, or are people who are unable to attend a university for one reason or another.</p>

<p>An ideal answer would be links + summaries to reports that conduct a careful, measured, and data-driven analysis and seem to take into consideration factors like the ones I listed up above. I would prefer papers that have been accepted by a reputable, peer-reviewed academic journals or conferences if at all possible. </p>

<p>A nice bonus would be if the reports compared bootcamp success rates to other methods of switching careers (for example, getting a second degree or simply self-studying), but this isn't necessary.</p>

<p>For example, here is <a href="http://www.kylethayer.com/assets/papers/BarriersFacedByCodingBootcampStudents-Thayer-Ko.pdf" rel="noreferrer">one paper</a> that satisfies the above requirements. It'll apparently be presented at the upcoming <a href="https://icer.hosting.acm.org/icer-2017/schedule/" rel="noreferrer">ACM ICER conference</a> later this month and draws some interesting conclusions -- the paper's main limitation is its relatively small datasize (it tracks only 26 students within a specific geographical location IIRC).</p>

CC BY-SA 3.0
2017-08-14T15:04:25.897Z
This sounds like a good subject for a debate rather than this forum. Perhaps you could talk to Prof Regis at U Washington to see what might be arranged for the next SIGCSE conference. I'd guess that there are many people near you who have tried each path and it would be interesting to see what they have to say.
Buffy
CC BY-SA 3.0
2017-08-14T15:07:50.547Z
@nocomprende -- while that's true, I'm mainly interested in helping beginners who are evaluating their options right now and don't have the luxury of waiting another half-decade or two for bootcamps to become more of a known quantity. In particular, I guess I'm looking primarily for data to help people make informed decisions -- analysis and comparison is a nice bonus, but probably unnecessary.
Michael0x2a
CC BY-SA 3.0
2017-08-14T17:30:51.443Z
@nocomprende *"If bootcamps are terrible, they will fail and disappear."* They will only fail and disappear if people like us do the research and spread the word that they are terrible.
Kevin Workman
CC BY-SA 3.0
2017-08-14T17:32:44.477Z
I would also love to see a study on bootcamps, but I'm afraid it's even more complicated than your question. For example, you really need to factor in the **quality** of the job that's guaranteed by the bootcamp. I've seen more than a few bootcamps that end up just being cleverly disguised recruiters for data entry jobs. "Learn how to be an engineer!" "Now fill out these spreadsheets for 8 dollars an hour." That is technically a full-time position, but it's not what was promised. That's the real danger to be aware of, IMHO.
Kevin Workman
<resource-request><adult-education>
Independent research on bootcamp job placement claims
# Independent research on bootcamp job placement claims

(Asked by: username_0 on 2017-08-13)

Bootcamps have become an increasingly popular alternative for starting or transitioning to a career in tech over the past 5 years or so. As a result, a common question I get when interacting with beginners is whether bootcamps are indeed worth it.

Unfortunately, after conducting some preliminary research myself, I found it challenging to find hard data that supports a conclusion either way. Most online sources (such as [coursereport.com](https://www.coursereport.com/)) seem very marketing-y and don't seem to analyze the more existential question of whether bootcamps are a good idea in the first place, compared to other options. And of course, there are plenty of anecdotes, but anecdotes are not data.

Analyzing this situation is complicated by several other factors:

1. Bootcamps may be suitable for some, but not all: for example, professionals with an unrelated degree trying to *transition* to tech vs high school graduates trying to *enter* tech.
2. The quality of individual bootcamps can vary wildly (but then again, I suspect, though cannot confirm, the quality of university CS degrees can also vary just as wildly).
3. Bootcamps are incentivized to report skewed data. Even something as simple as "% of people who graduate with a job" can be complicated. (If the bootcamp hires you back as a TA, does that count? What if you get a job in a non-tech field? What if you get a job after a year of additional self-study?).

This brings me to my core question: **What research has been conducted so far regarding how effective bootcamps are at helping their attendees obtain a full-time job in tech in a timely manner?**

For this question, we can assume that the bootcamp attendees are people who either have completed a degree in an unrelated major and want to switch careers, or are people who are unable to attend a university for one reason or another.

An ideal answer would be links + summaries to reports that conduct a careful, measured, and data-driven analysis and seem to take into consideration factors like the ones I listed up above. I would prefer papers that have been accepted by a reputable, peer-reviewed academic journals or conferences if at all possible.

A nice bonus would be if the reports compared bootcamp success rates to other methods of switching careers (for example, getting a second degree or simply self-studying), but this isn't necessary.

For example, here is [one paper](http://www.kylethayer.com/assets/papers/BarriersFacedByCodingBootcampStudents-Thayer-Ko.pdf) that satisfies the above requirements. It'll apparently be presented at the upcoming [ACM ICER conference](https://icer.hosting.acm.org/icer-2017/schedule/) later this month and draws some interesting conclusions -- the paper's main limitation is its relatively small datasize (it tracks only 26 students within a specific geographical location IIRC).

**Tags:** resource-request, adult-education

> **Comments:**
> **username_1**: This sounds like a good subject for a debate rather than this forum. Perhaps you could talk to Prof Regis at U Washington to see what might be arranged for the next SIGCSE conference. I'd guess that there are many people near you who have tried each path and it would be interesting to see what they have to say.  
> **username_0**: @nocomprende -- while that's true, I'm mainly interested in helping beginners who are evaluating their options right now and don't have the luxury of waiting another half-decade or two for bootcamps to become more of a known quantity. In particular, I guess I'm looking primarily for data to help people make informed decisions -- analysis and comparison is a nice bonus, but probably unnecessary.  
> **username_2**: @nocomprende *"If bootcamps are terrible, they will fail and disappear."* They will only fail and disappear if people like us do the research and spread the word that they are terrible.  
> **username_2**: I would also love to see a study on bootcamps, but I'm afraid it's even more complicated than your question. For example, you really need to factor in the **quality** of the job that's guaranteed by the bootcamp. I've seen more than a few bootcamps that end up just being cleverly disguised recruiters for data entry jobs. "Learn how to be an engineer!" "Now fill out these spreadsheets for 8 dollars an hour." That is technically a full-time position, but it's not what was promised. That's the real danger to be aware of, IMHO.  

---

## 2 answers

### Answer by username_3 on 2017-09-15. Score: 3

There's not much out there, unfortunately, and what there is is either suspect or sparse.

* CIRR has probably created the [best data that we have](https://cirr.org/data), as they engage in 3rd-party verification. These results are actually rather positive for the industry, although participation is voluntary, and there aren't many Bootcamps that participate.
* The US Federal Government created the EQUIP initiative to convince schools to provide government-quality data in return for student attendees being eligible for financial aid. [Only five organizations](https://www.ed.gov/news/press-releases/fact-sheet-ed-launches-initiative-low-income-students-access-new-generation-higher-education-providers) qualified. While I have been unable to locate the data itself, I would presume that those five organizations are probably fairly good.
* [Course Report](https://www.coursereport.com/resources/research-reports) is an independent organization that creates an annual survey of outcomes, and it shows consistently good results for Bootcamps nationally, but all of the results are self-reported, so they are not entirely trustworthy. Also, the organization is very obviously friendly to the industry itself, with founders and employees who attended bootcamps themselves. Their "reports" simply [look and read like ad copy](https://www.coursereport.com/reports/2016-coding-bootcamp-job-placement-demographics-report).
* There is a recent initiative by [the schools themselves](https://www.wsj.com/articles/coding-boot-camps-band-together-to-boost-accountability-1488364381) to create more accountability, presumably in order to counteract rumors that the institutions are [simply fraudulent diploma-mills](http://www.nclnet.org/coding_bootcamp_claims_the_truth_behind_the_numbers).

If you are considering a Bootcamp, I would strongly recommend only considering schools that have good results with CIRR, as that will both discourage fraud, and encourage Bootcamps to partipate in the process.


---

### Answer by username_1 on 2017-09-19. Score: 1

I'm going to assume that you mean courses in which face to face presence is required, as opposed to MOOCs in which it is not.

There isn't likely to be much true *research* on such things, partly due to the recentness of their creation, but mostly due to the difficulty of formulating and answering appropriate questions. What data there is is pretty scattered and is subject to taint by financially interested parties.

However, opinion surveys are available, as well as reports by interested but not *financially interested* groups.

A set of reports can be found here:
<https://www.coursereport.com/resources/research-reports>

Kyle Thayer and Andrew Ko recently interviewed a collection of students concerning barriers faced by bootcamp students: <http://www.kylethayer.com/assets/papers/BarriersFacedByCodingBootcampStudents-Thayer-Ko.pdf>. The study is small and so not definitive. It is also situated in time as these things change.

Of course, an online search for "value of programming bootcamps" will bring you a lot of opinions, but little research. The wisdom seems to be that bootcamps are good for making you better at your current job than they are for helping you move into a new profession. Employers may downplay the value of a bootcamp for valid or invalid reasons, but it still falls on the individual. If your resume shows no success in the new field, a bootcamp isn't likely to help you much.

But that is just another opinion, of course.

Still more opinion, but possibly useful: <https://www.bloomberg.com/news/features/2016-12-06/want-a-job-in-silicon-valley-keep-away-from-coding-schools>


---

