Survey is now closed!

Thank you to all who took part in the survey and also all who have helped out along the way. This has been some incredible journey!

Here are a few numbers to summarize how well the survey went.

About 1000 people took part in the survey among which 354 individuals provided full survey answers. A 35% completion rate is rather high as online surveys are overall known for suffering from low completion rate issues.

Here is the distribution of the survey responses per project (The number on the left is the number of full responses per project and the one on the right, the total number of responses including incomplete ones):

  • Debian: 70 /164
  • Fedora39 / 75
  • FreeBSD: 20 / 55
  • Gentoo: 14 / 33
  • GNOME: 44 / 94
  • KDE: 40 / 106
  • Mozilla: 22 / 50
  • NetBSD: 14 / 26
  • openSUSE: 17 / 89
  • Python: 16 / 34
  • Ubuntu: 46 / 245
  • Wikimedia: 12 / 27

59 countries are represented, the top 3 countries being the US (60 responses), Germany (37), and India (29).  342 people reported their gender among which 39 are women. The age distribution is as follows:

ageDistrib

I have just shifted from New Zealand to France where I am about to start an academic position at Toulouse Business School. I will be starting the analysis of the data by the beginning of January and will be keeping people posted.

Survey update after 1 week

There has been a lot of enthusiasm around the survey. numbers have been steadily increasing everyday.

I thank all who wrote posts about the survey in addition to all who helped out spread the word through social media.

Until today (15/11/12), there has been a total of 148 responses (out of 482 total responses). By full response, I mean people who filled in the four pages of the survey. All questions are optional (so no question is compulsory) but it is obviously better to answer all of them in order for me to be able to run more stats and get some more accurate analysis.

Here is the breakdown of the responses per project:

  • Debian28 full responses (from 65 responses)
  • FreeBSD – joined the survey today! Welcome :)
  • Gentoo - 2 full responses (from 11 responses)
  • GNOME - 28 full responses (from 63 responses)
  • KDE - 25 full responses (from 61 responses)
  • Mozilla - 12 full responses (from 27 responses)
  • NetBSD - 2 full responses (from 6 responses)
  • OpenSUSE - 13 full responses (from 43 responses)
  • Ubuntu - 38 full responses (from 206 responses)

Keep spreading the word, the survey is still live!

Here is the current of posts that promote the survey and/or describe the research project (We are still working on getting more posts):

  1. http://blog.lydiapintscher.de/2012/11/08/guest-post-newcomer-experience-in-kde-and-other-foss-communities-survey/
  2. http://news.opensuse.org/2012/11/07/newcomer-experience-in-opensuse-and-other-foss-communities-survey/
  3. http://blogs.gnome.org/gnomg/2012/11/07/newcomer-experience-survey/
  4. http://blogs.gnome.org/marina/2012/11/07/newcomer-experience-survey/
  5. http://blogs.gnome.org/bolsh/2012/11/14/community-citizenship-survey/
  6. http://upsilon.cc/~zack/blog/posts/2012/11/Debian_newcomer_experience_survey/
  7. http://blogs.gnome.org/bolsh/2012/11/14/community-citizenship-survey/
  8. https://openhatch.org/blog/2012/a-research-project-to-understand-what-does-it-take-to-retain-newcomers/
  9. https://www.linux.com/news/software/applications/666038-survey-how-important-is-newcomer-experience-in-free-open-source-software-projects
  10. http://www.muktware.com/4803/survey-newcomer-experience-and-contributor-behavior-foss-communities
  11. http://www.h-online.com/open/news/item/Newcomer-experience-survey-for-open-source-communities-1748936.html
  12. https://silicone.homelinux.org/~julien/gregarius/index.php
  13. http://blog.mozilla.org/about_mozilla/2012/11/
  14. http://www.ubuntublog.byethost12.com/?tag=kevin-carillo
  15. http://www.omgubuntu.co.uk/2012/11/scholarly-open-source-research
  16. http://www.ubuntuvibes.com/2012/11/take-part-in-foss-community-survey.html

Survey is live!

The final survey for the project about newcomer experience and citizenship in FOSS communities is now live.

If you have joined one of the following FOSS communities within the last 3 years (after January 2010): Debian, GNOME, Gentoo, KDE, Mozilla, Ubuntu, NetBSD, or OpenSUSE, I would like to invite you to complete an online survey. I am interested in hearing from people who are either technical or non-technical contributors, and who have had either positive or negative newcomer experiences.

The survey is available at:

https://limesurvey.sim.vuw.ac.nz/index.php?sid=65151&lang=en

Some more information about the project and the survey HERE.

What does a good FLOSS community citizen do?

To investigate the notion of citizenship in the particular context of FLOSS communities, I conducted some interviews with individuals from a range of communities such as Ubuntu, Debian, GNOME, KDE, Gentoo, Mahara, and WordPress.

The questions were not about defining of citizenship in the specific context of FLOSS as this is not the main objective of this research. This project adopts a practical view, it is instead about what a good FLOSS citizen does within a given community. What does he or she do so that the community might say: “this person is a ‘good’ citizen”. The answer is not trivial and obviously depends on the perception of people but at least it is possible to identify some of the behaviours that are beneficial for a community and that falls under the umbrella of citizenship.

The interviews revealed a set of six such behaviours that are interpersonal help, conscientiousness, considerateness, civic virtue, boostering, and behavioural compliance. The chosen terms are arguable as I have tried to find words or terms that would best encompass the aspect I have identified during the interviews. I have to admit that some of them could certainly be better named, I would appreciate any suggestion or feedback.

Interpersonal help

Helping others is perhaps the essence of FLOSS communities. I define here interpersonal help as the extent to which a member voluntarily performs actions aimed at helping other community members who have expressed their need for project-related help.

Helping is a bit of a subjective term and one may be tempted to see everything that happens in a community as instances of help.  What I call interpersonal help are things such as people who are always ready to lend a hand to members who have expressed a need for help. I could be about providing an answer to a question which deals with an area for which we are an expert and if this is not the case then redirecting the person to someone who is an expert. This is then some sort of reciprocal acknowledgement between two people  that one needs some sort of help in a project and the other one agrees to help.

Conscientiousness

There is a difference between doing the job and doing a good job. This is where conscientiousness takes place. I define it as the extent to which a member performs actions and carries out tasks in a dependable and reliable way by being careful, thorough, responsible, and organized.

Under this type of behaviour falls things such as taking your tasks and roles seriously and trying to do your best each time you are carrying out any type of assignment.  Conscientiousness also characterizes important aspects in FLOSS communities such as regularly informing the community about one’s work and progress and also letting the community know when one is not able to perform or complete a given assignment. A conscientious FLOSS community member is also one who voluntarily perform maintenance tasks to keep project resources to a good standard. I refer here to tedious   tasks for which one rarely get credit such as cleaning code or documentation.

Considerateness

Most communities’ code of conduct (inspired from the Ubuntu code of conduct) recognize the act of being considerate as an highly valued quality for a member. I define Considerateness in this project as the extent to which a member performs actions by always being aware of other people that could be affected and by taking into account the potential consequences of his/her actions on other community members.

Being considerate involves thinking beyond oneself when contributing to a project. It is associated with the awareness of the people surrounding you and how your contributions will impact them and their work. A considerate community member would always consult people who might be affected by his or her actions or decisions,would try to avoid creating problems for other members when contributing to the project, and would take steps to try to prevent problems caused by his or her contributions with other members.

Civic virtue

There is a sense of civic responsibility when being a community member. We could define such sense as a responsible and constructive involvement in the life of a FLOSS community, including expressing opinions and taking part in decisions, attending/partaking in social events, and keeping updated about issues that involve the overall project and the areas in which the member is involved.

It is first important for a member to keep up with the latest development and announcements about the overall project as well as in the areas in which the member is involved. The is a sense of civic responsibility is also expressed when members attend and partake in social events organized by the community such as conferences, hackfests, or sprints. Finally, expressing opinions and taking part in decisions is also some important matter. However, such participation must be constructive and effective. In other words one shall express his or her opinion way when it deals to an area for which the person an expert but the member shall also keep it quiet when a discussion or debate does not deal with an area which is clearly understood by the person.

Finally, someone with a high sense of civic responsibility would abide by any decision that has been made  for which the person either agrees or even disagrees, accept it, and act accordingly.

Boostering

The interviews showed that aspects such as “improving image outside of the project” or “advocating a project outside” were emphasized by most respondents. As a respondent pointed out “if you are a true passionate citizen then naturally you will be talking about the project in good terms and spread your passion to other people, promoting it to others”.

I define boostering here to encompass all above aspects by using the following definition: the extent to which a member acts with the best interest for a FLOSS community and promotes its image to outsiders.

Improving the image of a project starts with defending the project when a person inside or outside the community criticizes it. It is then about encouraging friends, colleagues, and family to use the software developed in the community and promoting the project to the outside world. Overall, such a passionate member always acts and contributes with the best interest for the community.

This list of behaviours is certainly not exhaustive but it is a step further towards understanding what FLOSS communities need from their members to ensure their success. This could also help FLOSS projects reflect on the actual code of conduct and encompass some of the aspects presented in this blog post.

How to turn a FLOSS community newcomer into a good community citizen?

For those who are wondering about what my PhD project is about, here are a few insights and a brief description about what I am working on.

Attracting newcomers, …Ok. But that’s not enough!

A number of FLOSS communities have realized that attracting new members had become crucial to ensure the success and survival of communities.

There is a large array of newcomer initiatives to help recruit new people within FLOSS communities and turn them into regular contributors. The Google Summer of Code is an obvious example of such initiative. Since its beginning in 2005, SoC has been gaining momentum year after year, this year it was announced that 1,212 proposals were accepted in 180 organizations. Other forms of mentoring (formally or formally) also do happen and are now becoming common practice.

There are also other initiatives such as the use of newcomer sub-communities such as Gnome Love, Debian Mentors, Kernel Mentors and Newbies. Some communities rely on a very formal process to enrol new members relying on sponsorship mechanisms and a fixed joining process or procedure such as the Debian New Member process. There are a lot more other initiatives that I am not aware of.

Attracting newcomers is indeed important but the position adopted in my research is that this is not a sufficient condition to ensure the success and prosperity of a project.

FLOSS communities need good citizens.

Certain communities are growing at a very fast pace. I reckon OpenStack is among such communities as it is gaining a lot of attention and popularity throughout the world. There seems that have been a lot of positive feedback about the OpenStack community success at the latest Openstack design summit-conference 2012.

However, it is highly risky for a community that attracts a large number of contributors as it is important to make sure that new members fit the community mold. Indeed, if a community looses control and a lot of new members do not comply to the code of conduct, commit stuff without considering the people or projects/modules being affected by the commit, do not attend any of the community events, do not help any other members, and are not in any way reliable or dependable in their contributions … The community is in great danger. As such behaviours will keep spreading.

So, yes … it is important to attract newcomers but a community needs to make sure that a certain proportion of these newcomers become ‘good’ contributors from the community perspective. ‘Good’ in the sense that they shall contribute to the well-being and growth of the community, ‘good’ as good community citizens.

This is one of the important aspects of my research. I try to define what a good FLOSS community citizen does for a community. I try to define what good citizenship behaviour is and what it is not.

What do FLOSS community newcomers really experience?

FLOSS communities have launched a wide array of more or less initiatives to attract newcomers and turn them into regular contributors but it seems that the other side of the coin is less understood by communities: the actual newcomer experience. What are the different types of such experience? How can we characterize it? Is there a way to measure such experience?

This is the second important aspect of my research. I am trying to develop a model of newcomer experience that would allow me to measure the various aspects of newcomer experience and compare the various types of experiences.

Abracadabra. How to turn a community newcomer into a good community citizen?

The overall objective of my research project is thus about linking newcomer experience to citizenship behaviours in the context of FLOSS communities:

What are the various aspect of a FLOSS newcomer experience that generate citizenship behaviours within the community?

The answer to this question will help FLOSS communities in implementing practices and processes that will engender and nurture such behaviours. Down the line, it will help communities to be ‘healthier’ and ensure their survival.

Until today, answers to the following questions are still not clear:  How are the contributions and the behaviour of a new member affected if he or she has received formal mentoring by one or several experienced members? What about if the new member has been actively involved in a newcomer sub-community? What is the impact of the quiz-based approach used by communities such as Debian and Gentoo? Is a fixed joining process beneficial in generating good community citizens?

I sincerely hope this research project will help in answering some of these questions and will overall contribute to the well-being of FLOSS communities.