Recent Updates Toggle Comment Threads | Keyboard Shortcuts

  • stefano 11:32 am on February 28, 2014 Permalink | Reply
    Tags: firenze, ge, nuovo pignone   

    Old and new, big Italian engineering 

    Steam turbine being delivered from Firenze

    Steam turbine being delivered from Firenze

    My brother sent me this image of a steam turbine shipped from GE plant in Firenze (aka Nuovo Pignone) to a customer. It’s so cool to see massive, modern, mechanic equipment being shipped around the world with Brunelleschi’s masterpiece of Italian engineering in the background.

     
  • stefano 10:30 am on February 26, 2014 Permalink | Reply
    Tags: , , fork, libreoffice,   

    Sustainability of Open Source software communities beyond a fork: How and why has the LibreOffice project evolved?

    via Sustainability of Open Source software communities beyond a fork: How and why has the LibreOffice project evolved?.

     
  • stefano 10:21 pm on February 24, 2014 Permalink | Reply
    Tags:   

    The quest to sustainable development of free software 

    A few articles on the topic of how to sustain development of free/libre software caught my attention lately:

    It’s a hard problem, especially when you compare the revenues of a Red Hat selling “free as in freedom” software with the insane amount of money that can be made developing software that enslaves and sells users to advertisers. On the other hand, I know of a good amount of people making a living (and saving for the rainy days) while respecting users freedoms.

     
  • stefano 2:29 pm on February 5, 2014 Permalink | Reply
    Tags: , gender, , , , profile, sex   

    Tracking gender diversity in the OpenStack developer community 

    The OpenStack Foundation has always tried to increase genders diversity in our community: we joined the Outreach Program for Women, established clear policies for our summits and in general we’ve been actively promoting good behavior across the board. A few weeks ago I realized that we were lacking of a decent way to track our progress in gender diversity in the OpenStack developer community and decided to improve the situation.

    When Anne asked me for the number of women or non-male developers in OpenStack, I realized that we don’t have that number. When people register to become OpenStack developers they need to become members of OpenStack Foundation and have an account on Launchpad. Neither of them track gender information. The best number I had to offer was the t-shirt kind requested at our Summits. If you don’t measure it you can’t improve it, the saying goes. So we thought we need to offer the option for Foundation’s members to tell us their gender, if they want to. How do we ask for gender without being disrepectful to non-binary genders?

    We did some research, discussed them on the bug and adapted the best practices to our case. We wanted to keep the choice short and not to offend anybody by leaving out options. An open entry form leads to hard to use data (people have very creative ways to spell just about anything), using pronouns would have made translations a nightmare. We need a way to restrict options so we can easily count them in the database so the binary options male/female were set first and ‘Prefer not to say’ was soon added as another option, since it’s really not mandatory to disclose that information. For non-binary genders using “Non-binary” sounded too geeky to me; using ‘other’ sounds weird, borderline offensive. We came to a consensus on my suggestion to have an open entry prefixed by “Let me tell you”. I liked this phrase because I feel like “Let me tell you” empowers the member to own their own gender definition. The new form is now live so you can now register or edit your OpenStack Member profile and add your gender (if you want to).

     
  • stefano 1:02 pm on January 20, 2014 Permalink | Reply
    Tags: ,   

    Why people contribute to OpenStack 

    A few days ago, I asked 55 OpenStack developers why they decided to submit one patch to OpenStack and what prevented them from contributing more. The sample polled people who contributed only once in the past 12 months, looking for anecdotal evidence for what we can do to improve the life of the occasional contributor. To me, occasional contributors are as important as the core contributors to sustain the growth of OpenStack in the medium/long term. Since it’s possible that the community has already already hired the best candidates among Python developers and system operators, to sustain the growth of OpenStack we need to tap into the wider Python community and experts of large distributed systems coming from other languages (Java, for starters). Knowing what hurdles new contributors face when they first join OpenStack is a first step to make onboarding easier and multiple contributions more frequent.

    People who replied are for the most parts users of OpenStack, that is developers and dev-ops people working on deployments of OpenStack for internal usage and system integrators who develop and deploy OpenStack for their customers. A third group of occasional contributors are developers of projects that use or are used by OpenStack, like Docker or Ceph.

    The top reasons to submit a patch went from the practical convenience of having patches maintained upstream, to fixing bugs (discovered during a proof of concept or in more advanced phases of a deployment) or to add/fix funcionalities to better integrate OpenStack with other projects. Finally, people contribute patches for personal growth and to enrich resumes.

    Why don’t they submit more? There are three main stumbling blocks. Legal hurdles delayed contributions, and even prevented (at least) one. The reasons for the delays range from NDAs with customers to incompatibility with corporate policies to release software under open source license and sign a Corporate Contributor License Agreement. Another group of reasons for the delay is the long time it takes for contributions to travel the review queue. The time it takes for patches to get in OpenStack repositories was mentioned more than once. Finally, the lack of simple issues to fix in the spare time: apparently the community fixes simple bugs too rapidly.

    The results cannot be considered representative but they seem to confirm that legal hurdles and speed of the reviews are preventing more casual contributions. While there are already many discussions on how to improve reviewing times, changing the way we handle contributions legally requires a massive endeavour to change OpenStack Foundation’s bylaws. The fact that simple issues to fix are hard to find is new to me: it may indicate that there are lots of people joining the community fixing these ‘low hanging fruits’ or something else. I think more analysis is needed in this area.

     
    • everett_toews 11:39 am on January 23, 2014 Permalink | Reply

      What? Nobody fessed up and admitted it was to get a free pass to the Summit?

      • stefano 4:24 pm on January 23, 2014 Permalink | Reply

        Surprising :) But no, I confirm, nobody mentioned that :)

    • tadowguy 6:32 pm on January 24, 2014 Permalink | Reply

      One of the reasons Ubuntu Harvest (http://harvest.ubuntu.com/) was created was to highlight easy opportunities for people to work on in Ubuntu. While it never reached it’s full potential, I think the theory is good. Perhaps a tool like it would help?

      • stefano 6:39 pm on January 24, 2014 Permalink | Reply

        I didn’t know about Harvest, thanks for bringing it up. One comment I heard is that the ‘low hanging fruit’ bugs are solved too rapidly for casual contributors to find/fix them or there are not enough bugs tagged properly.

    • twitter_tadowguy 6:41 pm on January 24, 2014 Permalink | Reply

      @Stefano, sorry I failed to include this before, took me a few minutes to find it, but look at this time to fix chart, it’s basically approaching zero.

      http://activity.openstack.org/dash/newbrowser/browser/its.html

      Last week I had a bug that I’d been working on (and was assigned to me) “taken” when someone submitted code that marked it as fixing it. I worked with the developer who ended up fixing it, but it was frustrating.

  • stefano 10:05 am on January 13, 2014 Permalink | Reply
    Tags: , , , recruiting   

    Exploring why people contribute to OpenStack 

    No doubt that OpenStack is one of the largest open source development efforts existing at the moment, with Linux, Debian and few others.  What can be improved to make the OpenStack community grow faster? How can we help new contributors become productive more rapidly?

    Whatever dimension you look at, the growth of the OpenStack developers community is astonishing. I’ve looked at the reasons for this growth and I’ve identified four main causes summarized in my presentation at Linux Conf North America and Open World Forum in Paris last year:

    • One clear mission to solve a hard problem
    • One initial core team with strong motivation to solve that problem
    • One team dedicated to recruiting new team members
    • One clear path to onboard new members in the team

    The first two points are pretty clear already and don’t seem to need much tweaking: those ain’t broken, so no need to fix’em. The other two are not broken either but they’re the kind of stuff you want to stay on top of because once you notice they’re broken, the cost to fix them will be higher. Recently I started to ask myself what margins of improvements there are in recruiting and onboarding new members in our communities.

    I quickly realized that while we know a lot about the top contributors to OpenStack, we don’t know much about the ‘long tail’ of contributors. It’s fairly easy to understand why the people responsible for 80% of OpenStack code and documentation work on the project. But who are the occasional contributors and what are their motivations to join the community? I embarked on a quest to get to know this long tail in an effort to understand how we can improve recruiting and onboarding new developers.

    After a conversation with Asheesh Laroia, of OpenHatch fame, I selected 55 random developers from the list of those who submitted a single change to the integrated OpenStack programs during the past 12 months. These people went through quite a huge chunk of trouble only to submit one single patch: besides learning enough of the quite complex OpenStack code, they had to sign the Individual CLA (maybe the Corporate CLA, too), learn about git review and the other tools, go through the code review process. I would expect that whoever goes through that process, does it with the intention to stick around. So I asked the sample two simple questions:

    • What made you decide to submit a patch to OpenStack?
    • What prevented you to submit more patches?

    I’ll wait a few days for their answers and share more details. Feel free to answer the questions leaving a comment here, too.

     
    • Kevin Fox 9:14 am on January 14, 2014 Permalink | Reply

      I’ve been trying to contribute since October. Ran into major issues with the contributor agreement. Mailing list posting here:
      http://lists.openstack.org/pipermail/legal-discuss/2013-November/000101.html

      Motivations for contribution back include:

      Giving back patches to the community as a small payment for receiving so much.
      Getting recognition for the patches we are using internally in our lab.
      Upstreaming of our patches so we do not have to port them on every updated release.

      I have not contributed yet, or was prevented from writing a few other patches due to the CLA really not fitting our situation. Our organization has, after years of effort, figured out how to release software open source. The org has not ever ran into a project that needed a CLA though, and it may take several more years for it to come to grips with them. The OpenStack project itself does not have a CLA that fits the situation either. The legal team is reviewing the issue and is working on it, but it is very slow going.

      IMO, the CLA has been a very high hurtle that projects like the Linux Kernel have very successfully gotten away without.

      • stefano 9:48 am on January 14, 2014 Permalink | Reply

        Thank you Kevin. Your case is indeed a painful one, I apologize for it. I wish the next Board of Directors at the end of January will evaluate a solution.

  • stefano 9:24 am on December 11, 2013 Permalink | Reply
    Tags: activity, bitergia, grimoire, , stackalytics, wikidsmart   

    How not to use OpenStack Community Metrics tools 

    I have noticed this morning another article/blog post mistakenly trying to extrapolate hard facts about a company’s involvement in OpenStack using one of the reporting tools built for the community. The reporter went to Stackalytics (but it could have gone to Activity Board, it would have been the same) to check if Oracle had made any contribution to the OpenStack codebase. That’s the wrong way to use these tools: numbers regarding companies contributing to OpenStack published daily cannot be trusted.

    Both Stackalytics and Activity Board depend on data that is entered voluntarily by the contributors to OpenStack, therefore they cannot be trusted. Stackalytics has a mapping file in its repository that is kept up to date by developers themselves (those that know its existence). Activity Board pulls data straight from the OpenStack Foundation Members database: when you sign up as Member of the Foundation (a precondition to become a developer) you’re asked to enter data about who pays for your contribution. The bylaws of the Foundation also require that you keep that info up to date, but we know as a fact that few people log back in their member profile and even fewer update their affiliation. Therefore we know that the data about the affiliation in all reporting tools is not 100% reliable at any point in time. It’s good enough if you’re looking at the top contributing companies where the volumes are high enough to remain fairly valid despite small percentage errors. But when a reporter goes to check if a total newcomer to the community has submitted any code, that number is very likely to be wrong (and close to zero): the new developers may have not understood what the Affiliation field is and not filled it out (I see a lot of those on a weekly basis) and they’re very unlikely to know about the mapping file in git for Stackalytics.

    The data that I trust most (but still not 100%, especially for ‘long tail’ contributors) are the reports published with Bitergia at release time: every OpenStack release we do a lot of manual cleanup of the data in the Foundation database, ask people to update their affiliation, normalize names of companies and circulate the report for comments before making them public. Still, those may contain errors which we track on Launchpad.

    As far as I know the reporter didn’t ask the Foundation nor Oracle if anybody could point at actual commits done by Oracle employees and that’s what he should have done.

    OpenStack prouds itself for being an open community and I’ve been the first proposer of having a public way to see the various activities inside the project, in real time and including the information about companies, not just individuals. I think we need to discuss how we can provide better data and avoid giving false illusion of precision to casual visitors to these sites.

     
    • Ryan Lane 7:19 am on December 12, 2013 Permalink | Reply

      I think this is a reasonable use of the tools. If a company doesn’t have their affiliation information up to date then they need to get that fixed. The company can then post information showing that they are indeed contributing.

      The onus of properly updated metrics for an organization needs to be on the organization and not on the person using the metrics. Untrustable metrics aren’t useful metrics.

      Maybe there’s something we can do to make the process less error prone for people contributing to get their affiliations correct?

      • stefano 10:11 am on December 12, 2013 Permalink | Reply

        I think the main problem with delegating responsibilities to companies is that they have very few tools to fix the issue themselves. Neither I think it’s fair to ask newcomers to do yet another thing (set the mapping file in stackalytics or something else) before they can commit code or file a bug: it’s already too hard to start interacting with OpenStack. I think we need to find a better way.

        One line of thoughts I have is to create the concept of ‘group’ and ‘sub-groups’ in our members database and tie such concept to the Corporate Contributor License Agreement. I think it deserves a blog post on its own. The basic idea is that the person who manages a development team at, say, IBM, instead of signing the Corporate CLA on Echosign and provide the list of authorized committers on the same platform, creates a group on the ID.openstack.org service and assigns to that group the individual members of his/her development team. This will also simplify the management of the Corporate CLA. It won’t solve 100% of the issues of people/companies who participate in other activities that is not managed via gerrit though.

    • Herman Narkaytis 9:15 am on December 21, 2013 Permalink | Reply

      Just a couple of notes on Stackalytics affiliation rules.
      1. Here is a description of algorithm https://wiki.openstack.org/wiki/Stackalytics#Company_affiliation
      It is not only about manually mantained mapping file. Mapping file is maintained directly by contributors. The main source of affilation data is emails from commits info. If commit is signed with hnarkaytis@mirantis.com, then affilation is evident.
      2. There are 701 conributors profiles for Icehouse at the moment. 97 (13.8%) are classified as *independent. The rest 600+ contributors are affilated according email’ domains or mapping file. *independent contributors made only 7% of all commits. There is a regular mail compain for *independent contributors, that ensure that all of them are aware about their affilation. Top 10 *independent (50%+ of commits) contributors confirmed their affiliation via email. This means that maximum error of measurment is about 3%.

      As core contributor of Stackalytics I can confirm that affilations are not 100% correct. Confidence interval for all measurments is 3%.
      Issue that you raised is valid and we gonna put an official disclamer on landing page.

      • stefano 5:47 pm on December 23, 2013 Permalink | Reply

        You’re right, Herman, I forgot to mention that there are heuristics that help ‘guessing’ the highest percentage of commit attributions.

  • stefano 3:09 pm on November 20, 2013 Permalink | Reply
    Tags: ask, askbot, ,   

    How to get new questions on Ask OpenStack via email 

    Email is still one of the best mechanism to get push notifications, so getting automatic nudges via email from Ask OpenStack is useful. I took some time to document how to get an email message every time a new question is asked on Ask OpenStack.

    The core of the configuration is available on the personal profile page. In my case the URL is https://ask.openstack.org/en/users/9/smaffulli/?sort=email_subscriptions: hit your username in the top navigation bar and then pick ‘subscriptions‘. The page will look like the screenshot below.

    Selection_001

    Askbot email settings

    As of today Ask OpenStack gets around 10 new questions per day and the rate is increasing steadily. I highlighted the configuration that can help you prevent getting too many emails: select the frequency of the notifications want to get notifications first in the line “Entire forum (tag filtered)”. Then set the tag filter: I picked “only subscribed tags”. You can modify the tags you want to receive notifications from the form at the bottom of the page:

    Selection_004

    Add tags you’re interested in to this form

    Tags are added by the person asking the question and can be edited by anybody with karma higher than 100. On the same subscriptions page there is also a setting to receive notifications for questions asked in Chinese languages.

    On Ask OpenStack home page there are also ways to customize the site further, hiding questions carrying ignored tags from the view or highlighting interesting ones

    Selection_002

    Further configuration options on Ask OpenStack home page

     

     
  • stefano 4:55 pm on November 18, 2013 Permalink | Reply
    Tags: , , hong kong, , summary,   

    Wrap-up post OpenStack Summit in Hong Kong 

    Back from busy days in one of the most exciting cities I’ve ever visited, I needed some time to put thougths back in order, recover from jet lag and deal with my irremediably broken WordPress installation (will probably blog about this later, too). Hong Kong was a blast in many aspects. The Summit itself started with lions dancing at the sound of drums in front of over 3,000 people:

    And then we saw that Bejing is the first city by total number of contributors to OpenStack in the whole world:

    There has been an incredible growth inside and around OpenStack, the project is growing fast. Growth is good, it’s what we wanted so we have plenty of reasons to celebrate. The second edition of the User Survey brought us more insights about usage of OpenStack around the world. We announced our first OpenStack Ambassadors, people who will help the OpenStack Community team get closer to many communities around the world. It was great to meet personally more women from the Outreach Program for Women of OpenStack. we’ve been doing this for over a year now, it’s a thing.

    IMG_20131111_204451Growth also brings challenges and some of them were evident in some of the conversations had at the Summit, around it and after. A few signals I caught during and around the Design Summit sessions highlighted that we may need to start taking new steps to reinforce the culture of collaboration inside the project. The challenges highlighted go from lack of reviewers (not core reviewers, just developers who pay attention and help others), PTLs getting overloaded, the high traffic on the Development mailing list (which leads to loss of information), the increasing number of questions on Ask OpenStack with no interactions (no up/down votes, comments, etc) and little engagement in its Chinese version, the challenges inside the Internationalization Team with processes and tools. We’ve also heard of a very few Design sessions where it was too hard to have a productive discussion because of one or two uncollaborative people.

    Since we’re getting so many new developers in the project we’re probably getting to the point where we can’t assume they are accustomed to contributing upstream first. The founders and first members of OpenStack all had a brilliant pedigree of open source contributions and collaboration. New members of the OpenStack Foundation may need some help to succeed. I enjoyed the session Getting Your Blueprint Accepted Quicker: the VPNaaS Use Case so much that I’m proposing the Upstream University training as an official program at the OpenStack Foundation to help new members. I’ll write more about this in the future.

    The next six months will continue to be super exciting and full of things to do. If you have missed Hong Kong go watch the recordings of the sessions  keep watching this space for more news.

     

     
  • stefano 3:57 pm on October 31, 2013 Permalink | Reply
    Tags: , h264, mpegla, , , webrtc   

    Cisco, Mozilla, and H.264 

    Let’s state the obvious with respect to VP8 vs H.264: We lost, and we’re admitting defeat. Cisco is providing a path for orderly retreat that leaves supporters of an open web in a strong enough position to face the next battle, so we’re taking it.

    via Monty Montgomery.

     
c
compose new post
j
next post/next comment
k
previous post/previous comment
r
reply
e
edit
o
show/hide comments
t
go to top
l
go to login
h
show/hide help
shift + esc
cancel