This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
chaoss:metrics [2017/09/13 16:05] GeorgLink [CHAOSS OSS Project Metrics] remove links to google docs |
chaoss:metrics [2019/01/30 23:33] (current) GeorgLink remove much information |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | {{:chaoss:chaoss_logo_pantone_2_.png?200|}} | + | [[chaoss:start|<< Back to CHAOSS start page]] |
+ | |||
+ | {{:chaoss:chaoss_logo_pantone_2_.png?400|}} | ||
====== CHAOSS Metrics Committee ====== | ====== CHAOSS Metrics Committee ====== | ||
Line 5: | Line 7: | ||
The CHAOSS (Community Health Analytics OSS) Metrics Committee defines implementation-agnostic metrics for assessing open source communities' health and sustainability. The CHAOSS Metrics Committee goals are to establish implementation-agnostic metrics for measuring community activity, contributions, and health; and optionally produce standardized metric exchange formats, detailed use cases, models, or recommendations to analyze specific issues in the industry/OSS world. | The CHAOSS (Community Health Analytics OSS) Metrics Committee defines implementation-agnostic metrics for assessing open source communities' health and sustainability. The CHAOSS Metrics Committee goals are to establish implementation-agnostic metrics for measuring community activity, contributions, and health; and optionally produce standardized metric exchange formats, detailed use cases, models, or recommendations to analyze specific issues in the industry/OSS world. | ||
- | All contributions to implementation-agnostic metrics and standards, including associated scripts, SQL statements, and documentation, will be received and made available under the MIT License (https://opensource.org/licenses/MIT). | + | For more information, visit our repository: https://github.com/chaoss/metrics |
- | + | ||
- | ===== Events ===== | + | |
- | + | ||
- | + | ||
- | <WRAP center round tip 60%> | + | |
- | Join us at the **__Open Source Summit North America__** in Los Angeles: | + | |
- | + | ||
- | **Monday, September 11 • 11:00am - 11:40am**\\ | + | |
- | Open Development Analytics: A Step Forward in Project Transparency\\ | + | |
- | http://sched.co/Bsb2 | + | |
- | + | ||
- | **Monday, September 11 • 5:40pm - 6:20pm**\\ | + | |
- | BoF: Community Health Analytics for Open Source\\ | + | |
- | http://sched.co/BCsP | + | |
- | + | ||
- | **Tuesday, September 12 • 2:00pm - 4:00pm**\\ | + | |
- | Breakout room to continue the work from the BoF\\ | + | |
- | Diamond ballroom Salon 2 (~30 people) | + | |
- | + | ||
- | * The BoF and breakout session will go into detail on the //Project Growth - Maturity - Decline// metric to continue the currently ongoing conversation from the mailing list. [[https://lists.linuxfoundation.org/mailman/listinfo/oss-health-metrics|Join us on the mailing list now]]. | + | |
- | * {{ :chaoss:metrics:2017-09-12.bof2-ossna.chaoss.pdf |Slides}} | + | |
- | </WRAP> | + | |
- | + | ||
- | + | ||
- | Join us at the **__Open Source Summit Europe__** in Praque:\\ | + | |
- | **Tuesday, October 24 • 9:00am - 1:00pm**\\ | + | |
- | More details to follow | + | |
- | + | ||
- | + | ||
- | + | ||
- | ===== CHAOSS OSS Project Metrics ==== | + | |
- | As a community, we will initially focus on four OSS project metrics. The initial four metrics are complex, value-oriented metrics that explain a current state of CHAOSS member needs. The four metrics, and any metric thereafter, must not constructed in ways that incentivize problem behaviors within a community. The complex metrics are constructed from one or more activity metrics. Refer to our __[[https://github.com/chaoss/metrics/blob/master/activity-metrics.md|list of activity metrics]]__ for descriptions of activity metrics. | + | |
- | + | ||
- | If, as a community, we should be initially focusing on a different set of metrics, post your comments to the __[[https://lists.linuxfoundation.org/pipermail/oss-health-metrics/|mail list]]__. This list is flexible and expected to grow over time. We can definitely change our focus as the community sees fit. | + | |
- | + | ||
- | ---- | + | |
- | ---- | + | |
- | <WRAP group> | + | |
- | <WRAP half column> | + | |
- | + | ||
- | ==== 1) Project Diversity and Inclusion ==== | + | |
- | Diversity and Inclusion are known to challenge unchecked assumptions and lead to more open and fair collaboration practices. | + | |
- | + | ||
- | === -- Organizational Diversity === | + | |
- | Organizational diversity indicates the breadth of support an OSS community has by different organizations. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Bus Factor, | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contribution-diversity.md|Contribution Diversity]], | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contributor-breadth.md|Contributor Breadth]], | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contributor-diversity.md|Contributor Diversity]], | + | |
- | Decision Distribution, | + | |
- | Distribution of Work | + | |
- | + | ||
- | === -- Geographic Diversity === | + | |
- | Geographic Diversity indicates the global reach and inclusion of an OSS community. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Commit Bias (by region), | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contributor-breadth.md|Contributor Breadth]], | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contributor-diversity.md|Contributor Diversity]], | + | |
- | Decision Distribution, | + | |
- | Language Bias, | + | |
- | Unity, | + | |
- | Use of Acronym, | + | |
- | User Groups (by country) | + | |
- | + | ||
- | </WRAP> | + | |
- | + | ||
- | <WRAP half column> | + | |
- | + | ||
- | ==== 2) Project Growth - Maturity - Decline ==== | + | |
- | An OSS community goes has states: growth, maturity, and decline. The state that a community is in may prove important when evaluating both across and within community concerns. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Age of Community, | + | |
- | Apache Maturity Model, | + | |
- | CII Best Practices Badge, | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/community-activity.md|Community Activity]], | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contribution-acceptance.md|Contribution Acceptance]], | + | |
- | Contribution Age, | + | |
- | Contributor Activity, | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/contributors.md|Contributors]], | + | |
- | Dependency Depth, | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/forks.md|Forks]], | + | |
- | Gatherings, | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/issue-response-rate.md|Issue Response Rate]], | + | |
- | [[https://github.com/chaoss/metrics/blob/master/metrics/issues-submitted-closed.md|Issues submitted/closed]], | + | |
- | Onion Layers, | + | |
- | Project Life Cycle, | + | |
- | Relative Activity, | + | |
- | Release Maturity, | + | |
- | Release Velocity, | + | |
- | Roadmap, | + | |
- | Test Coverage, | + | |
- | Time to Contributor, | + | |
- | Update Rate, | + | |
- | Update Regularity, | + | |
- | User Groups | + | |
- | + | ||
- | </WRAP> | + | |
- | </WRAP> | + | |
- | + | ||
- | ---- | + | |
- | <WRAP group> | + | |
- | <WRAP half column> | + | |
- | ==== 3) Project Risk ==== | + | |
- | This informs how much risk an OSS community might pose. The evaluation of risk depends on situation and purpose. | + | |
- | + | ||
- | === -- License Risk === | + | |
- | License Risk indicates the licenses used by an OSS community, how well license declarations are provided throughout all files and whether potential license conflicts arise. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | All Licenses, | + | |
- | License Declared, | + | |
- | License Conflicts, | + | |
- | License Count, | + | |
- | License Coverage | + | |
- | + | ||
- | === -- Vulnerability Risk === | + | |
- | Vulnerability Risk indicates known vulnerabilities and how the community responds. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Bug Age, | + | |
- | Bugs after Release, | + | |
- | Known Vulnerabilities, | + | |
- | Release Note Completeness | + | |
- | + | ||
- | </WRAP> | + | |
- | + | ||
- | <WRAP half column> | + | |
- | ==== 4) Project Position within OSS Ecosystem ==== | + | |
- | Many OSS communities rely on and are used in other open source software, creating interdependence throughout an OSS ecosystem. | + | |
- | + | ||
- | === -- Upstream Reliance === | + | |
- | Upstream Reliance informs how much an OSS community relies on other open source software. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Dependency Depth | + | |
- | + | ||
- | === -- Downstream Use === | + | |
- | Downstream Use informs how many other OSS communities rely on the focal community. | + | |
- | + | ||
- | __Informed by activity metrics:__ | + | |
- | Dependency Depth | + | |
- | </WRAP> | + | |
- | </WRAP> | + | |
- | + | ||
- | ---- | + | |
- | ---- | + | |
- | ===== About Us ===== | + | |
- | + | ||
- | ==== Development Status ==== | + | |
- | The CHAOSS Project and the Metrics Committee is newly formed and was announced at the Open Source Summit North America on September 11th, 2017. The conversation about defining metrics is just beginning and we will continuously update the wiki based on the discussions we have. | + | |
- | + | ||
- | The conversation about metrics is occurring on our __[[https://lists.linuxfoundation.org/pipermail/oss-health-metrics/|mail list]]__ and at our __[[chaoss:metrics#monthly-call|monthly phone calls]]__. | + | |
- | + | ||
- | ==== License ==== | + | |
- | All contributions to implementation-agnostic metrics and standards, including associated scripts, SQL statements, and documentation, will be received and made available under the MIT License (https://opensource.org/licenses/MIT). | + | |
- | + | ||
- | ==== Contributor Guidelines ==== | + | |
- | The CHAOSS Metrics Committee is an open source project and welcomes all new contributors. | + | |
- | + | ||
- | <WRAP center round info 60%> | + | |
- | + | ||
- | ===== How to get involved ===== | + | |
- | + | ||
- | ==== How to get started ==== | + | |
- | * Join our __[[https://lists.linuxfoundation.org/mailman/listinfo/oss-health-metrics|mail list]]__ and introduce yourself. | + | |
- | * Look through the __[[https://lists.linuxfoundation.org/pipermail/oss-health-metrics/|mail list archive]]__ for past discussions and self-introductions of people involved. | + | |
- | * Put the next [[chaoss:metrics#monthly-call|monthly phone call]] on your calendar. | + | |
- | * Put the [[chaoss:metrics#weekly-hangout|weekly hangout]] on your calendar. | + | |
- | + | ||
- | ==== Challenging Problems ==== | + | |
- | * What are metrics being used for? | + | |
- | * Where have metrics been used (un-)successfully? | + | |
- | * What do metrics mean in different contexts? | + | |
- | * What combination of activity metrics are used in different contexts? | + | |
- | * What 'recipes' can we provide for using metrics? | + | |
- | + | ||
- | ==== How to contribute ==== | + | |
- | * Share your experience with metrics. | + | |
- | * Participate in the definition of metrics. | + | |
- | * Work on use cases for metrics. | + | |
- | * Join our weekly hangouts and monthly calls. | + | |
- | + | ||
- | </WRAP> | + | |
- | + | ||
- | + | ||
- | ===== Communication ===== | + | |
- | + | ||
- | ==== Mail list ==== | + | |
- | The __[[https://lists.linuxfoundation.org/mailman/listinfo/oss-health-metrics|mail list]]__ is the place for discussion and open for anyone to join. | + | |
- | + | ||
- | ==== Wiki ==== | + | |
- | This Wiki is the place for the metrics. | + | |
- | + | ||
- | ==== GitHub ==== | + | |
- | We will develop metrics in our [[https://github.com/chaoss/metrics/|GitHub repository]]. | + | |
- | + | ||
- | ==== Weekly Hangout ==== | + | |
- | Tuesdays, 12noon Central US Time. | + | |
- | + | ||
- | https://hangouts.google.com/hangouts/_/67zc3kvkovelxctlilphwodlp4e | + | |
- | + | ||
- | There is nothing formal with this hangout. Come and go as you please. It's just to provide a permanent and regular site for metrics discussion. Topics could include new metrics, how to interpret metrics, how metrics can be related to value, or whatever else you'd like to chat about. | + | |
- | + | ||
- | Feel free to stop by anytime! | + | |
- | + | ||
- | ==== Monthly call ==== | + | |
- | __//Next call:// Tuesday, October 3rd, 2017__\\ | + | |
- | Monthly, every first Tuesday from 13:00 to 13:50 (US Central Time) | + | |
- | Join from PC, Mac, Linux, iOS or Android: https://unomaha.zoom.us/j/609939109\\ | ||
- | Or Telephone:\\ | ||
- | Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) or __[[https://unomaha.zoom.us/zoomconference?m=DKGo2mmIuOv9xSjphoGZZmYKxr5HFrS9|International numbers]]__\\ | ||
- | Meeting ID: 609 939 109 | ||
- | ==== Minutes ==== | + | ==== Monthly Call Minutes (TODO: moved to chaoss/governance repository) ==== |
+ | * __[[http://ircbot.wl.linuxfoundation.org/meetings/chaoss-community/2018/chaoss-community.2018-08-07-16.01.html|2018-08-07 Meeting]]__ ([[https://www.youtube.com/watch?v=oLuQgOi6OM0|Video Recording]]) | ||
+ | * __[[http://ircbot.wl.linuxfoundation.org/meetings/chaoss-community/2018/chaoss-community.2018-07-10-16.02.html|2018-07-10 Meeting]]__ ([[https://www.youtube.com/watch?v=4DSqTqX-Ka8|Video Recording]]) | ||
+ | * __[[http://ircbot.wl.linuxfoundation.org/meetings/chaoss-community/2018/chaoss-community.2018-06-05-16.05.html|2018-06-05 Meeting]]__ ([[https://youtu.be/m66bLv8lJPo|Video Recording]]) | ||
+ | * __[[http://ircbot.wl.linuxfoundation.org/meetings/chaoss-community/2018/chaoss-community.2018-05-01-15.58.html|2018-05-01 Meeting]]__ ([[https://youtu.be/0J5QFkkkgRU|Video Recording]]) | ||
+ | * __[[chaoss:metrics:minutes:2018-04-03-meeting|2018-04-03 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2018-03-13-meeting|2018-03-13 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2018-02-06-meeting|2018-02-06 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2018-01-09-meeting|2018-01-09 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2017-12-05-meeting|2017-12-05 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2017-11-07-meeting|2017-11-07 Meeting]]__ | ||
+ | * __[[chaoss:metrics:minutes:2017-10-03-meeting|2017-10-03 Meeting]]__ | ||
* __[[chaoss:metrics:minutes:2017-09-05-meeting|2017-09-05 Meeting]]__ | * __[[chaoss:metrics:minutes:2017-09-05-meeting|2017-09-05 Meeting]]__ | ||
* __[[chaoss:metrics:minutes:2017-08-01-meeting|2017-08-01 Meeting]]__ | * __[[chaoss:metrics:minutes:2017-08-01-meeting|2017-08-01 Meeting]]__ | ||
* __[[chaoss:metrics:minutes:2017-07-11-meeting|2017-07-11 Meeting]]__ | * __[[chaoss:metrics:minutes:2017-07-11-meeting|2017-07-11 Meeting]]__ | ||
* __[[chaoss:metrics:minutes:2017-06-06-meeting|2017-06-06 Meeting]]__ | * __[[chaoss:metrics:minutes:2017-06-06-meeting|2017-06-06 Meeting]]__ | ||
- | * __[[chaoss:metrics:minutes:2017-05-02-formation-meeting|2017-05-02 Formation Meeting]]__ | + | * __[[chaoss:metrics:minutes:2017-05-02-formation-meeting|2017-05-02 Meeting]]__ |
- | * __[[chaoss:metrics:minutes:2017-04-18-formation-meeting|2017-04-18 Formation Meeting]]__ | + | * __[[chaoss:metrics:minutes:2017-04-18-formation-meeting|2017-04-18 Meeting]]__ |
- | * __[[chaoss:metrics:minutes:2017-04-04-formation-meeting|2017-04-04 Formation Meeting]]__ | + | * __[[chaoss:metrics:minutes:2017-04-04-formation-meeting|2017-04-04 Meeting]]__ |
- | * __[[chaoss:metrics:minutes:2017-03-21-formation-meeting|2017-03-21 Formation Meeting]]__ | + | * __[[chaoss:metrics:minutes:2017-03-21-formation-meeting|2017-03-21 Meeting]]__ |
- | ===== Sponsor ===== | + | ===== Sponsors ===== |
{{:chaoss:sponsor:sloan-logo-stacked-black-web.png?nolink&150|}} | {{:chaoss:sponsor:sloan-logo-stacked-black-web.png?nolink&150|}} | ||
+ | {{:chaoss:sponsor:moz-logo-bw-rgb.png?nolink&150|}} |