CI/CD
4 qualifying programs compared, 1 with only half a program.
Compare inside a category, not across the study. Two programs here face the same buyers and the same norms, so a difference between them means something. A difference between categories mostly measures the categories.
| Axis | GitHub | GitLab CI/CD | TeamCity | CircleCI |
|---|---|---|---|---|
| Overall | 78.06 axes | 64.45 axes | 55.65 axes | 41.75 axes |
| Transparency | 4.0 | 2.5 | 2.5 | 1.9 |
| Demand | 1.0 | 1.5 | 0.5 | 1.0 |
| Entry cost | 4.5 | 4.0 | 4.5 | 4.0 |
| Distribution | 4.0 | 4.0 | 3.0 | 2.0 |
| Economics | 5.0 | not applicable — nothing can be sold through this listing | not applicable — nothing can be sold through this listing | not applicable — nothing can be sold through this listing |
| Terms | 3.5 | 4.0 | 3.5 | 2.0 |
n/athe axis does not apply to that program — read it as “question not asked”, never as 0.
These programs are judged on different numbers of axes, so their totals are renormalized over different denominators and are not strictly comparable. The axis rows are.
Where they actually differ
22 of 30 checks diverge; 8 are identical across all 4| Check | GitHub | GitLab CI/CD | TeamCity | CircleCI |
|---|---|---|---|---|
| A2 Requirements numeric | published, and we read it | published, and we read it | we looked for it and it is not published | we looked for it and it is not published |
| A3 Reward numeric | published, and we read it | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| A5 Changes dated | published, and we read it | we looked for it and it is not published | published, and we read it | partly published |
| B3 Co-marketing specified | we looked for it and it is not published | partly published | we looked for it and it is not published | partly published |
| B4 Funding | partly published | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published |
| B5 Merchandising | partly published | published, and we read it | partly published | partly published |
| C1 No entry fee | published, and we read it | partly published | published, and we read it | published, and we read it |
| C3 Fast review | partly published | published, and we read it | partly published | partly published |
| C4 No annual fee | published, and we read it | partly published | published, and we read it | published, and we read it |
| C5 No paid tier gate | published, and we read it | published, and we read it | published, and we read it | partly published |
| D2 Earnable placement | partly published | published, and we read it | partly published | we looked for it and it is not published |
| D3 Analytics returned | published, and we read it | published, and we read it | we looked for it and it is not published | we looked for it and it is not published |
| D4 Listing control | published, and we read it | published, and we read it | partly published | we looked for it and it is not published |
| D5 Audience disclosed | partly published | we looked for it and it is not published | published, and we read it | published, and we read it |
| E2 They collect and remit | published, and we read it | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| E3 You set the price | published, and we read it | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| E4 Provisioning documented | published, and we read it | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| E5 Payout terms published | published, and we read it | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| F2 No broad IP grant | published, and we read it | published, and we read it | partly published | we looked for it and it is not published |
| F3 No clone reservation | we looked for it and it is not published | partly published | we looked for it and it is not published | partly published |
| F4 Fair termination | published, and we read it | published, and we read it | published, and we read it | we looked for it and it is not published |
| F5 You keep the customer | partly published | partly published | published, and we read it | partly published |
Show the 8 checks they all score the same
Agreement is a finding too: where every program in a category fails the same check, that is the category’s norm rather than one vendor’s oversight.
| Check | GitHub | GitLab CI/CD | TeamCity | CircleCI |
|---|---|---|---|---|
| A1 Guide public | published, and we read it | published, and we read it | published, and we read it | published, and we read it |
| A4 Rules of engagement | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published |
| B1 Lead share | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published |
| B2 Shared pipeline | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published | we looked for it and it is not published |
| C2 No submission fee | published, and we read it | published, and we read it | published, and we read it | published, and we read it |
| D1 Browsable directory | published, and we read it | published, and we read it | published, and we read it | published, and we read it |
| E1 Price visible on the listing | not applicable by rule | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish | not applicable — nothing can be sold through this listing, so there are no economics to publish |
| F1 No exclusivity | published, and we read it | published, and we read it | published, and we read it | published, and we read it |
Also in this category, not comparable
Padding the grid above with these would invent zero-scoring competitors. They are listed because leaving them out would quietly shrink the denominator and make the category look healthier than it is.
Half a program (1). A directory with no partner program, or a program with no public directory — scored on transparency only: Jenkins