Examples

What WikiFix found in five public documentation sets

We loaded five public documentation sets into Confluence and ran WikiFix over them: NASA's Solar System pages, the GitLab handbook, the Sourcegraph handbook, the PostHog handbook, and the Apache Kafka docs with their improvement proposals. That is 8,247 pages, written by a lot of people over a lot of years. WikiFix found 683 places where pages give different answers to the same question. Here is a sample of 50: ten from each set. Under every answer is the sentence from the page that gives it, so you can check that the page says what the card says.

NASA Solar System

science.nasa.gov · 732 pages scanned · 57 places where pages disagree

Reference pages on the planets, moons and 158 Solar System missions: dense with numbers, units, approximations, tables and dated mission histories.

10 sample findings

In what year was Pluto reclassified as a dwarf planet?

2006: Pluto was long considered our ninth planet, but the International Astronomical Union reclassified Pluto as a dwarf planet in 2006.
– Pluto; …Pluto was reclassified as a dwarf planet in 2006 by the International Astronomical Union.
– Pluto: Facts; …the IAU reclassified Pluto as a dwarf planet in 2006.
– Pluto & Dwarf Planets
2016: Pluto was considered the ninth major planet in our solar system until the definition of “planet” was changed by the International Astronomical Union (IAU) in 2016.
– Hypothetical Planet X

What material is the Europa Clipper electronics vault made of?

Aluminum-zinc alloy: Europa Clipper's electronics are enclosed in a vault with walls made of 1/3-inch thick (9.2-mm) sheets of aluminum-zinc alloy to protect the electronics from Jupiter’s intense radiation.
– Meet Europa Clipper
Titanium and aluminum: The vault walls – made of titanium and aluminum – will act as a radiation shield against most of the high-energy atomic particles…
– Europa Clipper Mission Overview

The vault is what shields the spacecraft's electronics from Jupiter's radiation.

WikiFix finding: "What material is the Europa Clipper electronics vault made of?" – one page says "Aluminum-zinc alloy", one page says "Titanium and aluminum". Options to pick an answer, ask the page owner, or ignore.

GitLab Handbook

handbook.gitlab.com · 4,576 pages scanned · 332 places where pages disagree

A company handbook: policies, processes and procedures across engineering, security, sales, legal and people teams.

10 sample findings

Under what circumstances is a user allowed to wipe their own laptop?

Never: Under no circumstance should you be wiping your own laptop. Laptop wipes must be done from an IT Ops team member for logs.
– Offboarding FAQ
Only if IT requests for troubleshooting: Under no circumstance should you perform your own disk wipe unless you are doing so at the request of IT to troubleshoot a technical problem with the laptop.
– Laptop wipe (laptop management)

A security policy. "Never" and "only if IT asks" are different rules.

WikiFix finding: "Under what circumstances is a user allowed to wipe their own laptop?" – one page says "Never", one page says "Only if IT requests for troubleshooting". Options to pick an answer, ask the page owner, or ignore.

On which GitLab platforms is Snowplow deployed?

free and paid users of GitLab.com, Self-Managed and Dedicated versions: Applicable Software : Snowplow Metrics are collected from free and paid users of GitLab.com, Self-Managed and Dedicated versions of the Software.
– Customer product usage information
only on GitLab.com (not on self-managed instances): We do not use snowplow on our self-managed instances, only on GitLab.com
– Data model cheat sheet

The privacy page says self-managed sends events; the data team's page says it does not.

WikiFix finding: "On which GitLab platforms is Snowplow deployed?" – one page says "free and paid users of GitLab.com, Self-Managed and Dedicated versions", one page says "only on GitLab.com (not on self-managed instances)". Options to pick an answer, ask the page owner, or ignore.

Sourcegraph Handbook (archived July 2024)

github.com/sourcegraph/handbook · 901 pages scanned · 86 places where pages disagree

A company handbook: security policy, pay, support rules and engineering runbooks.

Sourcegraph archived this handbook on GitHub in July 2024 and moved it to Notion; most quotes here are from the archive.

10 sample findings

What is the invoice submission email address for Sourcegraph?

ap@sourcegraph.comp: Contractors submit an invoice at the end of each month (including any reimbursable and recurring expenses) via email to our accounting team, ap@sourcegraph.comp .
– How we engage talent outside of the US
ap@sourcegraph.com: All invoices should be sent via email to our accounting team, ap@sourcegraph.com All invoices will be paid through Airbase .
– Submitting an invoice (teammates based outside of US)

One character. Invoices sent to the first address don't arrive.

WikiFix finding: "What is the invoice submission email address for Sourcegraph?" – one page says "ap@sourcegraph.comp", one page says "ap@sourcegraph.com". Options to pick an answer, ask the page owner, or ignore.

Who may sign off an exception for a High or Medium risk with no reasonable treatment?

CTO: … In this case, an exception should be sought. Exceptions can only be signed off by the CTO.
– Security risk management process
risk committee: Exceptions must have the signoff from the risk committee on an individual basis.
– Information Security Risk Management Policy

The process page and the policy page name different people who can sign off a risk exception.

WikiFix finding: "Who may sign off an exception for a High or Medium risk with no reasonable treatment?" – one page says "CTO", one page says "risk committee". Options to pick an answer, ask the page owner, or ignore.

Apache Kafka docs and improvement proposals

cwiki.apache.org · 1,629 pages scanned · 168 places where pages disagree

An open-source project's wiki: design proposals, configuration names, protocols and APIs, written by many contributors over many years.

10 sample findings

Does Kafka's tiered storage feature support JBOD?

supports JBOD: JBOD support: Tiered storage feature also works in clusters configured with multiple log directories (i.e.
– Kafka Tiered Storage GA Release Notes
does not support JBOD: … storage. Topic created with the effective value for remote.storage.enable as true, can not change its retention policy from delete to compact. It does not support JBOD feature with tiered storage. Proposed Changes High-level design RemoteLogManager (RLM) is a new component which receives callback events for leadership changes and stop/delete …
– KIP-405: Kafka Tiered Storage

The release notes and the design doc disagree on a deployment constraint.

WikiFix finding: "Does Kafka's tiered storage feature support JBOD?" – one page says "supports JBOD", one page says "does not support JBOD". Options to pick an answer, ask the page owner, or ignore.

What is the numeric identifier for the error code UNSUPPORTED_COMPRESSION_TYPE?

74: It also introduces a new error code, UNSUPPORTED_COMPRESSION_TYPE (74).
– KIP-110: Add Codec for ZStandard Compression
76: … subscriptions have changed. Immediately send a GetTelemetrySubscriptionsRequest to update the client's subscriptions and get a new SubscriptionId. UNSUPPORTED_COMPRESSION_TYPE (76) Client's compression type is not supported by the broker. Immediately send a GetTelemetrySubscriptionsRequest to get an up-to-date list of the …
– KIP-714: Client metrics and observability

Two proposals give the same error code different numbers.

WikiFix finding: "What is the numeric identifier for the error code UNSUPPORTED_COMPRESSION_TYPE?" – one page says "74", one page says "76". Options to pick an answer, ask the page owner, or ignore.

PostHog Handbook

posthog.com/handbook · 409 pages scanned · 40 places where pages disagree

A handbook written in the open: sales playbooks, pricing, support and hiring processes.

10 sample findings

What support level does PostHog provide for self-hosted deployments?

Limited support: Need self-hosted - PostHog's self-hosted open-source deployment is made for hobbyists and since we're a small team, we can only provide limited support for it
– How to do discovery
No support, only docs and a migration recommendation: We no longer provide support for self-hosted deployments. If users contact us for help with self-hosted deployments then we refer them to our legacy docs and strongly recommend they migrate to PostHog Cloud).
– Partners; We do not otherwise provide support for self-hosted PostHog.
– Customer support

Sales reps promise a little; the support policy promises none.

WikiFix finding: "What support level does PostHog provide for self-hosted deployments?" – one page says "Limited support", one page says "No support, only docs and a migration recommendation". Options to pick an answer, ask the page owner, or ignore.

What is the pricing model for PostHog Logs?

billed per GB with custom retention billed per month at $0.05 per GB per month retained: Logs is generally available and billed per GB, with custom retention billed per month ($0.05/GB per month retained), set per service or per source.
– Customer experience (use-case selling)
per‑GB only with 10 GB free per month then $0.25 per GB after, with volume discounts: PostHog Logs is per-GB only. 10 GB free per month, $0.25/GB after, with volume discounts. No per-host fees. No per-retention-tier surcharges.
– Logs (how we position and sell)

One page prices Logs with a monthly retention charge; the other promises no retention surcharges at all, so a rep quoting either could be wrong.

WikiFix finding: "What is the pricing model for PostHog Logs?" – one page says "billed per GB with custom retention billed per month at $0.05 per GB per month retained", one page says "per‑GB only with 10 GB free per month then $0.25 per GB after, with volume discounts". Options to pick an answer, ask the page owner, or ignore.

Run it on your own spaces.

These five are public and were written with care, and each one still had pages that disagree with each other. Your first scan produces the same kind of report for your spaces, and reading it changes nothing on your pages.

Install in Confluence Message the founder

About the numbers: each set was mirrored into a Confluence site and scanned there. Page counts are what the mirror held on the day; the originals may have changed since. A finding counts as one question with two or more pages answering it differently.