Nirmion
도움말 도구 찾기

NIRMION 유용한 작업 공간

테스트 계산기

눈에 띄는 가정, 실용적인 예제 및 검토 가능한 출력과 함께 지역적으로 제한된 ab 테스트 계산기를 만드십시오.

브라우저 준비현지적으로 달리기인간의 검토가 추천됩니다

입구

당신은 무엇을 검토하고 싶습니까?

유용하고 책임감있는 결과를 위해 충분한 맥락을 추가하십시오.

23 / 180

질문, 자산 또는 컨텍스트가 검토되는 것을 지정합니다.

16 / 180

결과를 확인할 책임이 있는 사람의 이름을 지정합니다.

95 / 20,000

Add one labeled row per line: Control visitors, Control conversions, Variant visitors, and Variant conversions.

85 / 20,000

기록의 한계, 단위, 허가 또는 맥락은 검토자가 알아야합니다.

이 브라우저에서 모든 것이 실행됩니다. 결과를 사용하거나 공유하기 전에 가정을 검토하십시오.

검토 논문

당신의 결과는 기다리고 있습니다.

원하는 맥락과 라인 당 하나의 입력을 추가한 다음 검토 가능한 출력을 생성합니다.

  1. 범위를 정의합니다.
  2. 소유자의 이름
  3. 공유하기 전에 수출을 확인합니다.

AB TEST EXPLAINER

Read the lift before you debate the winner.

This tool is built for a simple two-variant comparison. You paste traffic and conversion counts for the control and variant, and the page turns those four numbers into two observed rates, a percentage-point gap, and relative lift.

Worked example from the default input

With 100 control visitors and 100 variant visitors, the example records 10 control conversions and 15 variant conversions. The tool therefore reports 10.00% for control, 15.00% for the variant, a 5.00 percentage-point gap, and +50.00% relative lift.

Primary result+50.00% relative lift

The live calculator headline for this example is +50.00% relative lift.

Default row contract

The parser expects one labeled row per line. Keeping the labels exactly as shown is the safest way to match the calculator's current input contract.

Control visitors | 100
Control conversions | 10
Variant visitors | 100
Variant conversions | 15

What to enter and how to enter it

This workspace does not use separate number boxes for each metric. The large input area is the real calculator definition, so the labels are part of the workflow.

Control visitors

Enter the total people, sessions, or units that saw the control experience during the same measurement window as the variant.

Control conversions

Enter only the conversions that belong to the same success event you will count for the variant.

Variant visitors

Enter the total people, sessions, or units that saw the variant experience under the same routing and time window.

Variant conversions

Enter the conversions for the variant using the same definition, attribution rule, and counting logic as the control.

How to interpret the result

Start with the two observed rates, then read the absolute gap, then the lift. That order keeps a relative percentage from hiding the size of the underlying rate change.

Control conversion rate

10.00%

The control rate is 10 divided by 100, which is 10.00%.

Variant conversion rate

15.00%

The variant rate is 15 divided by 100, which is 15.00%.

Absolute rate difference

5.00%

The direct gap between the two observed rates is 5.00 percentage points.

Relative lift

+50.00%

Relative lift compares the rate gap to the control baseline, so this example becomes +50.00%.

Method, assumptions, and limits

The page computes two proportions from the counts you supply. It then shows both the raw rate gap and the gap relative to the control rate so you can separate practical change from percentage framing.

  • Control rate = 10 / 100 = 10.00%
  • Variant rate = 15 / 100 = 15.00%
  • Absolute difference = 15.00% - 10.00% = 5.00 percentage points
  • Relative lift = (15.00% - 10.00%) / 10.00% = +50.00%

Safe-use boundary

Use this readout only when both variants measure the same success event, use comparable traffic windows, and keep conversions less than or equal to visitors. The tool does not randomize traffic, deduplicate users, estimate uncertainty, or decide whether the experiment should stop.

Source behind the statistical boundary

For inference on differences between two proportions, use a formal method rather than relying on lift alone. The linked NIST reference covers the next step beyond this descriptive calculator.

NIST reference on difference of proportions

Default example at a glance

The bars below show observed conversion rate, not raw conversion count. Equal traffic makes the five-point rate gap easier to read.

AB test example conversion-rate comparisonA comparison chart showing 10.00% for the control and 15.00% for the variant in the default AB test example.0%5%10%15%20%ControlVariant10.00%15.00%

Because both variants have 100 visitors in the default example, the visual highlights the rate change directly: 10.00% versus 15.00%.

COMMON QUESTIONS

Questions worth answering before you trust the lift

The calculator is fast because it stops at descriptive comparison. These answers explain what that means in practice.

What is the difference between percentage-point change and relative lift?

Percentage-point change is the direct gap between the two rates. In this example, 15.00% minus 10.00% equals 5.00 points. Relative lift divides that same gap by the control rate, which is why the same result is +50.00%.

Does this calculator tell me whether an A/B test is statistically significant?

No. It reports observed rates, the absolute percentage-point gap, and relative lift only. Significance, confidence intervals, power, and stopping rules need a separate statistical method.

What if one variant has tiny traffic or zero conversions?

Treat the readout as fragile. Very small samples make rates unstable, and a zero control rate makes relative lift unhelpful in practice even though the page can still show a descriptive output. Use a sample-size or significance tool before making a decision.

그것을 사용하는 방법

결과를 유용하고 책임감있게 만드십시오

  1. 011. 질문과 맥락을 정의하십시오.
  2. 022. 이 결과를 위해 필요한 정보만 추가합니다.
  3. 033. 사용하기 전에 가정, 허가 및 단위를 확인하십시오.

This workspace reads four labeled rows from the input box, converts them into control and variant conversion rates, then reports the absolute percentage-point gap and relative lift. It is descriptive only and does not estimate significance, confidence intervals, or sample size.