Home / MCP Tools / A/B Test Significance (two-proportion z-test)
Live MCP toolstatistics

A/B Test Significance (two-proportion z-test)

Conversion rates, lift, z-score, p-value and significance for two variants.

Free tier eligible — 500 calls/month with a free key from /pricing; x402 pay-per-call above quota.

Parameters

ParameterTypeRequiredDescription
conversions_anumberrequiredConversions in variant A
visitors_anumberrequiredVisitors in variant A
conversions_bnumberrequiredConversions in variant B
visitors_bnumberrequiredVisitors in variant B
confidencenumberoptionalConfidence level 0..1 (default 0.95)

Call it over MCP (JSON-RPC 2.0)

curl -s https://wingmanprotocol.com/mcp \
  -H 'Content-Type: application/json' \
  -H 'Accept: application/json, text/event-stream' \
  -d '{"jsonrpc": "2.0", "id": 1, "method": "tools/call", "params": {"name": "ab_test", "arguments": {"conversions_a": 100, "visitors_a": 100, "conversions_b": 100, "visitors_b": 100}}}'

Or plain HTTP

curl -s https://wingmanprotocol.com/tools/ab_test \
  -H 'Content-Type: application/json' \
  -d '{"conversions_a": 100, "visitors_a": 100, "conversions_b": 100, "visitors_b": 100}'

Try it live

Edit the JSON and run it — this POSTs to https://wingmanprotocol.com/tools/ab_test from your browser.

Related tools in Statistics

statistics
Confidence Interval Calculator
Confidence interval for a population mean or proportion given sample statistics.
statistics
Expected Value & Variance
E[X], variance and standard deviation of a discrete distribution.
statistics
Normal Distribution Probability
CDF, survival, z-score, and percentile queries for any normal distribution.
statistics
Percentile Calculator
Value at a given percentile, or the percentile rank of a value, over a dataset.
statistics
Linear Regression (least squares)
Best-fit slope, intercept, r^2 and an optional prediction from paired x/y data.