PathWave Test Automation is the commercial layer on top of OpenTAP, which is free. Here is exactly what you pay for, when it is worth it, and the four alternatives worth comparing.

Keysight PathWave Test Automation is a commercial test sequencing platform built on OpenTAP, the open-source automation engine Keysight released and now maintains as an OSI-licensed project. PathWave adds a supported editor, commercial plugins, results management, and a support contract on top of an engine that is free.
That relationship is the single most useful thing to understand before evaluating alternatives, because the strongest alternative to PathWave is the free software inside it. This post covers what the commercial layer buys, when it is worth paying for, and the four other options.
OpenTAP gives you the test plan engine, step execution, result listeners, the plugin architecture, and a CLI. Free, open source, production-grade.
PathWave adds:
The honest summary: you are buying the editor, the plugins, and the phone number. Whether that is worth it depends almost entirely on whether your bench is Keysight and whether you have plugin-writing capacity in-house.
Free, and the same engine. Install it, use the community editor or drive it from the CLI, write plugins in C#.
tap run MyTestPlan.TapPlan --settings ProductionGood for: anyone willing to trade the polished editor for zero licence cost. The engine is identical, so nothing about your test plans is lower quality.
Gives up: the commercial plugins and support. You write and maintain your own instrument plugins, which for a standard SCPI instrument is a few hundred lines of C#.
Verdict: the obvious place to start. Prototype here before paying for anything.
Changes the assumption rather than the tool. Instead of authoring steps, you describe the measurement in plain English, and an agent generates the sequence and the instrument automation, then runs it and produces the report.
Good for: bench characterisation and validation, mixed-vendor hardware, and teams whose bottleneck is the time to write the sequence rather than the time to run it.
Gives up: the production-floor operator model and the plugin ecosystem. It is not a drop-in replacement for a certified production sequencer.
Verdict: the right answer when writing the test is the slow part.
The direct commercial competitor, and the incumbent in a great many production test departments.
Good for: NI-heavy benches, and teams who already have TestStand expertise. Its step types, execution model, and operator interfaces are mature.
Gives up: cost parity, and it pulls you into the NI stack including deployment licences per station.
Verdict: a lateral move unless your hardware pushes you one way. See NI TestStand alternatives for the full comparison.
Free, and a genuinely underrated option. pytest is a mature test runner with fixtures, parameterisation, reporting plugins, and CI integration, and none of it was designed for hardware but all of it works.
import pytest
@pytest.mark.parametrize("vin,expected", [(3.0, 1.8), (3.3, 1.8), (3.6, 1.8)])
def test_ldo_regulation(psu, dmm, vin, expected):
psu.set_voltage(vin)
psu.output(True)
vout = float(dmm.query("READ?"))
assert expected * 0.98 <= vout <= expected * 1.02, f"VOUT {vout} at VIN {vin}"Good for: Python teams, CI integration, and anyone who wants test results in a format their software colleagues already understand.
Gives up: the operator interface and the configuration-driven model. pytest is code, and production operators do not run pytest.
Verdict: excellent for engineering validation, wrong for a production floor.
Free, keyword-driven, with a readable tabular syntax that non-programmers can edit. Libraries exist for instrument control and it is widely used in telecom and hardware integration test.
Good for: teams that want the sequence readable by test engineers who are not developers, with reporting built in.
Gives up: performance on tight loops, and the instrument plugin ecosystem is thinner than OpenTAP's.
Verdict: a good middle ground between code and configuration.
| PathWave | OpenTAP | TestStand | pytest | Robot | TestFlow | |
|---|---|---|---|---|---|---|
| Cost | Commercial | Free | Commercial + deployment | Free | Free | Free version, then paid |
| Engine | OpenTAP | OpenTAP | Proprietary | pytest | Robot | Agent-generated |
| Plugin language | C# | C# | LabVIEW, C, .NET, Python | Python | Python | None needed |
| Editor | Polished | Community | Mature | Code | Tables | Plain English |
| Operator UI | Yes | Limited | Yes | No | Limited | Browser workspace |
| CI integration | Yes | Yes | Awkward | Excellent | Excellent | Yes |
| Vendor neutral | In principle | Yes | In principle | Yes | Yes | Yes |
| Support contract | Yes | Community | Yes | Community | Community | Yes on paid |
Install OpenTAP and rebuild one existing sequence. Free, and it tells you whether the engine fits. If OpenTAP works, the only remaining question is whether the commercial layer is worth its price to you specifically.
Count your non-Keysight instruments. Each one is plugin work under PathWave or OpenTAP. If that number is large, the commercial plugin advantage mostly evaporates.
Ask who runs the tests. Engineers, or production operators? Operators need a supported UI. Engineers do not.
Ask what is actually slow. If running tests is slow, you need a better sequencer. If writing tests is slow, a better sequencer will not help.
That last question is the one that decides most of these evaluations and the one least often asked.
The decisive practical question when choosing between PathWave and free OpenTAP is how much plugin work your bench implies. It is less than people fear for a standard SCPI instrument.
[Display("Measure DC Voltage", Group: "DMM")]
public class MeasureDcVoltage : TestStep
{
[Display("Instrument")]
public ScpiInstrument Dmm { get; set; }
[Display("Range (V)")]
public double Range { get; set; } = 10;
[Display("Lower limit (V)")]
public double LowerLimit { get; set; }
[Display("Upper limit (V)")]
public double UpperLimit { get; set; }
public override void Run()
{
Dmm.ScpiCommand($"CONF:VOLT:DC {Range}");
double reading = Dmm.ScpiQuery<double>("READ?");
Results.Publish("DcVoltage", new List<string> { "Volts" }, reading);
UpgradeVerdict(reading >= LowerLimit && reading <= UpperLimit
? Verdict.Pass : Verdict.Fail);
}
}That is a complete, usable step type. A typical instrument needs three to six of these. Budget a day per instrument for a competent C# developer, plus testing.
So the arithmetic is: if you have four non-Keysight instruments, that is roughly a week of work once, against a recurring licence cost. If you have twenty, and they change often, the commercial plugins start to look reasonable.
Sequencers differ far more in what they do with results than in how they run steps. Decide this before choosing.
Teams that pick a sequencer on step authoring and discover the results model afterwards usually end up writing a custom listener, which erases the difference between the free and commercial options.
PathWave is a family, not a product, and the bill depends on which parts you have. For one test-development seat plus a handful of stations:
| Line | What it covers | Typical order of magnitude |
|---|---|---|
| Test Automation development seat | The authoring environment | Four figures per seat per year |
| Station or runtime entitlement | Executing sequences on a bench | Three to four figures per station per year |
| Instrument-specific PathWave apps | Per-instrument measurement applications | Three to four figures each, per instrument |
| Enterprise data or results back end | Central results storage and search | Quote-based |
| Support and maintenance | Updates, escalation | Percentage of licence, annually |
Two things to check on your own quote. Whether station entitlements are counted per physical bench or per concurrent execution, because the two numbers can differ by a lot in a lab where stations idle most of the day. And whether the instrument apps you were sold are ones anyone still opens, which is the same tier-audit problem described in NI software licensing costs on the other vendor's stack.
The comparison that matters is not PathWave against zero. It is PathWave against OpenTAP plus the plugin work, since PathWave Test Automation is built on OpenTAP and the open core is genuinely the same engine.
The reason to think carefully here, and it is not a pricing argument.
PathWave is excellent on Keysight hardware and progressively less convenient as the bench diversifies. That is not a criticism, it is what a vendor toolchain is for. The question is what your bench looks like in three years.
| Bench composition | PathWave fit |
|---|---|
| All Keysight, stable | Strong. The instrument apps are real value |
| Mostly Keysight, some Tektronix or Rigol | Workable, via generic SCPI plugins you write |
| Genuinely mixed, four or more vendors | Weak. You are writing plugins for everything anyway |
| Unknown, procurement buys on price | Assume mixed, and pick accordingly |
If you are in the third or fourth row, you are paying for a Keysight-optimised toolchain and then not using the part that makes it worth the price. See Keysight vs Tektronix oscilloscopes for how quickly a bench becomes mixed, and GPIB vs USB vs LAN for the transport layer that stays the same regardless.
Every sequencer on this page shares one assumption, that a human writes each step. That assumption is the thing worth questioning, and it is what TestFlow changes.
Connect your instruments. Pick the manufacturer and model, paste the VISA address (USB, LAN, GPIB, or serial), and the agent knows what is on your bench. No bench yet? Use a placeholder address, build the full automation, and swap in the real address when you are in the lab.
Tell the agent what to test, in plain English. For example, "run a VI sweep from 1 to 10 V in 1 V steps at 0.5 A load current," or "suggest the tests for a power-management device."
The agent builds the complete workflow in seconds. Instrument-aware automation appears on the canvas, with the generated scripts visible in a code panel you can inspect and edit.
Run it in your lab. Click Run and the status panel streams results step by step, with measured values inline (VOUT = 3.301 V, asserted 3.2 to 3.4 V, PASS). One click exports a structured PDF report, or the raw results as CSV.


The step-by-step walkthrough, VISA address formats, and Test Planner prompts are all in the TestFlow product guide.
Keysight's commercial test sequencing and automation platform, built on OpenTAP. It adds a supported editor, commercial plugins, results management, and Keysight support on top of the open-source core.
OpenTAP is the free open-source engine underneath. PathWave Test Automation is the commercial product built on it. You can run OpenTAP alone at no cost and get most of the sequencing capability.
PathWave Test Automation is commercial. OpenTAP, the engine it is built on, is free and open source under an OSI-approved licence. Some PathWave editor tiers have free entry levels, so check the current tier list.
OpenTAP itself, since it is the same engine. For Python-first teams, pytest with pyVISA covers most sequencing needs. TestFlow has a free version that generates the sequence rather than requiring you to author it.
No. OpenTAP and PathWave are vendor-neutral in principle and plugins exist for third-party hardware. In practice the Keysight instrument plugins are the most complete, so mixed benches need more plugin work.
Functionally yes, for most sequencing workloads. The migration cost is in rewriting sequences and step types, so the decision usually turns on which vendor's instruments dominate your bench.
Connect your instruments, describe a test in plain English, and TestFlow builds and runs it in minutes.
A new way for testing, from specs to automated sequences, capture clean data, and accelerate your validation cycle.