Response speed and acceleration

Can You Lower CMP 170HX Power Without Losing Speed?

Adjust the power limit one step at a time while watching real requests and temperature.

If you plan to keep a CMP 170HX running for long sessions, try tuning its power limit. A lower cap can reduce heat and electricity use. In the four-card GLM test below, lowering the per-card cap from 165 W to 140 W reduced single-user throughput1 by about 1.4% and the four GPUs' combined power draw by 113 W.

Before changing the limit, record the supported range and original setting. Keep adequate fan airflow and compare speed, temperature, and power with the same requests to find a suitable cap for your setup.

Requirements and key details
  • A power limit caps GPU power, so lowering it can change both power use and throughput.
  • In the four-card GLM test, 165 W→140 W changed single-user speed from 418.6→412.7 tok/s and four-GPU power from 650→537 W.
  • Record the supported range and current limit before testing, then restore the original value afterward.

A power limit caps GPU power

A power limit sets the maximum power the GPU2 may draw. Lowering it keeps the GPU within a smaller power budget; when a workload reaches the cap, clock speed or throughput may fall. Power use varies with the model, input length, and request count, so compare using the requests you expect to run.

GPU-reported power and whole-system power measured at the wall cover different boundaries. The four-GPU figure below is the sum for four cards; it excludes CPU3, memory, fans, and power-supply losses.

A single CMP 170HX card on a workbench with a magnifier beside it
Separate GPU-reported values from the point where you measure system power.

Compare power and throughput in the four-card GLM test

The public GLM-5.3-Flash test used four CMP 170HX cards at Tensor Parallel4 4 and varied the per-card power limit. The single-user column is output speed for one structured request; the eight-user column is aggregate throughput across eight requests. The table separates solo speed, concurrent throughput, and the four-GPU power sum.

Scroll sideways to compare all columns.

GLM-5.3-Flash TP4 · Per-card limit, throughput, and four-GPU power
Per-card limitSingle user8-user aggregateFour-GPU sum
165 W418.6 tok/s822.4 tok/s650 W
150 W418.0 tok/s816.5 tok/s582 W
140 W412.7 tok/s814.2 tok/s537 W
130 W394.9 tok/s785.9 tok/s517 W
120 W374.4 tok/s756.5 tok/s476 W
110 W340.1 tok/s706.8 tok/s436 W
100 W291.9 tok/s627.4 tok/s398 W

Conditions: GLM-5.3-Flash TP4 on four CMP 170HX cards, all at 1,728 MHz HBM, with limits applied live. GPU power is the four-card sum, not wall power. PixelML source record

Reducing the per-card cap from 165 W to 140 W lowered the four-GPU sum from 650 W to 537 W, a 113 W reduction. Single-user speed fell about 1.4%, from 418.6 to 412.7 tok/s; aggregate throughput for eight users fell about 1%, from 822.4 to 814.2 tok/s. Both workloads stayed close in this four-card GLM setup, but solo and eight-user results cannot be substituted for one another.

The 180 W Qwen run and 250 W stop are separate conditions

A separate one-card Qwen3.8-27B test completed at 180 W on a 64 GiB CMP 170HX with 74 SMs, 1728 MHz HBM, PCIe Gen2 x16, and forced airflow. The researcher began a 250 W run but stopped within a minute when memory temperature reached 80°C. Thus 180 W was the completed test condition, and 80°C was the stop point in the 250 W run. It is not a universal manufacturer maximum.

This result differs from the four-card GLM table in model, card count, workload, and cooling, so the two cannot be compared directly. The researcher recorded them in separate public run reports. Qwen one-card test conditions and logs

A CMP 170HX card beside a monitor with a blank window and note-taking tools
Record the original limit and supported range first.

Record the current value, then change one step at a time

On Linux, run nvidia-smi -q -d POWER,TEMPERATURE,CLOCK and save the output. First record each card’s current limit, supported minimum and maximum, temperature, and clocks. Do not apply an arbitrary -pl value before checking the range reported by the card. The CMP 170HX has a passive heatsink, so also confirm that strong forced airflow is working.

Use the example only if 180 W is within card 0’s supported range. The command changes card 0 only. Repeat the same request after applying it and record TTFT5, output tok/s, power, and memory temperature. Stop the workload if temperature keeps rising or an error appears.

To restore card 0’s original limit, replace OLD_LIMIT_W with the number you recorded and run the restore command. For example, if your note says 165 W, replace the placeholder with 165. After saving the test results, read the setting again and confirm it matches the recorded value.

Read current status
nvidia-smi -q -d POWER,TEMPERATURE,CLOCK
Record the current value and the range supported by the card.
Change card 0 after checking its supported range
sudo nvidia-smi -i 0 -pl 180
Use only when 180 W is within card 0’s supported range.
Restore the recorded original value
sudo nvidia-smi -i 0 -pl OLD_LIMIT_W
Replace OLD_LIMIT_W with card 0’s actual watt value recorded before testing.
Two installed CMP 170HX cards near a forced-air fan and an unmarked meter
Direct strong airflow across the passive heatsinks and check temperatures.

Convert GPU power differences into energy use

If the power difference is 100 W at the same measurement point and the system runs 8 hours a day for 30 days, the calculation is 100÷1000×8×30=24 kWh. This is an arithmetic example, not a CMP 170HX wall-power measurement. Do not treat a GPU reading as if it covered the whole system.

To estimate electricity cost, measure whole-system power at the wall and enter actual operating hours and your tariff in the site’s electricity tool. Use only a limit that meets your normal speed and temperature requirements.

Terminology notes

  1. Throughput — The amount of work processed or generated over time. Comparisons need the unit, such as tokens per second or requests per second.

    Back to the text
  2. GPU — A processor designed to handle many calculations in parallel. It performs model computations during AI inference.

    Back to the text
  3. CPU — The central processor that runs the operating system and general-purpose instructions; in AI workloads it also handles tasks such as preprocessing and data movement.

    Back to the text
  4. Tensor parallelism — A method that splits matrices and computations within a model layer across devices for joint execution. Devices communicate to combine partial results.

    Back to the text
  5. Time to First Token — The time from sending a request until its first output token arrives.

    Back to the text

Frequently asked questions

What should you check first in this article?
If you plan to keep a CMP 170HX running for long sessions, try tuning its power limit. A lower cap can reduce heat and electricity use. In the four-card GLM test below, lowering the per-card cap from 165 W to 140 W reduced single-user throughput by about 1.4% and the four GPUs' combined power draw by 113 W.
When is it better not to choose this?
On Linux, run nvidia-smi -q -d POWER,TEMPERATURE,CLOCK and save the output. First record each card’s current limit, supported minimum and maximum, temperature, and clocks. Do not apply an arbitrary -pl value before checking the range reported by the card. The CMP 170HX has a passive heatsink, so also confirm that strong forced airflow is working.