Big banks just received the first installment of benefits corporate America will reap from the new federal tax law. The haul: more than $2.5 billion.

The latest gain came Tuesday when Goldman Sachs Group Inc. reported first-quarter profit that rose 26% from a year earlier. This was aided by a lower corporate tax rate that boosted earnings by about $232 million.

Overall,...