There are digital and analog options. Any two-channel multi-band equalizer will allow you to modify a split headphone signal into two mono channels which can be merged into a single stereo signal downstream from the equalizer.
Something like the "Behringer Ultragraph Pro" (I think mine's the 30-band and separated dual-channel) that I use for room EQ in my studio will work. The only trick with headphones, is that you might need something like a direct injection box after you split the output from the computer and convert it to two balanced XLR or two balanced 1/4" (if the device you choose can't work with unbalanced connections), and another device to merge and convert it to an unbalanced stereo connection you could plug headphones into. If the device you buy allows for unbalanced 1/4" connections I'd just use something like the "Hosa CMP-159 Stereo Breakout Cable" to go from the computer soundcard to the equalizer. Then you'd just need another one and a female-to-female 1/8" adapter to plug in headphones. If you're using balanced 1/4" or balanced XLR, the connections get more complicated and can't be split passively anymore. You would be looking at $100-300 on the used market for all of those parts, but you could definitely build a straightforward rig that did that. Most EQs will give you +/- 12db or even 20db per band, and a parametric eq might also be an option--sometimes with even greater boost abilities--though over 20db could be very distorted especially through headphones at high volumes. Any EQ with a limiter or compressor (or upstream from one) will also potentially be safer and give you more control, too.
There are software options, especially if you have devices that support virtually connections like ASIO, but unless the hardware or CPU is very good, it can just result in significantly increased delay on the output, whereas the hardware will be much less likely to be noticeable in that way.
Good luck and keep us posted on what you try.
Spotify:
https://open.spotify.com/artist/2xHiPcCsm29R12HX4eXd4JPianoteq Studio & Organteq
Casio GP300 & Custom organ console