My first and only build was for hunting. I think you are lining up things pretty well.
If you are used to a serious bolt action hunting rifle, there is no way you will be satisfied with the standard design trigger of an AR-15. I tried the JP spring as a cheap possibility for enhancement. I tried polishing the gritty DD hammer and trigger. But all that was time wasted. I finally got the Geissele SSA-E trigger (it's a 2-stage) and I now consider it the best feature of the rifle. The cost hurt, but I can't imagine anything that would make me switch to something else.
My other splurge was on the Spikes Tactical Nickel Boron carrier group. It's slick - things move into place easily. It's easy to clean. The price has gone up with the insane demand of recent times, though. Check product reviews to see if you can find something with the same features for less.
I, too, bought the wedge as a just-in-case thing, but all the pieces came together tight enough without it.

