I like that idea. Traders are way too OP. The game really needs some sort of trader balancing and this would also lead to a bit more to do hunting for things the traders need.
The quest rewards would also need an overhaul though.
Did you think about making this into a mod?