The wisdom from above knows when to yield according to James. It knows when to walk away from situations and even from people. Jesus modelled it. He knew when to be silent and not be drawn into further conversation when onlookers might have thought He could have said another sentence or even a first sentence to win the day. He knew as well when to walk away from people, even lost or needy people, whom maybe others would have felt He should have run after or pursued or at least stayed with.
Wisdom in the bible is never simply an intellectual affair. It is to do with help from God to live with our humanity in its simplicity and complexity. It is about how we relate to ourselves, those around us and the world on the larger sphere. Clever people exist who are brilliant in terms of intellect but have no wisdom. Their cleverness does not necessarily translate into knowing how to live life. In fact in the living of their lives they may be monumentally stupid, chaotic and destructive of themselves and others.