Hello
God's peace comes when our terms of peace and God's terms of peace match.
Remember that God first offered His terms of peace to us and in our responding to his terms of peace we set out our understanding of what the terms of His peace means for us as we live our lives. What this calls for is coming into agreement with God's terms of peace otherwise we are only accepting what we want as our terms of peace and have not come into a total dependence on God and His terms of peace.
Paul, a number of times, sets out in his letters to the Saints that we need to renew our minds and then put on the renewed/refurbished personhood that God intended for us all individually.
Our "freedom" and peace are a consequence of us being in a right relationship with God being fully dependent upon God for all our needs. So often, we all fall short and turn away from God, but He has promised us all that if we, who are called by His Name, will humble ourselves and repent of our sin of turning away from being Face to Face with Him, then He will forgive us our sin of turning away from Him and will bring His healing Balm upon us and "heal" us and restore our Freedom in and Peace with Him as we walk in league with Him, drawing all of our nourishment from Him and His word.
We all need to remember that we are all hedged around in our relationship with God by His "Laws and Statutes" and when we break through that hedge of protection, by turning away from God, the "Laws and Statutes" helps us to know that we have turned away because of the manifested sins that we start committing when we do. If we can recognise our turning away from God and the subsequent breaking of our relationship with God, then if we repent of our "Primary Sin" of turning away from God then He will forgive us of our Primary Sin, but the consequences of the sins we manifested while being turned away from God remain and we need to work at repairing to restore the relationships that we have broken with our family members and friends by forgiving them for their iniquities against us and asking for their forgiveness for the iniquities that we committed against them while we were turned away from God.
In the account of King David's life, there are three occasions recorded where he had turned away from God and sinned against God by acting God like in what he did. On each occasion David repented of his sin of turning away from God and beginning to act "God like" and he was forgiven, but the consequence of the sins he committed while turned away from God remained for David to bring about restoration while he lived. King David was not always able to bring about restoration with the people that he had offended against, but his turning back into God's loving arms made the fractured relationships with those he had offended more bearable.
One of our main problems we must face is that we tend to judge ourselves more harshly than what God does, and we need to be able to forgive ourselves as well as those who we have forgiven for their offences against us.
May the Lord give you the wisdom needed to recognise how you need to start the process of restoration with God first and then, with God's help, our restoration with the people around us. This can often be a repetitive process where we fail often and need to get back onto the wagon of restoration every time that we sin against God and then others.
Shalom
PS: - Remember that you are not the only one who struggles in this area with God.