He chastised this man because he failed to acknowledge that Jesus is God. Only God is good, and since Jesus is God, only He is good and perfect (with the Father and the Holy Spirit). But you do not believe that Jesus is God.
Getting back to the OP, the meaning of loving your neighbor is indeed doing good to all men, even to your enemies. Which includes warning all men about that which is false, that which is evil, and that which is harmful.
Some Christians do not believe that warning others about the dangers which surround them and lie ahead is a part of loving your neighbor. But Christ and the apostles constantly warned Christians. And Noah spent 120 years warning the world of judgment to come. He is called a "preacher of righteousness".
Let's take the current COVID scamdemic and the bogus vaccines which are a designed hazard to everyone. How many Christians felt that it is their Christian duty to investigate this global scam and expose it? How many Christians thoroughly researched these dangerous and toxic "vaccines" and exposed them for what they truly are -- poisons to kill or maim their recipients? How many churches carefully examined the tyrannical government policies meant to shut down churches, and absolutely refused to go along with the scam? Churches were deemed "non-essential" while liquor stores were deemed "essential"! And yet too many Christians and churches voluntarily submitted to this nonsense instead of challenging governments by going to court to prove their case.
When Paul was arrested for his witness, he appealed to Caesar (the highest "court" in the Roman empire). That would be the same as Christians taking governments to the Supreme Court today and charging them with violating constitutions, and also crimes against humanity (via the vaccines). There should have been massive Christian protests against the lockdown of churches, and lockdowns in general (which accomplished absolutely nothing). But none of that happened.
There should already have been Nuremberg 2 by now, but those who talked about this recently have failed to follow through. Should Christians be warning the world about these crimes against humanity? Did Christians stand by while the Nazis committed their atrocities? Some did but many did not. Now the same atrocities are being committed through bogus vaccines, and most Christians are simply standing by. Is this not a part of "doing good"? Naturally the Gospel takes precedence over everything else, but taking people out of harm's way is also a Christian duty.
There are some very pertinent verses in the Torah which are applicable for those who have ears to hear:
ZERO ACCOUNTABILTY TODAY
And if a man shall open a pit, or if a man shall dig a pit, and not cover it, and an ox or an ass fall therein; The owner of the pit shall make it good, and give money unto the owner of them; and the dead beast shall be his.(Exod 21:33,34)
Is anyone being compensated for the unnecessary COVID deaths and vaccine deaths? No pharmaceutical company, government, public health official, or doctor is being held accountable today. And effective treatments such as ivermectin and HCQ were literally sabotaged in order to increase the death rates! They continue to be sabotaged.
THE CHRISTIAN'S DUTY
If thou meet thine enemy's ox or his ass going astray, thou shalt surely bring it back to him again. If thou see the ass of him that hateth thee lying under his burden, and wouldest forbear to help him, thou shalt surely help with him. (Exod 23:4,5)
Thou shalt not see thy brother's ox or his sheep go astray, and hide thyself from them: thou shalt in any case bring them again unto thy brother. And if thy brother be not nigh unto thee, or if thou know him not, then thou shalt bring it unto thine own house, and it shall be with thee until thy brother seek after it, and thou shalt restore it to him again. In like manner shalt thou do with his ass; and so shalt thou do with his raiment; and with all lost thing of thy brother's, which he hath lost, and thou hast found, shalt thou do likewise: thou mayest not hide thyself. Thou shalt not see thy brother's ass or his ox fall down by the way, and hide thyself from them: thou shalt surely help him to lift them up again. (Deut 22:1-4)