And that would be your "SRED of sense", meaning, your own understanding - which has a spiritual hole in it and does not stand up to the whole word of God.
Nonetheless, for those who have ears to hear what the Spirit says: When many left following Jesus, it was because they could not hear what He was saying spiritually. So, to go after them or to appeal to their carnal nature about the things of the spirit, simply indicated that they were not whom He had come for, for His sheep hear His voice. Thus, those who did not leave, even though they too did not understand, they stayed by faith. Yet even they did not go and teach the matter in the way it was given to them ("My words are spirit"), just as it is with you.