Your weird observation shows a lack of understanding what Christ was tell His disciples. When looking at the parable of the Talents we also must consider the Parable of the Minas in Luke.
In both parables the man who goes away for a time, nominally for 1,000 years, is Satan. In both parables Satan is providing the means, i.e. money, for his good and faithful servants to oppose God as He establishes His Everlasting Kingdom on the earth.
In Both parables the master is going on a forced journey for a period of time, knowing that even though he will be imprisoned in the Bottomless pit, that eventually he will be released and will then be able to return to the face of the earth, claiming that he is now a king/deity in his own right.
The wicked servant in both parables informs his master that the master has no right to the harvest to which the servants master agrees with, "
You knew that I was an austere man, collecting what I did not deposit and reaping what I did not sow." as recorded in the parable in Luke, and, "
You wicked and lazy servant, you knew that I reap where I have not sown, and gather where I have not scattered seed. 27So you ought to have deposited my money with the bankers, and at my coming I would have received back my own with interest." as recorded in the Parable in Matthew.
Now in the parable of the Minas, it ends with, "
But bring here those enemies of mine, who did not want me to reign over them, and slay them before me." which is also told to us in Rev 12.
Also, in the parable of the Talents, it ends with, "
cast the unprofitable servant into the outer darkness. There will be weeping and gnashing of teeth." However, Satan does not have the power of casting the unprofitable servant into the lake of fire, so he attempts to cast the unprofitable servant into the outer darkness where there will weeping and the gnashing of teeth. In this Satan failed because the light was in the heart of the Wicked Servant. The casting away of the " labelled Wicked Servant" is Satan's attempt to stop his good and faithful servants to hear the good news of the Gospel in the future from the "supposed wicked servant". The Good and faithful servants are invited by Satan, their master to join him in his joy of now being a deity.
The other two occurrences of the "Outer Darkness" are also found in the Gospel of Matthew.
Matthew 8:10-12: - 10 When Jesus heard it, He marvelled, and said to those who followed, "Assuredly, I say to you, I have not found such great faith, not even in Israel! 11 And I say to you that many will come from east and west, and sit down with Abraham, Isaac, and Jacob in the kingdom of heaven. 12 But the sons of the kingdom will be cast out into outer darkness. There will be weeping and gnashing of teeth."
Matthew 22:11-13: - 11 "But when the king came in to see the guests, he saw a man there who did not have on a wedding garment. 12 So he said to him, 'Friend, how did you come in here without a wedding garment?' And he was speechless. 13 Then the king said to the servants, 'Bind him hand and foot, take him away, and cast him into outer darkness; there will be weeping and gnashing of teeth.'
What I have presented above is a very "perverse left field" understanding of the "outer Darkness," in that it is very different to the traditional understandings particularly of the Parable of the Minas and the Talents.