Is it true that if you leave a sliver in your skin it can kill you?

i dont know if it's an old wives tail, but i remember hearing if you dont get a sliver out of your skin ASAP, that it will get into your bloodstream and travel to your heart and kill you. Any truth to that??