Remove unconditional edits to $PATH

If I wanted these directories on my path, they would be on my path. But since putting these random directories on my path causes cmake to misconfigure my builds, having them added unconditionally without any way to prevent that in general except to fix cmake is beyond incredibly useless.