The most basic crystal field argument includes point-symmetric charges approaching the central metal in a way as the ligands would. Then, any orbitals that are symmetry-equivalent will end up at the same energy, and depending on how much these point towards the point-symmetric approaching charges they will be raised or lowered.