Ye Fan had to ascend, so he had to temporarily leave the secret realm. After he met with Lu Xiaoman and Li Zhaojun, he had already left the secret realm.
He didn't want to meet more women to avoid wasting too much time; he didn't want to favor one over the other, so he decided not to meet any of them. However, he had somewhat favored some because he had met Lu Xiaoman, Li Zhaojun, Qin Mengyao, and Yang Xiaoting beforehand, which was inherently unfair to the other women.
Ye Fan went directly to the Left Domain Star System, which was close to Jiang Huo Star, where he had been before and brought back Fantasy.
Here, he felt no power could interfere with his ascension plan. He could peacefully complete the final stages of his cultivation here, bringing his Pure Yang spiritual energy to the point of ascension, a matter he deemed very necessary.
