The rifts are all protected by the enormous magical energy used by Adrian in creating them. Only beings that came from the other side could use their specific rifts to return. This magic also affects his allies which meanst that those that are not from other rifts cannot transfer. There is a way to bypass the rifts and that is by using an enormous amount of energy to destroy the protection magic guarding them.
The Primordial Divine Dragon Huanglong will not dare to do such a thing though as using the same amount of magical energy that Adrian used will make it lose most of its own divine energy in the process. The Primordial Divine Dragon Huanglong can no longer sustain its own consumption of magical energy as it is no longer able to use the ley lines. It is running on its own divine energy as a way to maintain its form and also maintain its army.
