Perhaps Wu Yuankong walked too fast and didn't care that the restrictions in his cave were not set. Or maybe Wu Yuankong is not worried about Zhai Chuman leaving Wuhenxian Pond at all. Maybe without his permission, no one can leave Wuhenxian Pond casually....