According to the "donation principle" of patent, the applicant exchanges patent protection by disclosing technology, and the disclosed technology is donated to the whole society in exchange for short-term "monopoly" behavior. If the patent is not authorized in the end, then the patent is not protected from beginning to end. So this patent belongs to the whole society, not the applicant, so there is no right to ask others to pay.
It is suggested that applicants should pay attention to the risks of patent application when considering exchanging open technology for protection. It may not be protected if it is made public.