1. According to Article 16 of the Detailed Rules for the Implementation of the Law on the Administration of Tax Collection, before going through the cancellation of tax registration, taxpayers should settle the tax payable, late fees and fines with the tax authorities, and hand in tax certificates such as invoices and tax registration certificates.
Therefore, your company should pay taxes first and then cancel.
If you leave it there, you will be punished.