Since we want to invalidate other people's patents, of course we have to search. Otherwise, why say other people's patents are invalid?
Even if you have some evidence, you should try to collect it more fully.
The main purpose of retrieval is to try to find the technical content of the patent you want to invalidate before the other party's patent application date.