I filled out the form and submitted my patent application to the Patent Office.

The WITH here actually refers to submitting documents to organizations, but it is a fixed usage:

File sth with the authorities

For example:

He will take the first step towards the presidency of the United States and submit documents to the Federal Election Commission this week. ...

... on the same day, you submitted documents to the court clerk.