Letterhead issue in Purchase Order email

Ever since upgrading from ERPNext v8 to ERPNext v10, the PDFs in purchase order emails seems to lack the letterhead. I have tried the commonly suggested fixes like adding the host_name to site_config.json all to no avail.
I realized I could see the PO with letterhead when I click the “view in browser” link in the email. However, a permission issue is raised when I click on “view in browser” from a browser not logged in to ERPNext and so I get a broken image. This means that the stakeholders we are emailing the POs to will be receiving the PO with no letterhead.

How can I solve this?