Have you considered to add keyword search and other factors into the re-ranker?
Other factors are formatted texts like bold, heading, bullet points, as well as bunch of factors typically seen in web search techniques?