Hacker News new | ask | show | jobs
by jeffbarr 4168 days ago
Looks awesome. Now if there was a clean way to do incremental rebuilds and pushes, I would be very happy. Octopress is awesome until you start to accumulate hundreds or thousands of posts that must be regenerated and pushed to the target. The regeneration process is intrinsically serial at this point and does not take advantage of multiple threads or processes.
2 comments

I have my own little blogging engine based on https://github.com/debrouwere/render and what I've found is that the bottleneck is almost always IO. Rendering templates is so fast it simply does not matter whether you run it on a gazillion cores or not. Getting data from disk and then writing it to disk means you're dealing with contention, where parallelizing stuff can actually make it slower. So it can actually make sense to do all of this serially.

But of course, that doesn't mean you can't do incremental rebuilds. If the data is older than both the HTML and the template, then there's no need to rerender. More generators should support this, either internally or by making it easier to run them as part of a Make build.

Agreed. This is a problem that I hope Jekyll manages to solve and it looks like they may be getting closer: https://github.com/jekyll/jekyll/pull/3116