Hacker News new | ask | show | jobs
by FabricPaul 5187 days ago
Replying to comment below (can't see a reply button) - please correct me if I'm wrong, but I don't see anything about Cython handling multi-threading and I don't see anything about dynamic compilation on target. I just had a flick through their documentation, so if this stuff is in there then I missed it...
1 comments
maxerickson 5187 days ago
There is a cython mechanism for compiling code on demand (pyximport), but it is only transparent to the user, it isn't especially dynamic.

There are also some parallel features:

http://wiki.cython.org/enhancements/prange

link
phtaylor 5187 days ago
Multi-threaded software development is a huge challenge facing software developers. The model we have taken enables massive amounts of computation to be distributed across all available cores.

The combination of task based parallelism, and data based parallelism, orchestrated using a dependency graph, enable our scheduler to very efficiently manage the CPU(and in the GPU in the future).

This model is used in high end video game engines today to leverage multi-core CPUs effectively. We make this programming model available in Python and JavaScript.

http://s09.idav.ucdavis.edu/talks/04-JAndersson-ParallelFros...

A single call from Python/JavaScript can kick off hundreds of tasks (written in KL) to be scheduled and executed.

link