Don't the electronic:optical and optical:electronic transitions introduce quite a bit of latency? I've seen estimates of around 500 microseconds per conversion. That's not enough to matter for networking, but RAM chips have internal latencies measured in nanoseconds.
Of course, "one day perhaps" this could change.