Hacker News new | ask | show | jobs
by jeffbee 1509 days ago
Are there a lot of binaries "over a few gigabytes"? On x86_64 you can only have 32-bit offsets for relative jumps. How would you build and link something that large?
2 comments

Jars got that big too. At some point the Java team had to patch Hotspot to accept JARs larger than 2GB.

My project weighed in as a jar of about 350MB. At one point I had look inside and it was like 60% protobuf-generated code.

I worked on search, it might be different in other areas. But yeah, the fact that you can't link it etc was a huge problem that we had to think about.
I received during my tenure several peer bonuses for unblocking the search or ads release by keeping the [redacted] under 2GiB. They are huge just because authors are lazy, not as an inevitable consequence of any technical choice that has been made. It was always easy for me (for some reason, easier than it was for the program's own maintainers) to use `blaze query` and a bit of critical thinking to break up some library that was always called `:util` into smaller pieces and thereby remove tens of megabytes from the linker output. People are just so lazy they aren't thinking about the consequences of their build targets.

Most developer's main targets are much, much smaller.

Wow can you reveal a few things about the internals of google search? Any secret-sauce/revolutionar algorithm? How does it compare to Lucene?