You can if you build the clojure jar yourself. Just follow the ant part of the clojure README to generate your own jar. Then you have a super portable clojure jar again. https://github.com/clojure/clojure/
This is cool, though for lowering the barrier of entry downloading a single jar is great. If ppl is first coming to Clojure w/o too much knowledge of java, having to install Ant first, clone a repo and build it manually could be a bit daunting.
My suggestion is mainly for people that want to "trim the fat" , have maximal control of things, or want to use this as basis for non-standard deployments. I just want to support the OP that you don't NEED to download all this tooling to get it to run on any computer. Once you have the jar, its very easy to put it on a friend's computer. You can even package up a JVM in there if you wanted too. While not up to date, I describe my motivations in dj.solo https://github.com/bmillare/dj.solo