[yjftsjthsd-h]

I feel like the interesting part is mostly https://gitlab.com/android_translation_layer/android_transla... which is probably an alternative to waydroid, but maybe more like WINE so it doesn't need the binder kernel module?

EDIT to add: I also think packaging up an application plus the compatibility layer using flatpak[0] is a really nice idea; it lets you 1. make those apps available in a way that nearly appears native, 2. lets you get users/testers on your compat layer easily, while 3. scoping it to a single app at a time to make it easier to do things like "well we've got this one app working, but how do we tell people that without them expecting other things to work that aren't implemented yet?". Excellent symbiosis:)

[0] Strictly speaking there shouldn't be anything requiring flatpak here... I think there's no technical blocker preventing you making a debian package for the ATL and another for NewPipe and sticking them in a repo/PPA that people could add. But I do somewhat feel that flatpak lends itself to this usecase.

[sigh_again]

Trying to reimplement Android without Binder is a doomed plan. Everything about Android is so intrinsically linked to having Binder available that you're just going to end up piling hacks on hacks to have anything working. At this point, an x86 Android image will be better and more reliable. Somewhat just as fast.

Services ? Binder. Intents (even internal ones) ? Binder. Play Services / microG which 90% of apps use ? Binder. Permissions ? Binder.

[phh]

I disagree. Apps barely use Binder directly, but mostly call framework jar (which yes will do binder, but since they are reimplementing framework jar that's fine). Intents and permissions can be implemented without binder as the API is quite semantic. It may happen that the app uses Binder for same-app IPC, but since app does ser-des itself, you can easily replace Android.os.binder by whatever IPC you want, The only "real" issue I can see , and you're right there, is Play Services. I think that handling that case specifically later (once floss apps/apps that don't require play services work properly), is not too horrific (it basically needs to compile the aidl into not calling binder, but redirecting it to a custom lib)

[sigh_again]

So, as I said, hacks on top of hacks on top of hacks :D If you're going to shim and reimplement, piece by piece some APIs like Binder... Just use Binder, that is already upstreamed in the kernel for so long.

[phh]

You're confusing shiming with rewriting.

DirectX uses direct hardware access. DirectX uses direct hardware access. That doesn't mean you can't rewrite a DirectX-API implementation without direct hardware access. Likewise, Android's original implementation of MediaCodec uses binder. That doesn't mean that a reimplementation of MediaCodec API requires binder. The vast majority of Android public APIs do not assume binder. The only exception is Service binding, and even then, it's an assumption in name: It assumes that android.os.Binder will provide you an IPC. Most usages of android.os.Binder will be local to an app, so you can easily replace it with any IPC. Even the usage towards multiple app (whose only real usage would be Play Services) doesn't actually require binder. The requirement on that part is just the ""stable"" ser-des.

As an app developer, you (should) never connect directly to /dev/binder, because its API/ABI isn't stable. (it changed like 3 times in the last 6 years?)

[kllrnohj]

> Most usages of android.os.Binder will be local to an app, so you can easily replace it with any IPC.

I'd be absolutely shocked if that was even a little bit true. Android's binder & AIDL generated code will absolutely do in-process passthrough to avoid the syscall for local calls, but ~nobody is bothering with AIDL unless it's to enable IPC. So that local pass-through is almost certainly rarely if ever used except on "accident" when components nominally support being passed over IPC, but in some cases aren't. An example would be Android's Surface + SurfaceTexture. Normally you're using Surface over IPC either to the display or to media codec or from camera. But if you're using SurfaceTexture, then in that rare scenario it might be local to the process.

But that's definitely a lot less common than IPC binder + AIDL.

All that said, you could almost certainly make a Binder driver shim that just uses unix domain sockets. Heck, Android itself even has one: https://cs.android.com/android/platform/superproject/main/+/...

What'd be a lot harder is handling some of the more advanced graphics & multimedia features. Android's gralloc HAL in particular is likely borderline impossible to implement on Linux as it assumes tight integration between all of the camera, media/video, GPU, and display stacks, and also largely assumes it's on unified memory.

[mappu]

For most of Wine's life it was sufficient to implement the system library ABI, but recent developments mean they also have to trap the (unstable) syscall ABI with ptrace. You could mimic Binder in userspace the same way, without the kernel module. But even that's not a problem since Binder is upstream and enabled by default in many distro kernels now.

[ronsor]

When did WINE start doing this? I always love a good read on ptrace hacks.

[lights0123]

https://github.com/wine-staging/wine-staging/commit/595f2f98...

A new strategy is used that is much faster: https://www.phoronix.com/news/Syscall-User-Dispatch-Queued

[quotemstr]

> Games avoiding the Windows API and performing system calls directly is an increasingly common occurrence by modern Windows games, seemingly in the name of Digital Rights Management schemes and similar protected modes.

Yuck. Windows system call numbers are not contractual. At all. Microsoft should try harder to kill any code outside ntdll.dll that makes a system call. It's obnoxious for a developer to deliberately use unstable interfaces and then demand indefinite compatibility.

[lxgr]

> demand indefinite compatibility.

Not infinite – long enough for the game to bring in most revenue is enough.

Who cares that it stops running one or two Windows updates later for totally avoidable reasons? Definitely not the publisher. (In fact, isn't it about time for an HD remaster again?)

[int0x29]

There is now at least one public windows kernel call listed on MSDN: __fastfail

https://learn.microsoft.com/en-us/cpp/intrinsics/fastfail?vi...

[augusto-moura]

I don't think binder is upstream, nor is the default in many distros. AFAIK support is very limited as not a lot of people use it. In arch it is provided only as a community package (AUR) [1]. This was a major blocker for me when trying to install anbox or waydroid, custom compiled kernel modules is a no-no for me, not because of security issues (which could exist), but because they can break a lot of stuff and fixing kernel modules is not a stroll in the park.

[1]: https://aur.archlinux.org/packages/binder_linux-dkms

[mappu]

It was moved from linux-staging to proper Linux in 2014 [1], and it's included with Debian oldoldstable, oldstable, and stable as well as Ubuntu linux-image packages, as a module binder_linux.ko; just need to modprobe binder.

1. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/lin...

2. https://packages.debian.org/search?suite=buster&arch=any&mod...

[ac29]

It is upstream and Arch gives directions for enabling it in the standard kernel: https://wiki.archlinux.org/title/Waydroid#Building_a_kernel

[yjftsjthsd-h]

I'm reasonably confident that it is upstream: https://github.com/torvalds/linux/blob/master/drivers/androi... looks like the most obvious bit, though there are other pieces. (And now I'm curious why waydroid is maintaining their own dkms code separate from that; perhaps it's to better target a range of kernel versions?) I will agree that it's not generally actually built/used by distros.

[deaddodo]

> At this point, an x86 Android image will be better and more reliable. Somewhat just as fast.

I'm pretty sure the overhead for something like Windows Subsystem Android is a few percentage points max, assuming the video card supports the proper OpenGL subsystem (so doesn't require software fallbacks). In fact, given that most x86 laptop CPUs and GPUs offer much more performance than most phone ARM chips, it's basically a moot point. The big problem is finding packages built universally or specifically for x86 (not sure what the status is for WSA on Windows ARM, but that could be an option too).

I'm still waiting for the day Linux offers something similar. Or FreeBSD does something similar to their Linux ABI compatibility.

Edit: looks like WSA is being ended in early 2025:

https://learn.microsoft.com/en-us/windows/android/wsa/

Due to not being able to integrate a store and make revenuue:

https://www.windowscentral.com/software-apps/windows-11/here...

What a shame.

[yjftsjthsd-h]

> I'm still waiting for the day Linux offers something similar.

Waiting? Waydroid is several years old at this point, and you've always been able to run Android in a VM via either Google's official device emulator in the SDK or just running https://www.android-x86.org/ et al. in whatever hypervisor you prefer.

[cyberax]

Android-x86 is dead. The last commits are from years ago.

Waydroid is slightly more alive, but only barely. And it itself is a fork of now defunct Anbox.

[deaddodo]

Sorry, I should have rephrased that:

I'm still waiting for Linux to offer a good version of that. I currently use waydroid, and it's barely functional.

[surajrmal]

Google launched the play store on Windows without wsa. I assume that's a big reason it collapsed.

[yjftsjthsd-h]

> At this point, an x86 Android image will be better and more reliable. Somewhat just as fast.

You mean a full VM?

[sigh_again]

No, merely using the standard Android emulator, as well as the x86_64 images that have been available for a while (or the ARM64 ones if you're on an M1 and others). With hardware acceleration properly setup, it's a nice experience. https://developer.android.com/studio/run/emulator-commandlin...

It does tend to be very unhappy when the system gets under load though, and might be sluggish if you're running a dozen IDEs on the side.

(Which, as comment under says, is technically a VM. But QEMU gets a pass at pretending not to be a VM and rather just black wizardry that makes bytes happy)

[NoahKAndrews]

The Android Emulator is a full VM under the hood. Waydroid is a lighter-weight alternative that uses the Binder implementation in the Linux kernel.

[stuaxo]

I always have trouble with AnBox and Waydroid - when it comes to Binder.

It seems like there were changes made to Binder between the version in Linux mainline and the one in Android.

Until that is properly synched up then using something else will be easier.

[refulgentis]

Binder is upstreamed into Linux.

But I feel I don't know much about binder/kernel/IPC: maybe I overestimate what that means?

[yjftsjthsd-h]

Binder is in mainline Linux, but I was under the impression that most distros aren't building it by default?

[quotemstr]

Plus, Linux itself should adopt binder. It's already upstream and actually pretty good.

[pjmlp]

Drivers? Binder. App extensions? Binder.

[Cloudef]

The project seems to be built on top of my android2gnulinux project from way back. Nice to see someone picking up the pieces and making it more functional.

https://github.com/Cloudef/android2gnulinux

[charlieboardman]

I have been hoping for compatibility layer + application flatpaks for a while so it’s nice to see someone doing it. My dream is to have a bunch of flatpaks for the Microsoft office suite

[irunmyownemail]

I don't use flatpak, snap or appimage so it's good that it doesn't need flatpak or similar.

[OsrsNeedsf2P]

Can I ask why?

A few years ago we stopped distributing on Linux outside of Flatpak. It was tiring getting bug reports that were only reproducible on certain drivers and setups, not to mention the weekly "how do I install this on <new distro here>".

We've seen people complain about the extra space it takes on disk, but after deduplication and compression the tradeoff to have Linux apps "just work" is worth it (imo)

[yjftsjthsd-h]

> Can I ask why?

I dislike the way flatpak is effectively a second distro on top of whatever else I'm running; it eats a rather lot of additional disk space (and network bandwidth), requires that I run updates for it in addition to everything else, and I'm not sold on its security patching story (last I looked, it strongly favored everyone effectively vendoring most dependencies and I don't trust them to keep up with patches like my actual distro).

To be fair, there's also a list of reasons I do like it, just... both pros and cons.

> It was tiring getting bug reports that were only reproducible on certain drivers and setups

I'll give you userspace, but drivers should be like the one thing that flatpak doesn't help with? It's the same kernel, not a VM.

[SXX]

Not someone you asked, but I personally tend to avoid it because it makes my system less transparent to me.

Isolated self contained containers are cool for enterprise setting with huge fleets of machines, frequent updates, etc. But it's not optimal for desktop Linux atm because no one secured any of desktop APIs and there are no easy way to inspect WTF each container is doing and why. Is it ships outdated deps? Is there crypto miner in or its just random hung process eating 100% of one cpu core?

Basically each app in self contained container have its own universe and you will never figure out what exactly its doing. So its turn your system into a black box.

As maintainer of OSS software and game developer I totally get the appeal, but as user I love Linux exactly because it's give me more transparency and I dont want to lose it.

[pmontra]

I have no idea if all flatpack apps update their own vulnerabilities once they are discovered. The distribution usually does it. Then I hate the idea of having boundaries between apps and imperfect integration with the desktop environment. Furthermore I don't really need any app distributed as flatpack so far, so I don't care. When I see one I only miss giving it a try but I don't miss using it to do my daily job. I could even said that flatpack is a good thing for me because it encapsulates all the possible distractions and makes them unreachable.

Anyway, I'd rather use flatpack than snap. I left Ubuntu for Debian because of it. I hope it goes the way of the other Canonical's unsuccessful attempts at building their own proprietary system and moat.

[kaba0]

Not the parent commenter, but I feel it mixes sandboxing and a non-ideal packaging method together.

Something like nix solves the second problem so much more elegantly.

[irunmyownemail]

I read through the commenters who responded before I saw your question this morning and feel they all did a great job with their answers and agree with them.

[bubblesnort]

It's conceptually similar to wine, but rather a reimplementation of the reference Android, which is AOSP.

See https://gitlab.com/android_translation_layer/android_transla...

[NoahKAndrews]

Better link: https://gitlab.com/android_translation_layer/android_transla...

[pantalaimon]

What’s wrong with binder?

The problem with Waydroid is that you need to boot up a whole Android system, which is not great for app startup time.

[xelamonster]

I keep my Waydroid session running in the background, managed by a systemd user-level service. Works great, and if it increases resource usage I don't notice--this is on a converted Chromebook so pretty low specs.

[NoahKAndrews]

Definitely. I'd never heard of this one before; I'd love to read a full comparison between the two.