Probably not easily, if at all. Additionally, it's ARM so you'd be limited to what's available in Arch Linux ARM. There's a Linux version of the very similar Intel Compute Stick for about $110 that you may be interested in.
Honestly, you don't want the Linux version of the compute stick. It's got a gig of RAM and 8 gigs of flash. Getting a windows stick for the increase in RAM and flash, and then doing a nuke and pave seems like a much easier route.