My (very small) tech nonprofit has started doing something similar [1], where everyone contributes to a list of OSS tools we use heavily, and then everyone gives a weight/score to each tool.
We then split the pot ($1,000 in 2022, probably ~$2,000 when I get around to doing 2023) among all the OSS projects, according to the relative scores.