[politelemon]

Depends if it's for work or personal.

For personal use, yes, as I do have a poke around in the source code as well its immediate project artefacts and community (if exists) to get an idea of project health and trustworthiness.

For work, not necessarily. I'd want to go for the most convenient option possible, that comes close to requirements and has a sufficient popularity. In some cases that might be an open source project, but even then it might be paid for by virtue of being managed by AWS, for example.