can probably get some form of local version control from IT and have access to VS Code. I was trying to plan out how to best do it.
You mentioned not coming from a CS background, but a Git provider may be able to help you with this. Github and Gitlab[1,2] are quite popular and easy enough to get started with. Of course you don't have to push your code to a remote repository, a local .git repo will be fine (just back it up somewhere)[3].