[shadowfiend]

Should/shouldn't is hard to say. But the fact that they are bundled with browsers is absolutely amazing, not for the professional developer, but for the amateur. The fact that you can start messing with a website with almost no additional effort and with no additional software is amazing. IMO, it's what makes the web one of the environments with the least friction to start programming in. Visible results, full-featured programming (via JS), and readily available tools.

Once you start getting into complex frameworks and what have you, you start needing additional tooling, more knowledge, etc, but that's fine. The point is to start tinkering, you only need a browser. To start doing a little more than tinkering, you need a browser and a text editor (not like Sublime, like Notepad; on day 0 you don't care that much about syntax highlighting). Both of these come out-of-the-box on any computer.