Maybe in a small town public library, but you will be dealing with kids all the time. Otherwise, you won't have time. I spent years working in academic libraries and you are always expected to be doing something. If you aren't working a desk job, then it's basically like any other office job. Even if you have some boring desk job you'll be expected to be filing or labeling something or working on some part of a project assigned to you. Plus, you'll be constantly interrupted. Remember, librarians take their jobs excessively seriously and expect all library staff to do the same.
Also, the title "Librarian" requires an MLS.