[dalke]

As you point out, not all academic institutions have this access. For example, a college which only teaches undergraduates is unlikely to subscribe to the specialist journals, even though a couple of the professors will be interested in those topics. (One common solution is for, say, the chemistry professors to get a personal ACS membership, which gives access to a limited number of ACS journal articles per year.)

There are researchers at companies. There are researchers with no affiliation. Many have an issue with paywalls even though you haven't.

I'm a self-employed software developer in cheminformatics who also does research in the history of the field. I can do this because the local(ish) chemistry library has most of the papers on paper in the basement. It's a public library, supported by my taxes. Otherwise it would be very expensive to get copies of the hundreds of papers I've read or looked through.

As an example, one of the papers from the 1960s has information I wanted in 'figure 2'. Only it turns out that figure 2 was swapped with figure 2 from the next paper in the journal. Both papers were by the same author. I don't know if it's an author error or a layout error by the journal. It would have been much harder to figure that out if I had to ask friends at another site for a copy of the paper in the first place.

So yes, I am a researcher whose research is restricted by the cost of reading the latest journals. My decision to look at the history of the field, rather than the present, is partially influenced by the fact that I have better (read "cheaper") access to the old materials than the new. Interlibrary loan is amazing.

[simoncarter]

Your response implies that you've not read the thread of comments I was contributing to. I wasn't taking a position on firewalls, nor on the current publication/journal practise. Rather, joelthelion tried to argue that paywalls could possibly explain the lack of citations for more recent publications. I gave counter arguments. Not sure what your comments on the right or wrongs on paywalls and journalling practises have to do with this?

> There are researchers at companies. There are researchers with no affiliation. Many have an issue with paywalls even though you haven't.

I never made any comment either way. I really don't see how you can make that comment. Just mentioned that researchers I have known find ways to get round paywalls, if they ever happen to to encounter one, if needed, including even emailing the author of the papers. If you want to publish you can't submit a paper for review without having demonstrated knowledge of the related literature, and where your work fits within that. Researchers will find a way to read and cite the relevant literature that they need to, and thus can't be used an excuse for lower citations for more recent papers.

EDIT: Didn't intend for my post to be harsh.

[dalke]

The thread is "the diminishing impact of modern paper because ... " with the alternative suggestions that a) 'every scientists know they are not worthy', and b) 'because they are behind a paywall'.

You replied to (b), saying that that likely wasn't the case because "I can't see paywalls being an issue. It certainly never was for me or my former colleagues [at academic institutions]."

My reply is two-fold. First, it affects me. I am writing a paper. I have excellent citations from the 1950s to 1980s because all of that is on paper, which is easily ("cheaply") accessible to me. I don't have good citations for the 1990s and onwards because those cost something like $30 each from the publisher. (It's actually cheaper to get most of them through Interlibrary Loan, which has much lower page charges than the publisher.)

Hence, just like you have observations that it doesn't affect your research, I have a counter-observation that it does affect my research.

The second point was to highlight your implicit suggestion that nearly all research is done at academic institutions. While you didn't say it explicitly, your counter-argument is very weak unless you make that assumption. I don't think you meant to make a weak argument. With the same weak argument, I could say that it affects me, and friends of mine who are self-employed or working in small companies, so therefore everyone must be affected by it.

Now, I think it's true that most published research is from academics, though since I work in mostly pharmaceutical chemistry I can say that many publications in my field come from industrial research.

"If you want to publish you can't submit a paper for review without having demonstrated knowledge of the related literature, and where your work fits within that."

Yes, I know that. The cost of doing the literature research has made it very hard for me to publish. Indeed, that's my point. As a self-funded researcher, I can say that science is an expensive endeavor.

"and thus can't be used an excuse for lower citations for more recent papers"

Strictly speaking that's not true. It could be that more people are publishing historical reviews. It could be the modern trend to include older citations. If you look at papers from the 1950s, you'll see that there might only be a few citations. By comparison, the modern citations sometimes seem to use the citations as a badge of honor, or proof that the person is scholarly.

Based on the evidence in the paper, therefore, you cannot make the conclusion you did. Nor can the paper's authors, since all the paper did was observe a trend that is in alignment with the hypothesis. The next set of tests might be to pick out a selection of papers and ask people now to judge which items need a citation. If the same set of judges say that papers from the 1990s should have had more citations, then this would suggest that there's been a cultural change.

The paper suggests that multiple factors may be involved. It does not identify which of those are the most important. They point out that the chemistry field is one of the few which hasn't changed. This happens to be my area of experience.

Mechanical search of chemical documentation started in the 1940s with punch card machines. Organizations like CAS, from the American Chemical Society, have long existed to make chemical documentation more searchable. Companies like ISI (now Thompson Reuters) started in the 1960s to computerize entry and keyword-based search, with online searches by the 1980s, though not full-text search.

The lack of change may indicate that the search technology of the 1980s, based on human indexing and keyword searches, is sufficient for the gains seen. To be fair, chemical publications is more open to keyword indexing than, say, Health & Medical Sciences. (I know this from reading some of the ISI publications, dating from when they entered the Health & Medical Sciences field.)

This paper says "between 1990 and 2013, the number of scholarly articles published per year grew close to 3-fold. As a result, there is much more recent work for researchers to learn from, build upon and cite". I've been reading the chemical documentation literature from the 1960s and 1970s. They were talking about exponential growth back then.

For example, I have a chemical information text book from the early 1970s saying that the doubling time for chemical documentation is about 13 years. I checked the modern numbers, and it's still holds.

If the exponential rate of growth is the same then and now, then a paper in 1990 would be equally biased towards recent decade papers, on a percentage basis, as someone writing now. That's how exponential curves work.

So, I'm not all that convinced about the paper. They aren't able to distinguish between a cultural change and an access to information change, or if it's due to improved search technology (eg, 1970s tech but with auto-indexing) or due to easier access to the literature.