How do you read papers?

Working in science is as much about reading papers as it is about writing papers. There are usually two ways you can come across an interesting scientific paper:

  • Active Searching. Literature search on a particular topic
  • Passive Browsing. Scanning the literature in regular intervals for papers of interest

The focused active search is typically used when you collect information for a research project or write a paper or grant proposal. This is stuff for another blog post and can be better explained by a science librarian like Oliver Obst or Frank Norman. Now I want to talk about different ways to keep track of the current literature in your field. I would assume that most if not all people involved in science do this in one way or another, and I also think that many people are struggling with the best strategy (see Richard's related post on this topic: Too many fish in the sea).

The basic concept behind browsing is that it is a passive activity where the scientific papers come to you regulary in one way or another. A good strategy should be efficient (not involve too much of your time), cost-effective and should have a good signal to noise ratio (i.e. finds many interesting papers without going through too much uninteresting stuff).

Journal Subscriptions
The old-fashioned way. You receive a print copy of journals of interest in regular intervals and flip through the journal. This strategy works for a few journals, but is usually too expensive and too unfocused as a general strategy. I currently have three personal journal subscriptions, but the main reasons are that I either can't get them in electronic form or have no institutional subscription. Departmental subscriptions that are circulated around help saving some costs. But I have to confess that I haven't been to a library to flip through a few journals for more than 10 years. I very much like the feeling of a printed journal in my hands, but browsing in electronic form is not only cheaper but also much faster (even more so with articles released early in electronic form). Many journals now exist only in electronic form or publish articles continously rather than in a weekly or monthly schedule.

Journal tables of content (TOC) by email or RSS
I would guess that this is currently the most popular browsing strategy. I prefer RSS to email because it means less clutter in my email inbox and because every journal article is a separate item that can be saved for later. I currently follow 8 journals. Papers also uses this strategy, but this feature could be refined in future versions of the program. The TOC strategy probably works best for the leading journals in your field of research, but isn't very efficient for journals with only 1-2 interesting articles per issue, e.g. high volume general interest journals such as PNAS. Podcasts (e.g. the Nature Podcast) are basically extended TOCs in audio format.

Filtering by experts
You let someone else do the filtering for you. The traditional approach is the review article. The major drawback is of course the delay between publication of the original research and the publication of the review. A different – and faster – approach is used by Faculty of 1000 Biology (they also have a similar service for medicine). The most interesting papers are highlighted and reviewed by leading researchers in the field. Research Highlights in Nature and similar features in other journals try to do the same on a much smaller scale.

Filtering by experts is a resource-intensive and subjective process, and it is very possible that very exciting research published in an obscure journal might be missed. Most will remember that internet search started out with expert filtering, exemplified by Yahoo. It didn't work.

Filtering by author or keyword
A good browsing strategy should consider the papers you have read already. In the approaches mentioned above this happens in your mind when you flip through the table of contents of a journal. A smarter approach is to regularly receive customized searches (again delivered via email or RSS). This is a popular strategy (explained here for PubMed) and can involve keywords (e.g. the molecule or organism you work on) or authors (your colleagues and competitors).

Filtering by papers you read
A more systematic approach would not just pick a few keywords, but would use the information from all the papers you've read already, particulary those that you liked. Social bookmarking tools such as Connotea or CiteULike have this information, but only if you give type in all those papers. It is more convenient to use that information directly from your reference manager where you have stored references or even fulltext PDFs to your most important papers anyway. Reference managers are usually used for writing papers and unfortunaly don't yet use this information to help you find interesting papers. One reason I like Papers and Mendeley is that they both have the potential to fill this gap.

Filtering by papers others read
You probably have guessed that this blog post would somehow suggest a Web 2.0 solution to this problem. The papers stored in the reference manager of other scientists can of course be used to find papers that might also interest you. This process can of course be automated (rather than the personal recommendation from a colleague) and should be anonymous. But neither Connotea nor CiteULike do that, and I don't know of any other online tool currently available.

In 2010 I want to use a tool that scans Pubmed or other databases for papers of interest based on the papers stored in my reference manager. The tool would give me a weekly report that can also be printed out for reading and note taking.

Related Posts Plugin for WordPress, Blogger...
This entry was posted in Snippets. Bookmark the permalink.

9 Responses to How do you read papers?

  1. Frank Norman says:

    Martin – thanks for the plug! I agree with your general drift, but have a few points to make.
    I think that no single approach is guaranteed to get everything. I suspect that most people will use a combination of the methods that you describe. A method you don’t mention is talking to colleagues – very low tech but often useful I remember one senior scientists telling me that, beyond a core of 6 journals he scanned, he relied on his postdocs to alert him to interesting papers to read.
    Regarding your distinction between active searching and passive browsing, I am not so convinced but perhaps I am out of touch. We used to run a lot of alert searches here. These are focused searches (usually we used Medline) that are run every week or month, aiming to give as tight or broad a coverage of a field as was wanted by the original requestor. Using all the ingenuity we could muster we tried to design the perfect search strategy. I always reasoned that it was particularly important to perfect the search since it was going to be run many many times.
    In the past most of our research groups had one or more of these searches, but I must confess that the service is less popular now, but I think it could still be useful to people.

  2. Frank Norman says:

    I do like the idea of using your personal reference database as a seed for current awareness alerts. A few years ago I tried touting the idea around some of the database producers but they seemed to think I was mad.
    One problem (as discussed at “Friendfeed”:http://friendfeed.com/mfenner ) is that people use their personal bib databases in such different ways. It may be difficult to make this work for everyone.

  3. Martin Fenner says:

    Talking to colleagues is indeed a very useful strategy to find interesting papers. The Web 2.0 tools I describe can expand this idea.
    I regularly use alert searches and I thought that they are still popular. Could it be that they are easier to create now, and maybe the help of a librarian is less frequently requested?
    The distinction between active searching and passive browsing can be useful. James Evans from the University of Chicago “published a study in July”:http://network.nature.com/people/mfenner/blog/2008/07/19/do-online-journals-narrow-science-and-scholarship where he observed that compared to the past, fewer journals and articles were cited and the cited articles were more recent. One explanation would be that the paper reading patterns have changed and people do more searching and less browsing.

  4. Frank Norman says:

    Martin – one of my theories to explain that observation was that as you say searches are easier to create so librarians’ help is less often requested … and actually the searches are less thorough than they ought to be! I am of course biased, and have no evidence to support that assertion.
    I was always at pains to construct a search strategy that went beyond the requestor’s original framing of the search topic. Otherwise there is the danger that you only find papers by authors who use exactly the same terminology as yourself.

  5. Richard Gayle says:

    If we could only get something as useful for Endnote as Genius is for iTunes? Part of the problem with searching is that we only find the articles we look for. Serendipity from browsing, or catching a News & Views, has provided me almost as many research answers as using PubMed for a search.

  6. Martin Fenner says:

    Richard, exactly my point. Genius/iTunes or last.fm for mp3 files are the model to do something similar with papers. This would not only be a very useful feature, but is also a very interesting business model.

  7. Martin Fenner says:

    When writing the blog post, I missed the paper by Duncan Hull that was just published in PLOS Computational Biology (“Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web”:http://dx.doi.org/10.1371/journal.pcbi.1000204). He describes four modes of getting to a paper:
    * Browse
    * Search
    * Recommend (from a collague, as mentioned by Frank
    * Read (using the reference list from another paper)
    I missed the last point in my blog post, but obviously that is a very common strategy.

  8. Joerg Kurt Wegner says:

    I use three major sources for finding new and interesting papers. One is “Google blogsearch”:http://blogsearch.google.com , which allows me to create RSS feeds for any keyword I like. Second, eMail alerts of journal subscriptions, though I do not like this too much, since nothing is sorted or ranked. Third, networking solutions connecting to scientists with similar interests, e.g. the “CiteULike”:http://www.citeulike.org watchlist, “FriendFeed”:http://friendfeed.com/ , and “Twitter”:http://twitter.com .
    Under consideration of the information overload problem, do I “rather trust people than technology alone”:http://miningdrugs.blogspot.com/2009/01/collaboration-bullseye-20-information.html .

  9. Martin Fenner says:

    Jörg, thanks for your tips and for the link to your detailed blog post. I totally agree that people are better than technology to solve the information overload problem, but why not mix the two?