But what next? Well, hopefully someone will read it. However, there is a problem; your paper doesn’t describe a panacea, there are no cute pictures of tiny lizards and it may get lost in the wash of important news stories that continue to roll.

Hmmm…. I wouldn’t worry too much though. I’m sure someone will read it. In a year or two it might start to get cited and it will probably be useful for the introduction to someone’s PhD thesis. Your Mum is going to be really pleased that you’ve published a paper and, hey, imagine how cool it will be to say you’re a published author the next time you’re at a party.

Is that it? Surely not! Your research is important and that’s why you started the project in the first place. You want it to make an IMPACT don’t you? So, is it enough to be just another researcher?

I recently came across these two youtube videos that aim to broaden the impact of research. I would argue that in the age where the internet allows you to easily access many thousands of minds it is not enough to merely cast your work adrift in pubmed and hope for the best.

What do you do to make your research stand out? If you know of any other examples of researchers making the most of their work drop me a line in the comments box!

Jonathen Smith: They Go To Die

Jonathen Smith, a lecturer in Global Health and Epi­demi­ol­ogy at Yale Uni­versity, has made a documentary about his experiences of researching the TB epidemic among South African gold miners. “I became acutely aware that the end result of any research con­ducted on this issue is that min­ers con­tinue to die.”

Susanna Cramb: Bayesian Spatio-Temporal Modelling

Susanna Cramb, a PhD student at the Queensland University of Technology, demystifies her research using Bayesian spatio-temporal modelling through the medium of animated Lego.

Over 1 billion people practice open defecation. (Image credit: Rémi Kaupp; wikimedia commons)

Diarrhea, abdominal pain, malaise, anemia, and delayed child development: these are the debilitating effects of one group of diseases, the soil-transmitted helminths (worms). As indicated by the name, these diseases are transmitted via contaminated soil; as such, good sanitation has a key role in prevention. However, because sanitation systems vary greatly, their impact is difficult to study. Now, a PLoS Medicine systematic review and meta-analysis (a reanalysis of data from already published studies), by Ziegelbauer and coauthors, quantifies the benefits of sanitation: for all three of the STHs, when sanitation was both available and regularly used, the odds of getting a worm disease was cut in half.

One billion of the world’s people experience a diminished ability to work, learn, and thrive as a result of infection by these parasites  – roundworm, whipworm, and hookworm. The resulting losses in quality of life and productivity can trap people in a cycle of poverty and stigma and diminish their ability to care for themselves and their families.

Currently, the primary approach to the problem is repeat drug treatment. As important as drugs are, though, they also have limitations: reinfection in endemic areas; possible reduced efficacy and development of resistance; and supply, delivery, and compliance problems. Drug administration can go only so far, and currently many programmatic goals are not being met. For the STHs, many authors argue that integrated control is the only hope for lasting improvement (see Further Reading).

Integrated control of infectious diseases involves not only drug treatment to knock down the illness itself, but preventive measures such as education of at-risk communities, surveillance and research, strong healthcare systems, vector control, safe water supplies, good hygiene practices, and adequate sanitation systems.

Thus, Ziegelbauer and coauthors urge, drug treatment should be only part of efforts toward STH control; sanitation should also be emphasized. And the authors point out something that drug treatment does not do: “Implementation of sanitation facilities and integrated control approaches go far beyond the prevention and control of intestinal helminths; they impact other neglected tropical diseases, such as schistosomiasis, trachoma, and diarrhea…and can even help promote social and educational advances for women and girls…”

Policy and funding support for integrated control that includes good sanitation should be a focus as the world fast approaches the deadline for the Millennium Development Goals with disappointing progress toward #7C (to “Halve, by 2015, the proportion of the population without sustainable access to safe drinking water and basic sanitation.”).

Further Reading

Hotez PJ (2008) Hookworm and poverty. In: Reducing the Impact of Poverty on Health and Human Development: Scientific Approaches. Ann NY Acad Sci 1136: 38–44.

The 2010 PLoS Water and Sanitation collection

WHO: Water Sanitation and Health

WHO / UNICEF Joint Monitoring Programme (JMP) for Water Supply and Sanitation

Ziegelbauer K, Speich B, Mäusezahl D, Bos R, Keiser J, et al. (2012) Effect of Sanitation on Soil-Transmitted Helminth Infection: Systematic Review and Meta-Analysis. PLoS Med 9(1): e1001162. doi:10.1371/journal.pmed.1001162

A cluster trial has been defined as a trial in which “the study, randomize[s] interventions to groups of patients (e.g., families, medical practices) rather than to individual patients”.

The group coordinating this consultation has developed a set of wiki pages, and has published a series of papers in the open-access journal Trials outlining what the issues are (each of the papers is accessible via the group’s wiki site above, as well as the journal website itself).

The consultation is dividing its efforts into defining and discussing each of six key ethical problems, each of which affects cluster trials in unique ways.

“Firstly, who is the research subject in a cluster trial? Secondly, when, and from whom, is informed consent needed in a cluster trial? Thirdly, does clinical equipoise apply in cluster trials? Fourthly, how should benefits and harms be assessed in cluster trials? Fifthly, do gatekeepers have a role to play in protecting the interests of those affected by cluster trials? Finally, what are the issues for cluster trials in vulnerable populations?”

These are important issues, as convincingly set out in the conference and in the introductory papers. Data presented in the webcast showed that a sizeable proportion (up to 30%) of published reports of cluster trials do not provide information on the ethical oversight, or consent procedures for the study. The chairs of research ethics boards consider the issues raised to be important, but do not apply protections consistently, and there’s a risk of both over- and under-regulating participants in cluster trials. For example, if ethics committees require consent from everyone affected in the randomized communities, for some types of cluster trials this may make the study unfeasible or consent meaningless (eg if interventions are applied at a community level, exposing everyone in a particular setting to the intervention, it may be completely unfeasible to avoid exposing individuals to the intervention even if they decline consent). The series of papers give some great real life examples highlighting what the problems and questions are.

So, what are the solutions on the table? The consultation sets out possible definitions for the research “subject” (or perhaps, more accurately, the research participant) in cluster trials. Specifically, this definition proposes:

“A research subject is an individual whose interests may be compromised as a result of interventions in a research study”

This definition would include individuals who are directly intervened upon by investigators for research purposes; individuals who are intervened upon by manipulation of their environment by investigators for research purposes; individuals who interact with investigators for the collection of data; and individuals from whom investigators obtain identifiable private information for the purpose of collecting data.

The guidelines under development also distinguish, as previous work has done, between different types of cluster trials, and this helps define at what level, and which individuals should be protected as research participants. Three types of cluster trials are defined – “cluster-cluster” trials (interventions are applied to entire clusters and not to individuals); “physician-cluster” trials (interventions are intended to affect the process of care offered by physicians, and thus their patients are indirectly affected); and “individual-cluster” trials (in which groups of individuals are randomized, but interventions are applied to individuals within those groups). Defining these different types makes it easier to work out whose interests need to be protected in the trial, and how. It’s also clear that editors need to do a much better job of encouraging authors to explain how they viewed the ethical implications of their cluster study, and at what level they applied specific protections such as consent, and why.

The guidelines group is still keen to hear from interested parties and you can post your discussion questions via the wiki pages – so if these issues are important to you, read the papers and get involved with the group. A summary of the webcast will also be posted on the site.

Recent cluster trials published in PLoS Medicine include:

Roca A, Hill PC, Townend J, Egere U, Antonio M, et al. (2011) Effects of Community-Wide Vaccination with PCV-7 on Pneumococcal Nasopharyngeal Carriage in The Gambia: A Cluster-Randomized Trial. PLoS Med 8(10): e1001107.

Cuevas LE, Yassin MA, Al-Sonboli N, Lawson L, Arbide I, et al. (2011) A Multi-Country Non-Inferiority Cluster Randomized Trial of Frontloaded Smear Microscopy for the Diagnosis of Pulmonary Tuberculosis. PLoS Med 8(7): e1000443.

Kangwana BP, Kedenge SV, Noor AM, Alegana VA, Nyandigisi AJ, et al. (2011) The Impact of Retail-Sector Delivery of Artemether–Lumefantrine on Malaria Treatment of Children under Five in Kenya: A Cluster Randomized Controlled Trial. PLoS Med 8(5): e1000437.

Luoto R, Kinnunen TI, Aittasalo M, Kolu P, Raitanen J, et al. (2011) Primary Prevention of Gestational Diabetes Mellitus and Large-for-Gestational-Age Newborns by Lifestyle Counseling: A Cluster-Randomized Controlled Trial. PLoS Med 8(5): e1001036.

My 2010 competing interests are on the PLoS Medicine site.

“Peer review in scholarly publishing, in one form or another, is crucial to the reputation and reliability of scientific research… However, despite the many criticisms and the little solid evidence on its efficacy, editorial peer review is considered by many as important and not something that can be dispensed with”.

So I was pleased to see a recent study reported in BMJ which takes a rigorous approach to evaluating the impact of one particular component of peer review. This study aimed to find out whether the use of reporting guidelines in peer review can improve the quality of published papers.

The researchers use this definition of a reporting guideline:

“statements that provide advice on how to report research methods and findings… they specify a minimum set of items required for a clear and transparent account of what was done and what was found in a research study, reflecting in particular issues that might have introduced bias into the research”

The study used a randomized design, in which 92 papers under evaluation at the journal Medicina Clinica were randomized to intervention or control arms. For “intervention” papers, the authors received an additional, reporting-guideline driven evaluation from a senior statistician (on top of regular peer reviewers). For “control” papers, authors received just the regular reviews. An interesting feature of the trial design was that all papers received the additional, reporting-guideline led review, but this was only sent to authors in the intervention (and not the control) arm; randomization was actually done after the reporting guideline review was completed. By doing this, the investigators were able to collect detailed baseline data on study quality, and to ensure the person doing the guideline-led review could not be biased with respect to group assignment. The instrument used to rate study quality was the scale developed by Goodman and colleagues.

What did the study show? Well, it’s a little bit hard to tell, and the evidence does not look desperately strong. In the study four papers in the “control” arm had to go through a reporting guideline-led additional review, because the editors were worried about protocol deviations in the studies reported in the papers. So these 4 papers crossed over from one arm to another. The investigators then analyse their data both intention to treat (handling the 4 crossover studies in their randomized group) and as-treated (handling the 4 crossover studies in the reporting-guideline led review group). The intention to treat analysis gives you an effect estimate for improvement of 0.25 (95% CI -0.05 to 0.54) (comparing intervention vs control arm) on the Goodman scale. The “as-treated” comparison is better, 0.33 (95% CI 0.03 to 0.63) – so if you are keen on per-protocol analyses you might conclude from this that reporting guidelines improve study quality (a bit) more than not using them… A cynic might say the study is just a bit underpowered, and if there is an effect, it’s fairly small. Of course, there does also seem to be evidence that papers in both study arms improve during peer review, although this wasn’t an objective of the project.

So what can you conclude? Firstly that it is tough to deliver properly designed studies such as this, which aim to concretely investigate the benefit (or otherwise) conferred by specific facets of peer review. The study did not definitively answer its question as to the benefit provided by use of reporting guidelines but will help others design similar studies in the future. And finally, editors and journals still operate with a huge set of “reasonability” assumptions about what works and what doesn’t, but we lack strong evidence informing a huge amount of what we do.

My competing interests are declared here. In addition, since that page was updated I have received reimbursement for local travel expenses to contribute to seminars organised by the EQUATOR group (an initiative aimed at promoting the quality and transparency of health research – and which collects together reporting guidelines). I have also contributed to the development of a number of reporting guidelines, some of which also had the involvement of some of the authors of the BMJ paper discussed in this blog.

In a blog posted on January 25, 2011 I proposed that ministers of health in developing countries must strive to strengthen health research in their countries by addressing several key questions, which will be the focus of the World Health Report 2012:

How should research priorities be set? What human and institutional capacities are needed? How to ensure ethical and good behaviour? How to promote transparency and accountability? How should knowledge be translated into action? What is the best way to coordinate research among the many performing it, and when so many health challenges involve sectors beyond health?

In the past 10 months we have run these ideas past a series of interested party consultations in order to gauge the validity of the focus and scope of the Report. While the central theme remains solidly relevant and important, two additional areas have been included to broaden the appeal, and potential value, of the Report.

First, there is a perception that the target audience should broaden. At the end of the day there are fewer than 200 ministers of health in the whole world and perhaps the Report should be aiming at a broader group of national health (and health research) policymakers. In many developing countries, where ministers of health are often short-lived political appointees, targeting the Report at decision- and policy-makers in executive, operational, leadership and managerial positions would seem to be a sensible approach. Importantly, this broader outreach should go beyond ministries of health as research funding is often controlled by other, more powerful ministries such as science & technology, finance and education.

Second, and while continuing to advocate for the importance of research in diagnosing the problem, deciding on appropriate interventions and relevant scale-up strategies, it was felt that we also needed to convey some excitement about science and research. We will therefore aim to show how research can contribute new insights by including some examples of emerging research issues with potential impacts on health including innovative technologies (e.g. advances in genomics, personalized medicine, stem cell therapy, etc), zoonotic diseases, climate change, agriculture and health.

These two additional dimensions underscore the subtle but important shift from ‘No Health Without Research’ to ‘Research for Health’ thus acknowledging that health, and the role of research, has become very multi-dimensional and inter-sectoral in nature and a broader, more inclusive approach is thus necessary.

The World Health Organization is continuing its collaboration with PLoS Medicine to develop the Collection announced previously elaborating on the themes driving the Report. The PLoS Medicine / WHO Collection will help capture the richness and diversity of country experiences in how to strengthen health research systems. A collection in an open access platform will allow all researchers, rich and poor alike, to contribute equally to the global pool of knowledge. The sharing of such experiences will complement and reinforce the practical advice contained in the World Health Report.

In relation to the expanded themes of the Report outlined above, submissions relating to research describing experiences with decision- and policy-makers within ministries of health and inter-sectoral policy development would be especially welcome. In addition papers on the implications of new technologies as it affects health care delivery and other, inter-sectoral aspects with potential impacts on health in developing countries (e.g. climate change, agriculture, trade, food security, etc) would also be welcome.

The WHO-PLoS Collection will bring together content from across the PLoS journals. Prospective authors wishing to submit articles for the WHO-PLoS Collection should submit initially to PLoS Medicine, and submissions will then be directed as appropriate to the most relevant PLoS journal, where they will be evaluated as per the journal’s usual policies, scope and standards.

To find out more about the WHO/PLoS Collection and how it will inform the World Health Report 2012, go to the collection site. Prospective authors should submit directly to PLoS Medicine via the online submission site or contact the editors on whr2012@plos.org.  We recommend that authors wishing to submit work to PLoS journals for potential consideration in the WHO/PLoS collection should submit their articles within the next two months (ie by the end of January 2012) to stand a good chance of their findings informing the eventual Collection and Report.

Competing Interests: Tikki Pang is with the World Health Organization’s Innovation, Information, Evidence and Research cluster and is the focal point for the development of the World Health Report 2012.

Today we launched a new submission and peer-review system for PLoS Medicine. The system is called PLoS Editorial Manager and it puts us on the same software that PLoS ONE migrated to a few weeks ago. PLoS Biology also moved today and the other PLoS titles will migrate to the new platform next week.

New submissions will be directed to PLoS Editorial Manager.  If you are a PLoS Medicine author who has  a manuscript currently under consideration then your manuscript will continue to be processed in the old system for a period of time.

Read  more about the PLoS journals’ migration to this new submission site and some of the benefits we hope it will bring.

Please feel free to get in touch with us at plosmedicine@plos.org if you have any questions about the new system or if you want to provide your feedback as an author, reviewer or academic editor using the new system.

Although the study is very small, and the lack of response was due to a number of differing issues including incorrect email addresses for two authors, nevertheless, the study raises important questions about whether authors really understand what journals’ policies on requiring data sharing means, whether they are willing to abide by such policies, and what journals can do to enforce such policies.

Our policies state

“Data Availability

Open access applies to both the scientific literature and the data used to establish that literature. Publication is contingent on making data integral to a manuscript freely available without restriction, provided that appropriate attribution is given and that suitable mechanisms exist for sharing the data used in a manuscript and that in the case of clinical information patient confidentiality is not compromised.

1. Data for which public repositories have been established that are in general use should be deposited before publication, and the appropriate accession numbers or digital object identifiers published with the paper.
2. If an appropriate repository does not exist, data should be provided as supporting information with the published paper. If this is not practical, data should be made freely available upon reasonable request.
3. The conclusions of a study must not be dependent solely on the analysis of proprietary data. If proprietary data were used to reach a conclusion, and the authors are unwilling or unable to make these data public, then the paper must include an analysis of public data that validates the conclusions so that others can reproduce the analysis and build on the findings.

Note that any restrictions on the availability or on the use of datasets might be judged to diminish the significance of a paper and will therefore influence the decision about whether a paper should be published. These policies have been developed in accordance with the principles established in Sharing Publication-Related Data and Materials (National Academies Press, 2003).”

We do not know who the authors contacted by Vickers and Savage were. During the review process of the Vickers paper at PLoS we offered to ourselves contact these authors, but the investigators declined. It is possible (though not an excuse) that the authors contacted by Vickers and Savage did not take the request as seriously as they should—indeed, as the investigators noted in the PLoS ONE paper “Our method of requesting data sets was intentionally left vague as we were interested as much in the investigators responses as acquiring the actual data set; perhaps a more detailed request would have garnered more positive responses.”

We would hope that the investigators’ conclusion that “our findings suggest that explicit journal policies requiring data sharing do not lead to authors making their data sets available to independent investigators” would not prove to be generally true.  However, even if these authors are not representative more generally of PLoS authors, the findings remain troubling. We take the issue of data sharing very seriously—if we are made aware of failure to comply with our policy of data sharing will gladly contact authors ourselves. On occasion, as in one recent case, a reason for non-compliance may become apparent, i.e., that supplying data would have compromised patient confidentiality. In other cases where we have contacted authors, they have quickly complied.

We will be looking at the language on our instructions and ensuing authors are aware of it at submission. The scientific world expects authors to be able to stand by their results; a critical part of this is making the data available if others need it. Non compliance for trivial reasons is not acceptable. At PLoS Medicine should an author fail to comply we would consider it appropriate to post a note on the online paper to that effect. In disagreements involving requests for data, we may also refer the requestor to officials at the author’s institution, or vice versa.

As part of our ongoing article-level metrics program, we’re delighted to announce that all seven PLoS journals will now provide online usage data for published articles, going back to their date of original publication. With this addition, the suite of metrics on PLoS articles now includes measures of: online usage; citations from the scholarly literature; social bookmarks; blog coverage; and the Comments, Notes and ‘Star’ ratings that have been made on the article.

As discussed recently, we at PLoS feel that there is much to be gained from assessing research articles on their own merits rather than on the basis of the journal (and its impact factor) where the work happens to be published. Until recently, however, readers have simply not had suitable tools to give them any indication of the quality (or ‘impact’) of an individual article. With the advent of online publishing and a burgeoning array of third parties providing information on scholarly articles, it has finally become feasible to provide meaningful article-level metrics and indicators for readers.

PLoS has therefore embarked on a program to aggregate a range of available data about an article and place that data on the article itself. The data are found on the new tab called ‘Metrics’, available on all articles. A reader can now scan the various metrics to determine the extent to which the article has been viewed, cited, covered in the media and so forth. With the addition of usage data to the article-level metrics we have taken another step towards providing the community with valuable data that can be used and analyzed.

In order to make article-level metrics as open and useful as possible, we are providing our entire dataset as a downloadable spreadsheet and we encourage interested researchers to download the data and perform their own analyses. We will be updating this spreadsheet periodically, but on launch the data it contains are correct up to July 31st, 2009. Future developments in our article-level metrics program will include the provision of more data for each metric (whenever we can locate high quality sources) and new indicators as they arise, as well as the development of more sophisticated display and analysis tools on the site itself.

We believe that article-level metrics represent an important development for scholarly publishing. While some publishers are providing limited data, we are not aware of any publisher that has gone as far as PLoS in providing such a broad range of indicators and metrics, and in making the data openly available. We invite you to visit our journal sites and seek out the Metrics tab for each article.

It’s also important to emphasize that online usage should not be seen as an absolute indicator of quality for any given article, and such data must be interpreted with caution. To provide additional context and to aid interpretation, we have provided a series of summary tables indicating the average usage of categories of article (grouped by age, journal and topic area). Users will also notice that a number of articles do not have any usage data, because of problems with the log files. We are working hard to add data for these articles, and we also encourage readers to let us know if they find any anomalies or have any questions about the data.

More information about our article-level metrics program can be found in our FAQ, this explanatory website as well as in this page of descriptive text for each journal (e.g for PLoS Biology and PLoS ONE). We look forward to your feedback, and to further developments in article-level metrics.

Mark Patterson, Director of Publishing

Media and other enquiries to Liz Allen, Director of Marketing, Tel (001) 415 624 1218

The committee was set up to focus on specific areas where there was particular potential for collaboration between Chinese and UK researchers – including three fields chosen for special attention – stem cells; clinical trials relating to emerging infections; and Traditional Chinese Medicine.

The report highlights that the system of ethical review (involving Institutional Review Boards) differs somewhat between the UK and PRC, with little national-level oversight of IRB function in PRC. In addition, the committee found that “Chinese guidelines are notably less specific than international guidelines in ensuring the independence of IRBs from the institutions they are scrutinising”, and frequently lacked members independent of the research centre.

Regulation of stem cell research and therapeutic applications is also an area where collaborating researchers should be aware of important differences in oversight.

The report sets out specific recommendations for UK and Chinese researchers who engage in research collaboration.