A large proportion of biologically relevant processes take place at membranes. Studying the dynamics of these processes in real time and without disturbing the biological system is still a major methodological challenge. A team led by Petra Schwille, director at the MPI of Biochemistry (MPI ... more
New citation indicators needed to measure research performance
How do you compare the impact of a researcher in chemistry or physics with a molecular biologist who may be working on similar projects? Two experts support the use of citation indicators that are based on percentiles, a statistical parameter that allows for comparisons with a carefully defined group of reference data. Journal impact factors and h-index alone do not make the grade.
“We argue that new citation impact indicators are needed and that these indicators should allow the comparison of the observed impact for a given publication set with a reference set of similar publications,” said Lutz Bornmann, a sociologist of science at the Division for Science and Innovation Studies at the Max Planck Society in Munich. “This is a better way to make meaningful assessments of scientific work.” He added: “Indicators must also take into account that the distribution of citations across papers is often skewed. The use of percentiles described in our paper provides a solution.”
A scientific paper and its citation in other papers reveal how science makes progress and can help to establish the credit for new discoveries. Citation indicators are used extensively to evaluate the impact of the research of individual scientists, institutes and university departments, and sometimes even countries. The outcomes of such analyses can have a profound influence on the careers of scientists or, for example, the future funding of research institutes.
The authors of the study emphasize that journal impact factors and h-index, two frequently used parameters to evaluate the quality and quantity of science, do not readily allow for comparisons between the work of different scientists or publications in journals from unrelated research fields. The problem is similar to comparing the performance of individuals who score goals in sports as different as football and handball. The number of goals in football is often around 2 but in handball can reach 20 or more. Is someone who scores an average of five goals in handball a better athlete than a football player who scores one goal a game?
“Experts of bibliometrics avoid using journal impact factors and the h-index because these indicators do not provide normalized values. For many years, they have been using reference sets to normalize the number of citations which is indispensable for fair assessment,” commented Werner Marx, co-author of the paper and head of the Information Retrieval Services at the Max Planck Institute for Solid State Research in Stuttgart. “The use of this type of advanced analysis is growing. However, we have an opportunity to do more and this could have a big impact on the way we answer important questions such as how good research really is.”
- MPI für Festkörperforschung
- data analysis
Electrons flow through most materials more like a gas than a fluid, meaning they don’t interact much with one another. It was long hypothesized that electrons could flow like a fluid, but only recent advances in materials and measurement techniques allowed these effects to be observed in 2D ... more
Proteomics produces enormous amounts of data, which can be very complex to analyze and interpret. The free software platform MaxQuant has proven to be invaluable for data analysis of shotgun proteomics over the past decade. Now, Jürgen Cox, group leader at the Max Planck Institute of Bioche ... more
The European Molecular Biology Organization (EMBO) and the Federation of European Biochemical Societies (FEBS) announce Carol V. Robinson, Professor of Chemistry at the University of Oxford, UK, as the winner of the 2011 FEBS/EMBO Women in Science Award. Professor Robinson has been recogniz ... more
Olivier Voinnet from the CNRS Institute of Plant Molecular Biology in Strasbourg, France, is awarded the 2009 EMBO Gold Medal. The researcher receives this medal for his pioneering work on the mechanisms and roles of gene silencing via RNA in plants. With this annual award, the European Mo ... more
The European Molecular Biology Organization (EMBO) announced the selection of 12 of Europe’s most talented young researchers as 2008 beneficiaries of the EMBO Young Investigator Programme. The programme annually identifies the brightest and most promising European young researchers at a cri ... more
Without the Higgs mechanism, particles would have no mass. The Higgs boson, which was discovered in 2012, is therefore also referred to as the “God particle”. It arises as an oscillating excitation of the Higgs field, which penetrates the world. Superconductivity displays similar properties ... more
Processes taking place inside tiny electronic components or in molecules can now be filmed at a resolution of a few hundred attoseconds and down to the individual atom. The operation of components for future computers can now be filmed in HD quality, so to speak. Manish Garg and Klaus Kern, ... more
Integrated circuitry is becoming increasingly complex. These days a Pentium processor contains some 30 million transistors. And the magnetic structures found in hard drives measure just 10 to 20 nanometers across – less than a flu virus at 80 to 120 nanometers in diameter. Dimensions are ra ... more
- 1Detect neurodegenerative diseases such as Alzheimer's by a simple eye scan?
- 2Fluorescence microscopy at highest spatial and temporal resolution
- 3The Mechanics of the Immune System
- 4Resolve Biosciences Launches New Era in Single-Cell Spatial Analysis
- 5Quick look under the skin
- 6New ion trap to create the world's most accurate mass spectrometer
- 7How does your computer smell?
- 8Clocking electron movements inside an atom
- 9Sartorius closes 2020 with strong growth
- 10A clear path to better insights into biomolecules
- AI helping to quantify enzyme activity
- Eppendorf AG completes conversion to European public limited company
- Artificial intelligence helps to find new natural substances
- Genomic tracking of the COVID-19 pandemic in England
- In neurodegenerative diseases, brain immune cells have a “ravenous appetite” for sugar