Proteomics produces enormous amounts of data, which can be very complex to analyze and interpret. The free software platform MaxQuant has proven to be invaluable for data analysis of shotgun proteomics over the past decade. Now, Jürgen Cox, group leader at the Max Planck Institute of Bioche ... more
New citation indicators needed to measure research performance
How do you compare the impact of a researcher in chemistry or physics with a molecular biologist who may be working on similar projects? Two experts support the use of citation indicators that are based on percentiles, a statistical parameter that allows for comparisons with a carefully defined group of reference data. Journal impact factors and h-index alone do not make the grade.
“We argue that new citation impact indicators are needed and that these indicators should allow the comparison of the observed impact for a given publication set with a reference set of similar publications,” said Lutz Bornmann, a sociologist of science at the Division for Science and Innovation Studies at the Max Planck Society in Munich. “This is a better way to make meaningful assessments of scientific work.” He added: “Indicators must also take into account that the distribution of citations across papers is often skewed. The use of percentiles described in our paper provides a solution.”
A scientific paper and its citation in other papers reveal how science makes progress and can help to establish the credit for new discoveries. Citation indicators are used extensively to evaluate the impact of the research of individual scientists, institutes and university departments, and sometimes even countries. The outcomes of such analyses can have a profound influence on the careers of scientists or, for example, the future funding of research institutes.
The authors of the study emphasize that journal impact factors and h-index, two frequently used parameters to evaluate the quality and quantity of science, do not readily allow for comparisons between the work of different scientists or publications in journals from unrelated research fields. The problem is similar to comparing the performance of individuals who score goals in sports as different as football and handball. The number of goals in football is often around 2 but in handball can reach 20 or more. Is someone who scores an average of five goals in handball a better athlete than a football player who scores one goal a game?
“Experts of bibliometrics avoid using journal impact factors and the h-index because these indicators do not provide normalized values. For many years, they have been using reference sets to normalize the number of citations which is indispensable for fair assessment,” commented Werner Marx, co-author of the paper and head of the Information Retrieval Services at the Max Planck Institute for Solid State Research in Stuttgart. “The use of this type of advanced analysis is growing. However, we have an opportunity to do more and this could have a big impact on the way we answer important questions such as how good research really is.”
- MPI für Festkörperforschung
- data analysis
Hot vents in the deep sea are home to microbes that feed on ethane. They were discovered recently from scientists of the Max Planck Institute for Marine Microbiology. Now the researchers from Bremen succeeded in finding an important component in the microbial conversion of the gas. They wer ... more
Using real-time deformability cytometry, researchers at the Max-Planck-Zentrum für Physik und Medizin in Erlangen were able to show for the first time: Covid-19 significantly changes the size and stiffness of red and white blood cells - sometimes over months. These results may help to expla ... more
The European Molecular Biology Organization (EMBO) and the Federation of European Biochemical Societies (FEBS) announce Carol V. Robinson, Professor of Chemistry at the University of Oxford, UK, as the winner of the 2011 FEBS/EMBO Women in Science Award. Professor Robinson has been recogniz ... more
Olivier Voinnet from the CNRS Institute of Plant Molecular Biology in Strasbourg, France, is awarded the 2009 EMBO Gold Medal. The researcher receives this medal for his pioneering work on the mechanisms and roles of gene silencing via RNA in plants. With this annual award, the European Mo ... more
The European Molecular Biology Organization (EMBO) announced the selection of 12 of Europe’s most talented young researchers as 2008 beneficiaries of the EMBO Young Investigator Programme. The programme annually identifies the brightest and most promising European young researchers at a cri ... more
Without the Higgs mechanism, particles would have no mass. The Higgs boson, which was discovered in 2012, is therefore also referred to as the “God particle”. It arises as an oscillating excitation of the Higgs field, which penetrates the world. Superconductivity displays similar properties ... more
Processes taking place inside tiny electronic components or in molecules can now be filmed at a resolution of a few hundred attoseconds and down to the individual atom. The operation of components for future computers can now be filmed in HD quality, so to speak. Manish Garg and Klaus Kern, ... more
Integrated circuitry is becoming increasingly complex. These days a Pentium processor contains some 30 million transistors. And the magnetic structures found in hard drives measure just 10 to 20 nanometers across – less than a flu virus at 80 to 120 nanometers in diameter. Dimensions are ra ... more
- 1Detect neurodegenerative diseases such as Alzheimer's by a simple eye scan?
- 2Fluorescence microscopy at highest spatial and temporal resolution
- 3The Mechanics of the Immune System
- 4Resolve Biosciences Launches New Era in Single-Cell Spatial Analysis
- 5Quick look under the skin
- 6New ion trap to create the world's most accurate mass spectrometer
- 7How does your computer smell?
- 8Clocking electron movements inside an atom
- 9Sartorius closes 2020 with strong growth
- 10A clear path to better insights into biomolecules