Rules for assessment

The assessment of research output is based on the classification of the five best publications out of five years. These five titles are selected by the researcher from the national research database METIS, which is updated at the end of each calendar year, or during the year if Personal Metis is used.

In previous journal rankings, journals were classified in four classes A – D. For assessments in 2011 and later, this system will be gradually replaced by a ranking based on the journal’s Article Influence Score, which can be found on the Eigenfactor website as well as on the ISI Web of Knowledge (Additional Resources → Journal Citation Reports). A journal’s weight is derived from the Article Influence  percentile as published on the Eigenfactor website; AIp henceforth. If the AIp is available for the year of publication, that value will be used. If the publication is too recent, the most recent AIp will be used.

To determine the journal’s weight, the percentile is first divided by 100, and then squared.

For a single-authored journal publication, the amount of credits obtained is simply equal to the journal’s weight in the year that the article was published. With multiple authors, that weight is multiplied by 0.75 to obtain the number of credits.

Dissertations receive 0.45 credits. In addition, dissertations that are reissued as monograph by a scientific publisher will be treated as such.

The listed publishers are classified as A or B; publications with non-listed publishers receive no credits. Single-authored monographs receive 0.9 credits for an A publisher and 0.45 for a B publisher. Single-authored contributions to an edited volume receive 0.45 for an A-publisher and 0.15 for a B-publisher. Also these scores are multiplied by 0.75 in case of multiple authors. If an author has contributed more than one contribution to an edited volume, the total amount of credits derived from this volume cannot exceed the credits attributed to a monograph issued by the same publisher.

Book reviews are not included in the assessment. Other short journal publications - including editorials (for edited special issues), comments, very short notes, etc. - may qualify for inclusion provided they make a sufficient scientific contribution. Judgements are to be made by a temporary committee. The number of pages is of no consequence for the credits attributed.

Summarising, the following credits are attributed:

PublicationRankingSingle authorMultiple authorsMax credits per volume
JournalW=(AIp/100)2W0.75∙W
Dissertation0.450.45
MonographA0.90.75∙0.9
B0.450.75∙0.45
Chapter in or editeur of an edited volumeA0.450.75∙0.450.9
B0.150.75∙0.150.45

 

To smoothen the transition between the previous ranking and the new one, the following rules will apply:
  • For journal publications that have appeared before 2013, the journal weight used in the computation of credits will be the maximum of W and 0.88 for A journals, the maximum of W and 0.45 for B journals, and the maximum of W and 0.15 for C journals. For articles that appear later, this rule applies only if proof is provided that article was first submitted to the journal in which it eventually appeared before 31 January 2011.
  • For book publications that have appeared with C-publishers before 2013 credits will be awarded as follows: 0.15 and 0.75∙0.15 for monographs; 0.10 and 0.75∙0.10 for contributions (with the appropriate maximum of credits for multiple contributions to the same volume). For book publications that appear later, this rule applies only if proof is provided that the commitment to publish the book, or make the contribution, was made before January 1 2011. Otherwise, no credits will be awarded for monographs and contributions to books that have appeared with C-publishers.

In general, there will be no deviations from the journal weights thus defined, with the following exceptions:

1.  Accounting

It has become clear that accounting journals are exceptionally poorly represented in ISI. For that reason, in this field imputed AIp’s will be used for journals that do not appear in ISI. The imputation is based on a fitted relation between journals’ g-factors in Google scholar and the AI scores, performed for the subset of Accounting journals for which both measures are available.

As soon as an (sufficiently high) AIp becomes available, the imputed AIp will be replaced by the actual one. A new relation between google’s g and the AIp will be fitted every year. The desirability of maintaining this exceptional treatment of Accounting journals will be re-evaluated every three years. 

2. Unintended outlets

Researchers qualifying for research time are expected to publish in journals that are natural outlets for the fields in which they are active. When journals outside those fields are used and lead to disproportional amounts of credits being earned, the Faculty Board may consult a temporary committee and decide to block the future use of those journals in the research allocation system.