ABSTRACT The present paper reports on the initial study and the preliminary findings of how the c... more ABSTRACT The present paper reports on the initial study and the preliminary findings of how the concept of simulated work task situation is reported used in the research literature. The overall objective of the study is in a systematic manner to learn how and for what types of ...
The doctoral forum at the first IIiX symposium. Birger Larsen, Jesper W Schneider ACM Internation... more The doctoral forum at the first IIiX symposium. Birger Larsen, Jesper W Schneider ACM International Conference Proceeding Series 176, 176-179, 10/2006. This paper gives a description of the Doctoral Forum held at the first symposium on Information Interaction in Context (IIiX) and provides brief descriptions of the presented student projects. Six senior researchers gave feedback to a total of 14 doctoral students. 80 Computer Applications(General)(CI).
The present paper explores simultaneous modelling of cross-reference activity between authors by ... more The present paper explores simultaneous modelling of cross-reference activity between authors by use of asymmetric proximities and multidimensional unfolding. We thereby model and map both citing and cited relations between authors in a common space. This enables a more comprehensive comparison of the author's dual roles of citing and being cited in a reference network. We model a set of 31 authors and compare the results to a recent author co-citation study of Information Science. We find that multidimensional unfolding is a reliable and insightful technique for modelling authors' citing and cited dimensions simultaneously. The common space of citing and cited positions exemplify that some authors have substantial discrepancies between their citing behaviour and the way their works are used by peers in the set. Further, modelling mutual relationships as asymmetric brings more accuracy and nuances into the maps as relationships become overt. Finally, the study discusses how high publication activity influences mapping results considerably. To counter this effect, we demonstrate the appropriateness of correcting data for main effects by use of an asymmetric proximity measure of odds ratios.
This paper raises concerns about the advantages of using statistical significance tests in resear... more This paper raises concerns about the advantages of using statistical significance tests in research assessments as has recently been suggested in the debate about proper normalization procedures for citation indicators. Statistical significance tests are highly controversial and numerous criticisms have been leveled against their use. Based on examples from articles by proponents of the use statistical significance tests in research assessments, we address some of the numerous problems with such tests. The issues specifically discussed are the ritual practice of such tests, their dichotomous application in decision making, the difference between statistical and substantive significance, the implausibility of most null hypotheses, the crucial assumption of randomness, as well as the utility of standard errors and confidence intervals for inferential purposes. We argue that applying statistical significance tests and mechanically adhering to their results is highly problematic and detrimental to critical thinking. We claim that the use of such tests do not provide any advantages in relation to citation indicators, interpretations of them, or the decision making processes based upon them. On the contrary their use may be harmful. Like many other critics, we generally believe that statistical significance tests are over- and misused in the social sciences including scientometrics and we encourage a reform on these matters.
Abstract This article outlines and discusses the bibliometric indicator used for performance-base... more Abstract This article outlines and discusses the bibliometric indicator used for performance-based funding of research institutions in Norway. It is argued that the indicator is novel and innovative as compared to the indicators used in other funding models. It compares institutions ...
ABSTRACT The present paper reports on the initial study and the preliminary findings of how the c... more ABSTRACT The present paper reports on the initial study and the preliminary findings of how the concept of simulated work task situation is reported used in the research literature. The overall objective of the study is in a systematic manner to learn how and for what types of ...
The doctoral forum at the first IIiX symposium. Birger Larsen, Jesper W Schneider ACM Internation... more The doctoral forum at the first IIiX symposium. Birger Larsen, Jesper W Schneider ACM International Conference Proceeding Series 176, 176-179, 10/2006. This paper gives a description of the Doctoral Forum held at the first symposium on Information Interaction in Context (IIiX) and provides brief descriptions of the presented student projects. Six senior researchers gave feedback to a total of 14 doctoral students. 80 Computer Applications(General)(CI).
The present paper explores simultaneous modelling of cross-reference activity between authors by ... more The present paper explores simultaneous modelling of cross-reference activity between authors by use of asymmetric proximities and multidimensional unfolding. We thereby model and map both citing and cited relations between authors in a common space. This enables a more comprehensive comparison of the author's dual roles of citing and being cited in a reference network. We model a set of 31 authors and compare the results to a recent author co-citation study of Information Science. We find that multidimensional unfolding is a reliable and insightful technique for modelling authors' citing and cited dimensions simultaneously. The common space of citing and cited positions exemplify that some authors have substantial discrepancies between their citing behaviour and the way their works are used by peers in the set. Further, modelling mutual relationships as asymmetric brings more accuracy and nuances into the maps as relationships become overt. Finally, the study discusses how high publication activity influences mapping results considerably. To counter this effect, we demonstrate the appropriateness of correcting data for main effects by use of an asymmetric proximity measure of odds ratios.
This paper raises concerns about the advantages of using statistical significance tests in resear... more This paper raises concerns about the advantages of using statistical significance tests in research assessments as has recently been suggested in the debate about proper normalization procedures for citation indicators. Statistical significance tests are highly controversial and numerous criticisms have been leveled against their use. Based on examples from articles by proponents of the use statistical significance tests in research assessments, we address some of the numerous problems with such tests. The issues specifically discussed are the ritual practice of such tests, their dichotomous application in decision making, the difference between statistical and substantive significance, the implausibility of most null hypotheses, the crucial assumption of randomness, as well as the utility of standard errors and confidence intervals for inferential purposes. We argue that applying statistical significance tests and mechanically adhering to their results is highly problematic and detrimental to critical thinking. We claim that the use of such tests do not provide any advantages in relation to citation indicators, interpretations of them, or the decision making processes based upon them. On the contrary their use may be harmful. Like many other critics, we generally believe that statistical significance tests are over- and misused in the social sciences including scientometrics and we encourage a reform on these matters.
Abstract This article outlines and discusses the bibliometric indicator used for performance-base... more Abstract This article outlines and discusses the bibliometric indicator used for performance-based funding of research institutions in Norway. It is argued that the indicator is novel and innovative as compared to the indicators used in other funding models. It compares institutions ...
Uploads
Papers
Statistical significance tests are highly controversial and numerous criticisms have been leveled against their use. Based on examples from articles by proponents of the use statistical significance tests in research assessments, we address some of the numerous problems with such tests. The issues specifically discussed are the ritual practice of such tests, their dichotomous application in decision making, the difference between statistical and substantive significance, the implausibility of most null hypotheses, the crucial assumption of randomness, as well as the utility of standard errors and confidence intervals for inferential purposes. We argue that applying statistical significance tests and mechanically adhering to their results is highly problematic and detrimental to critical thinking. We claim that the use of such tests do not provide any advantages in relation to citation indicators, interpretations of them, or the decision making processes based upon them. On the contrary their use may be harmful. Like many other critics, we generally believe that statistical significance tests are over- and misused in the social sciences including scientometrics and we encourage a reform on these matters.
Statistical significance tests are highly controversial and numerous criticisms have been leveled against their use. Based on examples from articles by proponents of the use statistical significance tests in research assessments, we address some of the numerous problems with such tests. The issues specifically discussed are the ritual practice of such tests, their dichotomous application in decision making, the difference between statistical and substantive significance, the implausibility of most null hypotheses, the crucial assumption of randomness, as well as the utility of standard errors and confidence intervals for inferential purposes. We argue that applying statistical significance tests and mechanically adhering to their results is highly problematic and detrimental to critical thinking. We claim that the use of such tests do not provide any advantages in relation to citation indicators, interpretations of them, or the decision making processes based upon them. On the contrary their use may be harmful. Like many other critics, we generally believe that statistical significance tests are over- and misused in the social sciences including scientometrics and we encourage a reform on these matters.