顯示具有 reference analysis 標籤的文章。 顯示所有文章
顯示具有 reference analysis 標籤的文章。 顯示所有文章

2014年9月15日 星期一

Bonnevie-Nebelong, E. (2006). Methods for journal evaluation: journal citation identity, journal citation image and internationalization. Scientometrics, 66(2), 411-424.

Bonnevie-Nebelong, E. (2006). Methods for journal evaluation: journal citation identity, journal citation image and internationalization. Scientometrics, 66(2), 411-424.

Scientometrics

本研究以引用分析對Journal of Documentation (J DOC) 進行評估,並且與JASIST和JIS進行比較。所使用的引用分析方法包括三個方面:以引用的參考文獻為主的期刊引用認同(journal citation identity)、以被引用的情形為主的期刊引證形象(journal citation image)和以出版品本身為主的國際化(internationalisation)。

在期刊引用認同方面有兩種指標。第一種指標是引用對被引用者比(citations/citee-ratio),計算方式是分析範圍內所有參考文獻數除以參考文獻上出現的期刊種類,如果這個數值愈低,表示出現許多不同種類的期刊,也就是使用的期刊具有多元性(diversity)。另一個指標是自我引用(self-citations),用來測量期刊在科學領域內的獨立性(isolation),如果自我引用的程度低表示在科學領域內的影響力高。自我引用指標的測量包括引用文獻中來自本身期刊的比例(self-citing)和期刊被引用的情形下來自本身的比例(self-cited),前者是期刊引用認同的一部份,而後者則屬於期刊引證形象。

期刊引證形象也包含兩種指標。第一種指標是新期刊擴散因素(new journal diffusion factor),此一指標分析該期刊時間範圍內每一篇論文平均被引用的期刊種類,代表該期刊的想法出口情形(export of ideas)、跨領域性(transdisciplinarity)以及專殊化(specialisation)程度。另一只標示該期刊的共被引期刊,根據共被引情形以及共被引期刊的期刊影響因素(Journal Impact factor)來加以描述。

國際化是測量出版品以及引用期刊論文的作者地區。

各種分析方法與指標整理為Table 1。



首先,引用對被引用者比的結果如Figure 1。另外,1990到2003年的平均引用對被引用者比,JDOC為1.50,JASIST為1.88,JIS則為1.44。較低的引用對被引用者比表示引用的文獻裡重複的期刊較多種,代表這份期刊有較多元的科學基礎(scientific base)。從結果上看來,JDOC比JASIST的科學基礎多元性較高,但較JIS來得低。

JDOC比JASIST和JIS的文章有較高的比例是書評(boo review),這使得JDOC的參考文獻數較少,因為書評平均只有1.6到2筆參考文獻。

在1990到2003年間,JDOC、JASIST和JIS等三種期刊引用本身的比例都有下降的趨勢,表示這三種期刊愈來愈不孤立,測量期刊被引用的情形,則可發現JDOC與JIS來自期刊本身的比例則較低,表示它們在這個領域的能見度(visibility)較高。另外,JIS在從1979年開始的前十年引用來自期刊本身的比例較高,則說明了這個期刊在當時為在領域邊緣的新期刊。

JDOC的新期刊擴散因素比其他兩種期刊稍大,並且有往上的趨勢。

經常與JDOC共同引用的前十種期刊如Table 3所示。期刊共被引的相似度以Jaccard Similarity測量。

JDOC上論文作者的地區分布如Figure 10。主要的作者來自西歐地區,並逐漸增加。



引用JDOC論文的作者地區分布則如Figure 11。以北美地區的作者引用最多,但西歐地區則逐漸增加。



The Journal Citation Identity is a reference analysis. It is measured by looking into  the referencing style of the publishing authors. What is their combined citations/(journal) citee-ratio? This means that the total number of references in the journal must be calculated, year-by-year or all years taken together. The result of this is divided with the number of different journals present in the set of references. If the set contains many different journals, the ratio will be lower. Consequently a low average signifies a greater diversity in the use of journals among the authors as part of their scientific base, and thus a wider horizon.

Self-citations are part of the Journal Citation Identity as well as the Journal Citation Image, depending on the perspective. ... They are indicators of the style of a journal. Many self-citations among the references may signify isolation of the journal in the scientific domain (high rate). A low rate of self-citations may indicate a high level of influence in the scientific community.

The Journal Citation Image is based on citation analyses of two types: the New Journal Diffusion Factor (N JDF) and journal co-citation analysis.

The New Journal Diffusion Factor was proposed by Frandsen, and is inspired by Rowlands’ diffusion factor. It measures breadth by number of citing journals per published article. N JDF is the average number of different journals that an average article is cited by within a given time window. The result of this tells about the scientific style and about breadth, export of ideas, transdisciplinarity and degree of specialisation of a journal. N JDF is tested for JDOC in a time perspective.

The Journal Citation Image “the White way” means to do a co-citation journal-by-journal analysis and interpret the result in a qualitative manner. It is thus a means to evaluate a journal by the journals co-cited with the journal in question. The co-cited journals are displayed in a list ranked by frequency of co-incidences, the number of citations for each co-cited journal taken into consideration by application of the jaccard calculations. Also the Journal Impact factor (JIF) is used to evaluate the co-cited journals. The co-cited journals then function as image-makers of the journal in question.

Internationalisation is measured by looking into the geographic locations of both publishing and cited authors of the JDOC.

A high citation/citee ratio means that the journal has many recited journals among its references. A low ratio signifies less journal re-citations and thus a greater diversity of journals as part of the scientific base and a wider horizon among authors.

Journal self-citations. Journal self-citations can be analysed from two perspectives, by self-citing rate and by self-cited rate. The first mentioned is part of the citation identity, the second one is part of the self-image, but the two types of self-citations are treated together here for practical reason.

The three journals all show decreasing self-citing rates during the years 1980–2003. This may signify a tendency towards less isolation of the field.

2014年9月9日 星期二

Åström, F. (2007). Changes in the LIS research front: Time‐sliced cocitation analyses of LIS journal articles, 1990–2004. Journal of the American Society for Information Science and Technology, 58(7), 947-957.

Åström, F. (2007). Changes in the LIS research front: Time‐sliced cocitation analyses of LIS journal articles, 1990–2004. Journal of the American Society for Information Science and Technology, 58(7), 947-957.

scientometrics

本研究利用論文間的共被引分析探討1990到2004年間圖書資訊學(LIS)的研究前沿(research front)的改變,了解這個學科目前的處境與發展趨勢。分析資料為21種LIS期刊。將同時間內具有影響力的共被引文章定義為研究前沿(research fronts),並且分為三個5年期間,分析領域的改變。研究結果發現LIS由兩個不同研究領域構成的穩定結構:資訊計量學(informetrics)和資訊搜尋與檢索(information seeking and retrieval),由於分享研究興趣與方法,資訊檢索與資訊計量學有靠近的傾向。而網路為主的研究成為資訊計量學和資訊搜尋與檢索的主要研究則是這個領域的主要變化。

本研究採用的期刊來源為JCR (2003) 的Information Science & Library Science分類下的55種期刊。去除主要是被非LIS期刊引用的期刊以及評論性或商業性期刊後,選擇1990到2004年間有出版的期刊,如下表共21種。

論文的總數為13605筆,從中選取最高被引用的論文,建立共被引次數矩陣。以多維尺度演算法(multidimensional scaling algorithm, MDS)進行處理。
首先是研究基礎(research base)部分,從13605筆論文資料的221586次引用(150145篇參考文獻)中,選取被引用超過50次的文獻,共66筆進行分析。其共被引映射圖如FIG 1.:

與先前研究一致,圖書資訊學在圖形上分為兩個區域,圖形上半部為資訊搜尋與檢索相關論文,下半部則為資訊計量學文獻,此一結果和 Persson (1994) 與 White & McCain (1998)等研究相符合。另外在資訊計量學文獻右邊,還有一群文獻形成網路計量學(webometrics)叢集。網路計量學是利用連結、引用與叢集等資訊計量學方法進行網路本質與特性的分析。

資訊搜尋與檢索從早期的系統導向資訊檢索(systems-oriented information retrieval)發展到使用者-系統互動研究(user-system interaction studies)和資訊行為(information behavior)。

除了網路計量學以外,資訊計量學以書目計量映射(bibliometric mapping)為中心,周圍的部分是書目計量分布(bibliometric distributions)。

為了進一步了解與核對共被引分析的結果,將共被引資料輸入叢集分析。叢集分析所產生的8個叢集符合映射圖的結構,各叢集如TABLE 2。
從TABLE 2各叢集出版年度的中位數,可以將八個叢集分為四個時期:第一個時期圖書資訊學的研究包括實驗性資訊檢索(experimental information retrieval)、書目計量映射以及書目計量分布;第二個時期開始對於資訊檢索的使用者端產生興趣,增加了搜尋過程與認知面向的資訊檢索研究;隨後是在1990年代早期進行的相關性(relevance)研究,同時也傾向於一般的資訊行為;1990年代末期則受到網路科技的影響,開始進行網路以及網路計量學的研究。

接下來的共被引分析,被引用的參考文獻僅限於也在13605篇論文裡的論文,來了解具有影響力的論文,做為研究脈絡(research context)。選取被引用次數超過25次的論文,共65篇。呈現的圖形大致上仍然可明顯的看出分為上半區域的資訊搜尋與檢索和下半區域的資訊計量學。但資訊檢索的研究以認知性資訊搜尋與檢索、相關性和資訊行為為主要,實驗性資訊檢索研究則成為邊緣。

相較於研究基礎,在研究脈絡上可以發現資訊計量學的結果較為分散,包含三個部分:研究合作(research collaboration)、書目計量映射與網路計量學,並且以網路計量學最為主要。


以TABLE 3的叢集結果來看,在研究脈絡中雖然實驗性資訊檢索與書目計量分布消失了,但增加了兒童的資訊行為研究和對於研究合作的資訊計量學分析。雖然這些研究依然存在,但本身並沒有形成叢集,而是歸入其他的叢集中,如IR/Search。

對三個5年的時期進行研究前沿分析,第一個時期1990-1994年,共有3401篇論文,彼此間有1581次引用,39篇論文獲得5次以上的引用。這個時期以ISR為主,特別是使用者觀點的ISR研究;資訊計量學由兩個小叢集組成:一為研究合作,另一聚焦於映射。

第二個時期1995-1999年,包含3318篇論文,彼此間的引用共有2117次,獲得5次以上引用的論文共有52篇。這時期ISR的聚集相當明顯,除了聚焦在資訊科技(information technology)和實驗性資訊檢索(experimental IR)的兩個叢聚外。在一般的資訊計量學之外,另外還有研究成效(research performance)的叢集。

第三個時期2000-2004年,有4147筆論文,彼此間有2926次的引用,62篇論文的引用次數超過7次。在這個時期,可以看出資訊計量學較前面兩個時期緊密連接,主要聚焦在網路計量學,而ISR則較前兩個時期變得較為分散,可分為三個叢集:ISR、兒童的資訊行為(children's information behaviors)以及健康資訊學(health informatics)。

本研究發現LIS有相當穩定的結構,主要為ISR及資訊計量學所構成。另外,從研究基礎上發現,大多為理論或方法學的文獻,但研究脈絡與前沿上的文獻卻以實務性的論文為主。就三個時期的研究來看,1900-1994年以圖書館與資訊服務(library and information service)為主,第二個時期則是線上資料庫與資訊尋求;第三個時期受到WWW影響,主要的研究從群體利用WWW搜尋資訊的方法到發展分析網站影響因素的方法。最後,本研究發現ISR與資訊計量學有愈來愈接近的趨勢,其原因是因為兩者都需要測量文件(或搜尋問題)之間的關係強度,並且也都對將資訊視覺化有興趣,因此彼此引用整合的機會增加。

Based on articles published in 1990–2004 in 21 library and information science (LIS) journals, a set of cocitation analyses was performed to study changes in research fronts over the last 15 years, where LIS is at now, and to discuss where it is heading.

The results show a stable structure of two distinct research fields: informetrics and information seeking and retrieval (ISR). However, experimental retrieval research and user oriented research have merged into one ISR field; and IR and informetrics also show signs of coming closer together, sharing research interests and methodologies, making informetrics research more visible in mainstream LIS research. Furthermore, the focus on the Internet, both in ISR research and in informetrics—where webometrics quickly has become a dominating research area—is an important change.

The nature and intellectual organization of LIS has been thoroughly investigated in analyses describing the general traits of LIS research, as well as mapping how LIS has been organized in different research themes (Persson, 1994; White & Griffith, 1981; White & McCain, 1998).

My approach centers on the following questions. What research topics have dominated LIS during the period 1990–2004? What changes can be observed in the topics addressed over the last 15 years? Can these changes can be used to tell us something about where LIS is heading?

Most definitions of “research fronts” explain them as groups of citing articles being clustered through bibliographic coupling (e.g., Persson, 1994), and their relations to the cited documents clustered by cocitation analysis (Garfield, 1994; Morris et al., 2003; Price, 1965). Although Persson sees the current (citing) articles as the research front and the cited documents as the research base, Garfield, for example, also includes the clusters of cocited core articles into the research front.

In addition, by analyzing the co-occurrence of highly cited documents, we also get an indication on the impact of the articles, thus expanding the definition of research fronts as including influential, as well as current research.

To identify LIS research, and to select journals for the analyses, the Journal Citation Reports: JCR Social Sciences (Thomson ISI, 2003) was used. To defining LIS research, JCR’s Information Science & Library Science classification, covering 55 journals, was used.

To limit the definition, all general LIS journals were identified and the specialized ones were excluded. This was done using the “Citing Journal” field in JCR: If the journal primarily was cited by non-LIS publications, it was excluded from the study.

The analyses were done on a document level, as opposed to an analysis on the author level. Although an author analysis provides more of an overview, the document analysis is more detailed, e.g., by not grouping documents on different topics by the same author.

The result reflects contemporary and influential research within a specific field of research, i.e., the research front.

The research base was based on the 13,605 journal articles published from 1990–2004 and their 221,586 references to 150,145 unique documents. The 66 most-cited documents that received 50 citations or more were selected for further analysis (Figure 1).

The map shows two main areas consistent with the structures found in earlier analyses on LIS (e.g., Persson, 1994; White & McCain, 1998). On the top half of the map, a group of information-seeking and retrieval (ISR) related literature is featured and on the bottom half, a group of informetrics literature. However, on the right side of the informetrics field, a group of webometric studies has formed a cluster. Webometrics is the study of the nature and properties of the World Wide Web, using informetric methodologies such as link, citation, and cluster analyses (Björneborn & Ingwersen, 2001).

In the ISR section of the map, there is a thematic shift from right to left. Systems-oriented information retrieval (IR) literature is on the far right, followed towards the left by user-system interaction studies and information behavior. In comparison to Persson (1994), the “soft” part of the IR-field has increased its impact compared to the “hard” systems-oriented IR research.

Apart from the webometric group on the far right, the informetrics field is centered on bibliometric mapping, surrounded by documents concerning bibliometric distributions.

To enhance the results of the cocitation analysis, a cluster analysis (Persson, 1994) was performed, resulting in eight clusters (Table 2). The clusters support the structures identified in the map, and reveal a division of the soft IR-research: from search- and relevance-focused documents, over cognitive IR and information seeking, to information behavior.

The publication years of the clustered documents shows four generations of research orientations, a trait also visible in the IR part of the map. The first generation of LIS research includes experimental IR, bibliometric distributions, and bibliometric mapping. The second generation of research, with references published from the early 1980s marks the increasing interest in the user side of IR, incorporating the search process and the cognitive perspective into IR and LIS research. This is followed by the relevance studies in the early 1990s; and a contemporary trend to focus on general information behavior. The most recent trend in the LIS research base is studies on World Wide Web and webometrics, dating back to the late 1990s.

The results of the second analysis show influential research areas during the period 1990–2004. It is still the same 13,605 articles providing the material, but only the 18,615 citations to articles present in the set of citing documents are analyzed. Here, as well as in the following time-sliced analysis, the self-citations were removed. Out of the 5024 unique-cited documents, the 65 articles being cited 25 times or more were selected and analyzed (Figure 2).

The general structure of the map is the same: with informetrics on the lower half and ISR on the top half. There are some differences, however. In the top half, a center has developed around “Kuhlthau, 1991” and “Ingwersen, 1996,” focusing on cognitive ISR, relevance, and information behavior, while experimental IR research has become peripheral. Different perspectives on the user-oriented research has dominated the information-seeking and retrieval field; and has together with the wider information behavior field formed a strong research area of different variations on information-seeking research.

At the same time, the informetrics field has become more dispersed, with three clearly defined subfields: research collaboration to the left, bibliometric mapping in the middle, and webometrics on the right side. In comparison with the research base, webometrics has become the dominating research area within the informetrics field.

2014年8月14日 星期四

Huang, M. H., & Chang, Y. W. (2012). A comparative study of interdisciplinary changes between information science and library science. Scientometrics, 91(3), 789-803.

Huang, M. H., & Chang, Y. W. (2012). A comparative study of interdisciplinary changes between information science and library science. Scientometrics, 91(3), 789-803.

scientometrics

本研究利用圖書館學與資訊科學領域下各五種期刊於1978到2007年間論文引用的參考文獻,比較這兩個領域的跨學科(interdisciplinary)特性。跨學科性(interdisciplinarity)的定義為使用來自其他學科的知識(knowledge)、方法(methods)、技術(techniques)與設備(devices)成為科學活動的結果(Tijssen 1992),利用來自不同學科參考文獻的引用分布是經常採用的分析技術。研究結果顯示兩者的來源學科有很大不同:圖書館學的研究傾向於引用圖書資訊學(library and information science)、教育學(education)、企業/管理(business/management)、社會學(sociology)和心理學(psychology);然而資訊科學的研究引用大多來自圖書資訊學、一般科學(general science)、電腦科學(computer science)、科技(technology)和醫學(medicine)等學科。除了圖書資訊學本身以外,圖書館學引用的學科主要以社會科學為主,資訊科學的引用則主要來自於自然科學。

從引用比例的變化來看,圖書館學在引用圖書資訊學上有下降的趨勢,引用自教育學的比例則是上升,資訊科學來自電腦科學上的引用,其比例也是上升。

本研究以從Brillouin指標(Brillouin’s Index)測量兩個領域的跨學科性,Brillouin指標的計算方式如下:

N是觀察的數量(the number of observations),也就是參考文獻的總數,ni是屬於第i個類別的觀察的數量,也就是在第i個學科的參考文獻數量。從可以看到這兩個領域的跨學科性都逐年上升,並且資訊科學比圖書館學有較高的跨學科性。


Based on the research generated by five library science journals and five information science journals, library science researchers tend to cite publications from library and information science (LIS), education, business/management, sociology, and psychology, while researchers of information science tend to cite more publications from LIS, general science, computer science, technology, and medicine. This means that the disciplines with larger contributions to library science are almost entirely different from those contributing to information science.

However, a decreasing trend in the percentage of LIS in library science indicates that library science researchers tend to cite more publications from non-LIS disciplines. A rising trend in the proportion of references to education sources is reported for library science articles, while a rising trend in the proportion of references to computer science sources has been found for information science articles.

In addition, this study applies an interdisciplinary indicator, Brillouin’s Index, to measurement of the degree of interdisciplinarity. The results confirm that the trend toward interdisciplinarity in both information science and library science has risen over the years, although the degree of interdisciplinarity in information science is higher than that in library science.

The concept of interdisciplinarity has been discussed by many researchers (Huutoniemi et al. 2010; Leydesdorff and Probst 2009; Rosenfield 1992; Tijssen 1992), and can be defined as the use of knowledge, methods, techniques, and devices as a result of scientific activities from other fields (Tijssen 1992).

2014年8月11日 星期一

Tsay, M. Y. (2011). A bibliometric analysis and comparison on three information science journals: JASIST, IPM, JOD, 1998–2008. Scientometrics, 89(2), 591-606.

Tsay, M. Y. (2011). A bibliometric analysis and comparison on three information science journals: JASIST, IPM, JOD, 1998–2008. Scientometrics, 89(2), 591-606.

Scientometrics

Borko (1968) 將資訊科學定義為「研究資訊的特性與行為、管理資訊流的力量以及使資訊能最佳化的取得與可用性的處理方法」本研究探討與比較JASIST (Journal of the American Society for Information Science and Technology)、IPM (Information Processing and Management)和JOD (Journal of Documentation)三種資訊科學相關期刊在1998到2008年間論文的參考文獻具有的書目計量特性 (bibliometric characteristics) 以及與其他學科的主題關係 (subject relationship)。

研究結果呈現三種期刊都是資訊科學導向,但JOD更傾向於圖書館學,而JASIST和IPM有更多的共同性以及比JOD更深入地擴散到其他學科。若干結果如下:
1. JASIST出版的文章數量為IPM和JOD的兩倍,後兩者出版的文章數量約略相當。但JOD以書評(book reviews)為主(54%)。
2. JASIST和JOD上每一篇論文平均有38和40筆參考文獻,明顯比IPM的32筆多。JOD、JASIST和IPM的參考文獻分別有9.3、7.8和4.1為書籍。
3. 期刊的自我引用情形以JASIST的17.46%最高,IPM和JOD分別為14.11%和10.19%。
4. 三種期刊引用最高的前五種期刊中有四種是相同的,包含JASIST、IPM、Scientometrics和JOD。JOD引用最高的書籍與其他兩者明顯不同,但JASIST和IPM引用最高的前三名則是一樣的,包含Salton 和 McGill的 Introduction to Modern Information Retrieval、 Van Rijsbergen的 Information Retrieval 以及 Salton的 The SMART Retrieval System: Experiments in Automatic Document Processing。
5. 三種期刊引用最高的前十種期刊有40到50%為資訊科學相關期刊,表示這個領域的研究人員引用較多自己領域的研究結果。
6. 引用期刊的前三大類別為‘‘Bibliography. Library Science. Information Resources (General)’’ 、 ‘‘Science’’ 和 ‘‘Social Sciences (General)’’。針對引用書籍而言,JASIST和IPM最大的類別都是science,但JOD則是‘‘Bibliography. Library Science. Information Resources (General)’’。以主題來說,三種期刊的前三大都是一樣的,包括‘‘searching’’、‘‘online information retrieval’’ 和 ‘‘information work’’。


Employing a citation analysis, this study explored and compared the bibliometric characteristics and the subject relationship with other disciplines of and among the three leading information science journals, Journal of the American Society for Information Science and Technology (JASIST), Information Processing and Management and Journal of Documentation. The citation data were drawn from references of each article of the three journals during 1998 and 2008.

Comparison on the characteristics of cited journals and books confirmed that all the three journals under study are information science oriented, except JOD which is library science orientation. JASIST and IPM are very much in common and diffuse to other disciplines more deeply than JOD.

Borko (1968) defined that information science is ‘‘a discipline that investigates the properties and behavior of information, the forces governing the flow of information, and the means of processing information for optimum accessibility and usability.

JASIST published more than twice of articles of IPM and JOD, both published approximately the same number of articles. Interestingly, JOD published more book reviews (54%) than journal articles.

The average number of references cited per paper for JASIST and JOD is 38 and 40. It is significantly higher than that of IPM of 32. There is no significant difference between JASIST and JOD in terms of average number of references cited.

In average, 9.3, 7.8, 4.1 books were cited per paper by JOD, JASIST and IPM, respectively. JOD cites books per paper most, while IPM cites least.

JASIST has the highest self-citation rate of 17.46%, next by IPM of 14.11% and JOD
has the least self-citation rate of 10.19%.

Four of the top five highly cited journals are in common, i.e., Journal of the American Society for Information Science and Technology, Information Processing and Management, Scientometrics, and Journal of Documentation.

On the other hand, the most cited three books in common for JASIST and IPM are Salton and McGill’s Introduction to Modern Information Retrieval, Van Rijsbergen’s Information Retrieval and Salton’s The SMART Retrieval System: Experiments in Automatic Document Processing.

For the three journals under study, most of the top ten highly cited journals, contributing about 40–50% of cited journals, are information science journals indicating that the researchers in the information science field cite more research results in their own field.

The top three main classes of cited journals in papers of the three journals under study are in common and in the same order, i.e., ‘‘Bibliography. Library Science. Information Resources (General)’’, ‘‘Science’’ and ‘‘Social Sciences (General)’’.

As for the books cited, the most cited main class in JASIST and IPM papers is science, while the most cited main class for JOD is ‘‘Bibliography. Library Science. Information Resources (General)’’.

The top three highly cited subjects of library and information science journals are in common and encompass ‘‘searching’’, ‘‘online information retrieval’’, and ‘‘information work’’.

Papers in JOD are less computer-related than JASIST and IPM and JOD is more traditional library science oriented than JASIST and IPM are. On the other hand, ‘‘Information Storage and Retrieval Systems’’ and ‘‘Information Retrieval’’ are two of the three most cited subjects of books cited by the three journals under study.

2014年2月15日 星期六

Wouters, P., & Leydesdorff, L. (1994). Has Price's dream come true: Is scientometrics a hard science?. Scientometrics, 31(2), 193-222.

Wouters, P., & Leydesdorff, L. (1994). Has Price's dream come true: Is scientometrics a hard science?. Scientometrics, 31(2), 193-222.

本研究利用Scientometrics期刊論文以及其參考文獻為研究資料,根據多種資訊判斷科學計量學領域是否已經是硬科學,並分析這個領域的其他特性。本研究所使用的科學計量學資訊有引用文獻的相對年齡(relative age of the cited literature)、論文作者間的關係、論文題名的詞語模式(patterns of words  in the titles of these articles)等。

根據Price的知識增長理論(theory of knowledge growth),科學家會引用本身領域的文獻,因此,如果有研究前沿(research fronts)存在於這個領域,便會產生立即效應。Price指標(Price index)可以測量立即效應(immediacy effect),Price指標較大表示引用文獻的相對年齡較低,例如Price(1970)測得生物化學和物理的Price指標值約在60%到70%,社會科學大約在42%附近。Crane(1972)則認為科學會形成作者間彼此緊密相連的社群,因此本研究分析作者間的合著關係和引用的關係,並且利用網絡分析技術探討科學社群的凝聚程度,並且測量作者在網絡的位置連結性以及結構的相似性,根據這些資訊進行叢集,集結彼此間連結性強的作者形成一個叢集,或是形成位置相似的作者叢集。另外,Rip and Courtial (1984)和Leydesdorff (1989a)
指出題名上的詞語可視為是出版品的認知訊息(cognitive message)的指標,詞語在題名上的共現可視為是詞語間關係存在的紀錄,因此本研究也利用網絡分析技術探討詞語的共現網絡。

研究結果發現分析的779筆Scientometrics期刊論文資料,除了前三年快速的增加外,平均每年增加3.5筆,並且這些論文資料共包含12341筆參考文獻,平均每篇論文有15.8筆參考文獻。各項指標都相當穩定。Price指標的平均值為43.0%,若以每年的Price指標的平均值在34.0%到51.4%之間。

以作者資料來看, 779筆論文資料共計由669位不同的作者完成,有接近3/4的作者(488位)僅出現在一筆論文資料上,每位作者平均出現在1.8筆論文資料上,其作者生產力符合Lotka分布,並且大部分(61%)的論文是單一作者,平均每篇論文有1.6位作者。合著作者的論文資料中,大多數的作者都僅和一到兩位同事合作,合著網絡相當破散,但幾個較大的網絡與作者在同一機構任職、參與同一研究計畫或者具有共同的研究興趣有關。

Scientometrics期刊論文的作者引用網絡則呈現高度凝聚的狀態。779筆論文資料中有441筆被其他Scientometrics期刊論文引用,每筆Scientometrics期刊上的論文引用的論文平均有19.4%同樣是Scientometrics期刊的論文。發表超過1篇以上論文的作者共有181位,其中的130位作者有引用其他129位作者的資料,利用作者之間的彼此互相引用關係,發現形成的集團(clique)大多與作者任職機構有關,也有一個集團是成員間曾彼此辯論(debate)而產生。最後,題名上的詞語共現網絡也同樣有高度凝聚的情形。從上面的資訊可以判斷科學計量學領域已經由多種的學科背景在認知與社會性上整合而成,但並沒有發現研究前沿的現象。

In more than one respect, Scientometrics displays the characteristics of a social science journal. Its Price Index amounts to 43.0 percent, and is remarkably stable over time.

The majority of the published items in Scientometrics has been written by a single author. Moreover, the network of co-authorships is highly fragmented: most authors cooperate with no more than one or two colleagues.

Both the citation networks of the authors and the network of title words indicate that the field is nonetheless highly cohesive.

The characteristics of the publications in this journal, and the patterns of the bibliometric relations among them, may therefore indicate the type and extent of the cognitive and social integration of the various disciplinary backgrounds into scientometrics as a field.

The question, in other words, is how "hard" scientometrics is, and how strongly its knowledge is codified. These properties can be measured in terms of:
a) the relative age of the cited literature, the so-called "Price Index",
b) the relations among the authors of articles published in Scientometrics; and
c) the pattern of words in the titles of these articles.

According to Price's theory of knowledge growth (Price 1965), science distinguishes itself from other fields of study by the way scientists refer to their literature (Price 1970). The existence of "research fronts" in science supposedly leads to an "immediacy effect", which can be measured in terms of the so-called "Price Index".

The Price Index is defined as "the proportion of the references that are to the last five years of literature" (Price 1970). Price estimated that this index would vary between 22 and 39 percent if no immediacy effect were present. [1] A field that was all research front and with no general archive might have a Price Index of 75 to 80 percent.

From his analysis of 162 journals, Price (1970) concluded: "Perhaps the most important finding I have to offer is that the hierarchy of Price's Index seems to correspond very well with what we intuit as hard science, soft science, and nonscience as we descend the scale." Biochemistry and physics are at the top, with indexes of 60 to 70 percent, the social sciences cluster around 42 percent, and the humanities fall in the range of 10 to 30 percent.

Science is, on the whole, practised in tightly knit communities in which the authors address one another (Crane 1972).

Co-authorship relations can be considered as indicators of co-operation. [3]

The meaning of citation relations is less clear, given the ongoing citation debate (MacRoberts and MacRoberts 1989; Cozzens 1989; Luukkonen 1990; Leydesdorff and Amsterdamska 1990; Woolgar 1991). But whatever the precise meanings of citations may be, citations can be considered as sociometric data, and the resulting network can accordingly be analyzed (cf. Shrum and Mullins 1988).

We analyzed the extent to which the authors are connected to one another, i.e. the cohesiveness of the network, as well as the pattern displayed by each author in relation to all other authors, i.e. the position of authors in the network.

We also analyzed the similarities among authors in both these dimensions of the matrices, i.e. we clustered strongly connected authors as well as authors in similar positions. Direct as well as indirect linkages between the authors are involved in this analysis.

Strong cliques are sets of authors connected by relations in such a way that all members of the clique are connected to one another, and anyone for whom this holds is included in the clique. The inclusion criterion is less strong for weak cliques, in which all pairs within the clique must have relationships with all other pairs, and anyone with a relation to or from a member of the clique is included.

Strong structural equivalence clusters are sets of authors with completely identical positions in the network (the distance dP between them is zero). Weak structural clusters are sets of authors with a significant similarity in their patterns of relations (the distance dP is small).

As noted, we wished to know whether a structurally codified semantics of scientometrics exists or whether, on the contrary, the articles in Scientometrics use the different terminologies of the various disciplines surrounding scientometrics.

Given the functions of titles of articles, the words in these titles can be considered as indicators of the cognitive message of the publication (Rip and Courtial 1984; Leydesdorff 1989a). The co-occurrence of words in titles can be considered as an indication of the existence or non-existence of relations between these words (Callon et al. 1983).

Since 1978, 779 items have been published in Scientometrics. They contain 12,341 references to the scientific literature. [10]

The number of publications per year in the journal increases in a linear way (Fig. 1). [11] After a steep growth during the first three years, the number increases by 3.5 publications per year.

The number of references per year shows a comparable pattern, although somewhat more irregular. Every publication contains on average 15.8 references (cf. Yitzhala, 1991). Since 1986, this number has become stable at an average of 15 references per publication (Fig. 2).

The publications in Scientometrics were written by 669 different authors. On average, every author published 1.8 times and every paper was written by 1.6 authors. Nearly three-fourth of the authors (488 or 73 percent) published only once in Scientometrics. The distribution of productivity among the authors is a Lotka distribution (Fig. 4).

The average Price Index of Scientometrics is 43.0 percent. ... The Price Index varies between 34.0 and 51.4 percent (Fig. 5). The regression line is not significant. [12] Apparently, the index displays neither rise nor fall since 1978.

Recently, Schubert and Maczelka (1993) concluded from an analysis of Scientomettics in 1980-81 and 1990-91 that the journal has moved slightly from the "soft" (social) towards the "harder" (natural) sciences. They drew this conclusion from the rise of the Price Index from 35 percent to 42 percent between these measurement points. This observation is, however, based on only two measurements. Because of the statistical fluctuations in the value of the Price Index over time, any conclusion can be drawn regarding the development of the Price Index if one restricts oneself to only two measurement points.

In accordance with Price's theory, the number of references to literature of a specific age rises until the cited literature is two years older than the citing literature, and then falls off (Fig. 7). Note that this decline is gradual. Apparently, only a small "immediacy effect" is visible in scientometrics.

A general phenomenon in science is the growth of the number of co-authored scientific articles, relative to the total scientific production (Luukkonen et al. 1992; Abt 1992).

In Scientometrics, however, 61 percent of the articles have been written by a single author. This share is stable over time.

The network of co-authorships is highly fragmented. ... With the exception of three subgroups, most co-authors cooperate with no more than one or two colleagues.

Comparison of the composition of the weak structural equivalence clusters with the relational cliques reveals that two clusters are identical: a group of authors from Leiden (Van Raan et al.) and a group of authors with various institutional affiliations, probably best characterized as the "co-word analysis group". So, these two groups have distinct identities, with respect both to their relations and to their positions in the network.

Some clusters seem constituted by the institutional affiliations of the authors. This holds for the Leiden group and for the authors around ISI (cluster 3). In other cases, nationality appears to be the binding force. This holds for the group in Hungary (cluster 5), the Belgian informetricians (cluster 10) and the Spanish scientometricians (cluster 6). However, cluster 1 can best be characterized by its research program (co-word analysis). Cluster 2 seems to consist of authors from Sussex together with CHI Research Inc. Thus, co-author relations are not only institutionally defined; shared interests and common intellectual goals play a role as well.

To sum up, scientometrics is a fragmentary field of co-authorships. The authors are highly selective in their co-authorship relations with one another. Co-authorships are defined neither exclusively by social nor only by intellectual factors. Both dimensions shape the pattern of co-authorships.

With respect to the number of solitary authors and the large number of isolated small clusters, scientometrics exhibits the pattern of a social science.

Of the 779 articles published in Scientometrics, 411 were subsequently cited one or more times in Scientometrics. The share of references to Scientometrics (as a percentage of all references) has stabilized around an average of 19.4 percent since 1987.

Of the 181 authors in the core set, 130 authors cite one another. So, 51 (or 28.2 percent) of the authors publishing more than one article in Scientometrics from 1978 till 1993 are neither citing nor cited within this group of authors.

The core set of authors in Scientometrics is found to be highly cohesive in terms of their mutual citation relations. All these authors are members of one single weak clique. Moreover, a majority of these authors (88) also belongs to one strong clique (Table 5).

The picture is different if we exclude all indirect relations from the analysis. This "fine structure" of the citation matrix is shown in Table 6, where 13 strong cliques and 6 weak cliques are revealed. Most strong cliques seem to coincide with shared institutional affiliations. The exception is clique 9, which indicates the existence of a debate among the members of this clique.

The most striking feature of the network of title words of articles published in Scientometrics is its cohesiveness. All words cluster together in a single strong component clique (Table 8). If only direct relations are included, all words cluster together in a single weak component clique. This means that all words are either used together in a title or share a common co-word.

Thus, the language of scientometrics is both strongly unified and weakly codified. This strong cohesiveness is a stable characteristic of the titles in Scientornetrics, from the very start of the journal. Perhaps a distinct discourse already existed before the journal was founded. In any case, it constitutes a textual identity of scientometrics as a field, one probably different from the various mother disciplines. Thus a process of de-differentiation seems to have occurred not only in the patterns of citing (and being cited) but also at the cognitive level.

The interpretation of the Price Index is complicated because of these variations within disciplines. If we, nevertheless, take the Price Index preliminary as an indicator of "hardness", scientometrics belongs to the group of relatively hard social sciences. At the same time, it stays unequivocally within the social science range. Taken literally, Price's dream has therefore not come true, since he postulated the emergence of a completely new type of social science with a natural science character. But if we reformulate his goal a posteriori in a more modest way, as the building of a relatively hard social science, it did come true.

The value of the Price Index appears stable over the years. Since a number of other indicators also exhibit stability, this seems to suggest the existence of some scientometric identity. For example, the journal expands at a regular rate, while the percentage of co-authored papers increases only very slowly. The origin of this stability can best be explained by the finding that the community of researchers who have published more than once in Scientometrics acts as a tightly knit network.

In addition to the co-authorships within various institutes, and partly overlapping with this structures, there are national co-authorship relations, like those among the Belgian informetricians, and programmatic co-authorship relations, like those among the users of the French co-word instrument. In general, co-authorship relations are firmly embedded in existing social structures, both at the national and at the community level.

These various strong graphs of co-authors, however, are structurally embedded in the communication structure as indicated by textual indicators. Both in terms of citation relations and in terms of title-words the network is very cohesive, while the structural dimensions of codification are less clear.

In summary, the community of authors publishing in Scientometrics is well integrated, while there are no indications of an exclusive paradigm or a research front.

2014年2月9日 星期日

Schoepflin, U., & Glänzel, W. (2001). Two decades of" Scientometrics". An interdisciplinary field represented by its leading journal. Scientometrics, 50(2), 301-312.

Schoepflin, U., & Glänzel, W. (2001). Two decades of" Scientometrics". An interdisciplinary field represented by its leading journal. Scientometrics, 50(2), 301-312.

本研究以Scientometrics期刊論文的參考文獻資料,對科學計量學領域的特性進行分析。過去的研究裡,Schubert and Maczelka (1993)利用1980-1981和1990-1991兩個時段Scientometrics期刊論文的參考文獻年齡,計算兩個時段的Price指標(Price index),發現後面時段的Price指標較大於前一個時段的Price指標,因此判斷科學計量學領域正趨向較硬的社會科學。Wouters and Leydesdorff (1994)認為只取樣幾個時段的資料可能不準確,應該觀察資料的連續變化情形,他們的研究指出Price指標在1978到1992年間的變化並不大,所以這個社會科學是較穩定的、並沒有朝向應科學發展的趨勢。Glänzel and Schoepflin (1994)則認為科學計量學是異質性很高的研究領域,這個領域的作者來自不同的學科,擁有相當不同的傳播、引用和發表方式,這種現象使得這個科際整合的領域趨向多元發展。

本研究以1980、1989和1997三個年度的Scientometrics期刊論文的參考文獻做為研究資料,計算以下四個統計資訊:1) 每篇論文的Price指標(the Price index per paper)、2) 參考文獻是連續出版品的百分比(the percentage of references to serials)、3) 參考文獻的平均年齡(the mean reference age)和4) 平均參考文獻數(the mean reference rate)。各年度的論文數與指標如下表所示:


三個年度的期刊Price指標相當穩定,並且所有的指標都反映Scientometriics類似社會科學期刊的模式。此外,表上也呈現每一年度論文的Price指標和連續出版品比率的中位數(median),這些數據皆明顯大於期刊的數據,表示許多論文比整體期刊呈現的情形來得硬。

本研究並分派每一篇論文到一個類別,這些類別包括:1) 書目計量學理論、數學模型與書目計量學定律的公式化(bibliometric theory, mathematical models and formalisation of bibliometric laws);2) 案例研究與實務論文(case studies and empirical papers)、3) 方法學論文包含應用(methodological papers including applications)、4) 指標工程與資料呈現(indicators engineering and data presentation)、5) 書目計量學中的社會學取向,科學社會學(sociological approach to bibliometrics, sociology of science)、6) 科學政策、科學管理與廣泛或技術討論(science policy, science management and general or technical discussions)。論文在各類別及各年度的分布如下表所示


可以明顯地發現:1980年度的案例分析和方法學論文所占比例較小,但在後兩個年度則占了論文的大部分;相反的,科學政策從第一個年度後便減少,社會學取向也有相同的情形。本研究推測等Research Evaluation與Social Studies of Science等期刊吸引了相關的論文投稿可能是科學政策與社會學取向方面的論文數量減少的原因。

下表分析各分類論文的參考文獻指標,從這些數據可以看出不同類別的論文在指標上差異很大,特別是科學政策,因此當科學政策在第二和三個年度大幅減少後,期刊整體的指標便有很大的不同。因此,本研究認為科學計量學是異質性很高的領域。



The development of the field of bibliometric and scientometric research is analysed by quantitative methods to answer the following questions:
(1) Is bibliometrics evolving from a soft science field towards rather hard (social) sciences (Schubert-Maczelka hypothesis)?

(2) Can bibliometrics be characterised as a social science field with stable characteristics (Wouters-Leydesdorff hypothesis)?

(3) Is bibliometrics a heterogeneous field, the sub-disciplines of which have their own characteristics? Are these sub-disciplines more and more consolidating, and are predominant sub-disciplines impressing their own characteristics upon the whole field (Glänzel-Schoepflin hypothesis)?

The findings suggest, that the field is in fact heterogeneous, and each sub-discipline has its own characteristics.

Indeed, this journal covers almost the complete spectrum of bibliometric research. It publishes theoretical papers and papers on mathematical models as well as on the research evaluation of special fields and/or selected institutions, on science policy questions as well as articles on social studies of science and general discussions about the field.

While Schubert and Maczelka (1993) found a clear move from softer’ towards ‘harder’ (social) sciences between the analysed time periods 1980-1981 and 1990-1991, respectively, Wouters and Leydesdorff (1994) concluded on the basis of the change of Price’s Index in time that bibliometrics has not become a hard social science field in the observation period 1978-1992.

Glänzel and Schoepflin (1994) stated in their discussion paper that bibliometrics has become a heterogeneous field and sub-disciplines are drifting apart. Consequently, bibliometrics comprises sub-disciplines with distinctly different communication, citation and publication characteristics.

Assuming that bibliometrics is an interdisciplinary field and that authors coming from different fields bring their specific communication behaviour into it, we have classified all papers published in Scientometrics into different categories representing the main field-specific approaches to bibliometrics.

All source articles published in the journal Scientometrics in three sample years, 1980, 1989 and 1997, have been processed. All references cited in articles, notes and letters in the above three publication years were selected. Review articles have not been taken into consideration since the extent and structure of the reference lists of these documents are expected to distinctly differ from those of other research papers. Papers without references have been omitted.

References have been assigned to two categories, reference to serials (S) and reference to non-serials (N). All references have been classified manually.

The following statistics have been calculated.
1. The Price Index per paper. This index is defined as the percentage of references not older than five years in all references of an individual paper. This indicator has been introduced by Moed (1989).
2. The percentage of references to serials. The share of references assigned to category S in all references (N+S) cited by a journal or subfield expressed in percent.
3. The mean references age. The age of references cited in a journal or subfield are summed up and divided by the number of the references. This indicator can be determined also as a conditional mean, that is for both the subset of references in serials and non-serials separately.
4. The mean reference rate. This is the ratio of the number of references cited by a journal and the total number of papers published in the journal including those without references.

The “Price Index” is commonly used as a measure to distinguish between hard science, soft science, technology and non-science (see Price, 1970).

According to the results of an earlier study (Glänzel and Schoepflin, 1999), the percentage of references to serials proved to be a sensitive measure to characterise typical differences in the communication behaviour between the sciences and the social sciences.

The mean reference age also serves as an efficient measure of the “hardness” of science. In the paper by Glänzel and Schoepflin (1999), a comparison of the mean age of references and the Price Index has shown that the age of references is only in part reflected by the Price Index, in particular if the average age of references does not exceed about 15 years.

In addition, we calculated the mean reference rate, that is, the average size” of the reference list of a bibliometric paper published in Scientometrics. Although this cannot be considered a sensitive measure of the “hardness” of science, it reflects nevertheless additional field-specific characteristics (see Glänzel and Schoepflin, 1999).

In the next step, all selected source articles in Scientometrics have been assigned manually to one category out of a scheme of six. ... The classification scheme used for this study is presented in Table 1. The classification permits to group the material in several ways: the categories can be regarded from the viewpoint of core bibliometrics (2, 3, and 4) and background research (1, 5, and 6), but also with respect to theoretical (1, 3, and 5) and applied research (2, 4, and 6).


Table 2 presents the number of papers assigned to each category in 1980, 1989 and 1997.




However, the Price Index shows stability also in our case. Even more, all indicator values reflect patterns typical of social-science journals (c.f. Glänzel and Schoepflin, 1999).

It is worth mentioning here, that the median of paper-based indicators is greater both for the Price Index and the share of serials than the corresponding journal indicators. This phenomenon allows only one possible interpretation: Numerous papers are ‘harder’ than expected on the basis of the overall journal indicators.

There are obviously two dramatic developments: first, there is an impressing and steady growth of Case Studies, from a forth position in 1980 to the predominant first position in 1997. Second, there is a similarly impressive loss of share of articles on Science Policy and Discussions (category 6) from the predominant first position in 1980 to a minor category in 1997. This goes along with a steady loss in material with a sociological approach, too (category 5). On the other hand, there is a certain increase in Methodology (category 3), while Theory and Indicator Engineering remain minor classes.



If we now take a look on Core Bibliometrics as defined by categories 2, 3, and 4, it becomes obvious, that this group is practically reduced to Case Studies and Methodology, and by far dominating the total output of research as represented by the journal Scientometrtics.

The group characterised as Background Research (categories 1, 5, and 6) has continuously lost ground since 1980. Moreover, theoretical research in bibliometrics seems to be mainly a matter of methodology.

Following the differentiation of the field, journals like Social Studies of Science or the newly founded Research Evaluation publish a considerable share of bibliometric research in categories 5 and 6. But also journals in information science (e.g. JASIS, Information Processing & Management, or Journal of Information Science to name just a few Anglo-Saxon titles) attract bibliometric research articles.

On the detriment of a larger scope, Scientometrics has clearly become the forum for Case Studies and Methodology-oriented contributions.

The above-mentioned deviating patterns in 1980 can be at least in part explained by the great share of papers in category 6 and their low share of serials and relatively low age of the references. Indeed, the indicator values of the six categories give evidence of specific characteristics of the corresponding sub-disciplines.



The above trends and figures tell unambiguously against an evolution of bibliometrics towards a discipline of ‘hard’ social science (Schubert-Maczelka hypothesis). On the other hand, we cannot speak of stable characteristics, either (Wouters-Leydesdorff hypothesis). The indicators allow only an interpretation in the sense of the third hypothesis. The field is indeed heterogeneous, and each sub-discipline has its own characteristics. This may, of course, be at least in part caused by the deviating field-specific communication behaviour of the authors who bring traditional organisation schemes from their own fields into bibliometrics.

2014年2月7日 星期五

Peritz, B. C., & Bar-Ilan, J. (2002). The sources used by bibliometrics-scientometrics as reflected in references. Scientometrics, 54(2), 269-284.

Peritz, B. C., & Bar-Ilan, J. (2002). The sources used by bibliometrics-scientometrics as reflected in references. Scientometrics, 54(2), 269-284.

Van Raan (1997)討論科學計量學的最佳狀態,強調這個領域需要平衡應用與基礎研究以及增強科學計量學和廣泛的學科之間的關係。過去已經有許多研究根據Scientometrics期刊論文的參考文獻,對科學計量學領域的特性進行分析,例如:Schubert and Maczelka (1993)利用1980-81與1990-91兩個期間的論文參考文獻,分析1980年代Scientometrics期刊的改變,所使用的指標包括參考文獻的年齡分布(age distribution)、Price指標(Price index)、引用出版品的分布、引用作者的分布以及最常引用的出版品等。Wouters and Leydesdorff (1994)分析前25卷的論文參考文獻,計算論文的平均參考文獻數量以及被引用文獻的相對年齡(relative age)。Schoepflin and Glänzel (2001)以1980、1989和1997年的論文參考文獻資料,計算Price指標、參考文獻為連續出版品(serial)的比率、參考文獻的平均年齡(mean reference age)和平均引用的參考文獻比率(mean reference rate)。

本研究比較Scientometrics期刊1990和2000年論文的參考文獻,共169篇論文(1990年70篇,2000年89篇。附註:此處有誤,合計只有159篇。),2814筆參考文獻,並將參考文獻的來源分為不同領域。結果發現1990年每篇論文平均有15.1(1054/70)筆參考文獻,2000年每篇論文平均有19.8(1760/89)筆參考文獻。Scientometrics期刊論文引用近五年的文獻比例,也就是Price指標,從1990年的37.6%,減少為2000年的31.6%。1990年有47.3%的參考文獻來自科學計量學與書目計量學(scientometrics and bibliometrics)、圖書資訊學(library and information science)以及社會學、歷史學與哲學(the sociology, history and philosophy of science),2000年增加為56.9%。兩個年度的作者自我引用情形沒有明顯差異,1990年為13.4%,2000年則為13.9%。然而該期刊的自我引用(journal self-citation)與引用期刊的百分比(the percentage of references to journals)等情形皆有增加。期刊的自我引用情形從1990年的12.9%增加為2000年的20.1%,可能的理由是Scientometrics愈來愈成為這個領域的核心期刊。

The aim of this study was to examine the extent to which the field of bibliometrics and scientometrics makes use of sources outside the field.

The results show that in 2000, 56.9% (and 47.3% in 1990) of the references originated from three fields: scientometrics and bibliometrics; library and information science; and the sociology, history and philosophy of science.

When comparing the two periods, there is also a considerable increase in journal self-citation (i.e., references to the journal Scientometrics) and in the percentage of references to journals.

Van Raan (1997) discussed the state-of-the-art of scientometrics, and emphasized the need to balance between applied and basic research in the field, and the importance of strengthening the relations of scientometrics with a broad spectrum of disciplines.

Peritz (1981) examined the references of research papers published in 39 core journals during five calendar years, and calculated the percentage of references outside the field. In another study, Peritz (1988) examined the literature for bibliometrics for the period 1960–1985, and classified the body of literature according to the field of the journal in which the article was published.

Al-Sabbagh (1987) studied the interdisciplinarity of information science through a reference analysis of JASIS. The findings, based on a ten percent random sample of references appearing in JASIS articles between 1970 and 1985 show that the largest percentage of references come from information science, followed by computer science, library science and science-general.

Thompson (1989), based on the references of articles in twenty library and information science journals in five selected years, studied the age of the references, the extent of self citation, and found that the list of most cited journals was almost exclusively from library and information science.

Cronin and Pearson (1990), in a study based on citations found that information science exports techniques of information retrieval and bibliometrics.

Meyer and Spencer (1996) analyzed citations to twenty-four library and information science journals over a twenty-year period. Their findings show that 86.6% of the citations come from library and information science, but other disciplines including computer science, medicine, psychology, the social sciences and general sciences also cite library and information science journals to some extent.

Rousseau (1997) studied the references appearing in the papers of the first two ISSI Conferences and citations of the Proceedings. He tabulated the most frequently cited publications – the three most frequently cited publication were JASIS, Scientometrics and J. Doc. The list of most frequently citing journals and of the most cited papers from the Proceedings was also presented.

The journal Scientometrics has been the “theme” of several previous bibliometric studies.

Schubert and Maczelka (1993) studied the changes that occurred to the journal during the 1980’s based on its reference patterns. Two periods, 1980–81 and 1990–91 were chosen. They calculated the age distribution of the references, the Price Index, the distribution of the cited publication, the distribution of cited authors, and tabulated the most frequently cited publications.

Wouters and Leydesdorff (1994) analyzed the references of all articles and notes in the first 25 volumes of Scientometrics, and calculated, among other indicators, the number of references per article and the relative age of the cited literature (the Price Index).

Persson (2000) maps the citation and reference patterns of Scientometrics based on volumes 1 to 44 of the journal.

Very recently Schoepflin and Glänzel (2001) calculated several bibliometric measures (the Price Index, percentage of references to serials, mean reference age and mean reference rate) for articles, letters and notes published in Scientometrics in 1980, 1989 and 1997.

Most of the previous studies of Scientometrics were either concerned with quantitative aspects (e.g.; the Price Index) or with citation and co-citation patterns.

This study analyzed all the references of all the papers published in Scientometrics in 1990 and in 2000. The population of the study consisted of 169 papers and 2814 references. ...The list contained 70 items for 1990 and 89 items for 2000, altogether 169 papers. ... In the set for 1990, 60 (86% of the total for 1990) items in the list were labeled as articles, while for 2000, 83 (93% of the total for 2000) items were labeled as articles.

The references were categorized according to six facets:
• author self-citation;
• journal self-citation;
• discipline of publication source;
• field self-citation;
• type of publication;
• year of publication.

Thus, first we had to define the major themes covered by the field:
• indicators (science and technology), forecasting and planning;
• research trends, research evaluation and funding;
• science policy;
• bibliometric laws and models;
• citation analysis including all aspects (e.g. obsolescence, ranking, mappings, coupling, etc.);
• patent analysis;
• reference analysis;
• coword analysis in context of performance;
• productivity (e.g. authors, journals, institutions);
• impact;
• peer review process;
• sociology of science;
• social contexts of research;
• characteristics and development of a scientific area;
• scholarly communication;
• scientific networks;
• technology flow;
• innovation;
• other themes relevant to the field.

Altogether, 2814 references were identified, 1054 in 1990 and 1760 in 2000.
The mean number of references in 1990 was 15.1, while in 2000 the mean increased to 19.8.

It is interesting to note, that the percentage of references in the last five years (1986 to 1990, for 1990; and 1996 to 2000 for 2000) decreased from 37.6% to 31.6%. Does this mean that scientometrics is getting “softer” (the “Price Index”, (Price, 1970))?

Both Schubert and Maczelka (1993) and Shoepflin and Glänzel (2001) found that the Price Index of scientometrics increased over time. They, as in the current work, based their data on single years.

On the other hand, Wouters and Leydesdorff (1994) studied the first twenty five volumes of Scientometrics, observed some fluctuations in the Price Index over the years, but showed that the regression line is not significant, and concluded that the index displays neither rise or fall between 1978 and 1992.

We also believe, that in order to draw conclusions about the “hardness” or “softness” of the field, its journal or journals should be studied over a continuous time period, and not isolated years.

A reference for a given item was labeled as author self-citation, if one of the authors of the reference matched one of the authors of the given item. ... Author self-citation was 13.4% for 1990 (141 references) and 13.9% (244 references) for 2000. ... In terms of author self-citation, no significant differences were observed between the two periods.

Journal self-citation, (i.e., references to the journal Scientometrics), on the other hand, increased considerably, from 12.9% in 1990 (136 journal self-citations) to 20.1% (354 journal self-citations) in 2000.

A possible explanation for this increase is that the journal Scientometrics is more and more becoming the central journal of the field.

The top four journals appear exactly in the same order for both years, and they represent the main aspects of the field: the field itself, its relation to information and library science, to planning and management and to the sociology of science. These four sources cover 18.5% of the references in 1990, and 28.1% of the references in 2000.

In the list of most frequently cited publications we see mostly journals, but also books, handbooks, yearbooks, collections, proceedings and reports. ... Table 4 shows that the percentage of the references to journal articles increased considerably, while the percentage of the references to books, yearbooks and reports decreased. In 1990 there were no references to electronic sources, this category only appeared in 2000. It will be interesting to see whether the electronic sources are going to be referenced more extensively in the future.

Along with the increasing citation rate of the journal Scientometrics, we observe a general increase in sources belonging to the field of scientometrics and bibliometrics. This could either be the sign that the field is becoming more mature or self-sufficient or it may indicate that scientometricians base their research less and less on methods and studies conducted in other fields.

Most of the references 2000 (56.9%), and nearly half of the references in 1990 (47.3%) are from the three fields, closely related to the subject-matter: scientometrics and bibliometrics itself; library and information science; and sociology and history of science.

A substantial amount of references are to sources belonging to the social sciences (21.3% in 1990, and 13.0% in 2000). We see that the percentage of references to sources from the social sciences decreased considerably.

On the other hand, the combined share of sciences-general; mathematics, computer science, statistics and engineering; science and medical sciences remained nearly the same (23.4% in 1990 versus 23.5% in 2000).

About half of the references originate from sources, which are not related to scientometrics. It is quite possible that some of these references are to works, which belong to the field.

On the other hand, some of the references from the fields closely related to scientometrics are not classified as field self-citation.

In 1990, 593 out of the 1054 references (56.3%) were classified as field self citation, while in 2000, 1092 out of the 1760 references (62.0%) were field self-citations. This is a rather considerable increase, it may indicate that the field is becoming more and more self sufficient, and needs to rely less on theories and methods emanating from other scientific fields.

The results show that the field relies heavily on itself, on library and information science and on sociology, history and philosophy of science.

There is an increase in journal self-citation, the list of core journals remaining stable for both periods. Author self-citation is around 20% for the years under study.

2014年2月4日 星期二

Schubert, A. (2002). The web of scientometrics: A statistical overview of the first 50 volumes of the journal. Scientometrics, 53(1), 3-20.

Schubert, A. (2002). The web of scientometrics: A statistical overview of the first 50 volumes of the journal. Scientometrics, 53(1), 3-20.

Schoepflin and Glänzel (2001)將Scientometrics期刊上的論文主題分為六類:1. 理論(包括書目計量學理論、數學模型和書目計量學定律的公式化)、2. 案例(案例研究和實務論文)、3. 方法學與應用、4. 指標 (指標工程與資料呈現)、5. 社會學取向(書目計量學的社會學方法和科學社會學)以及6. 政策研究(包括科學政策、科學管理和一般與科技討論)等,並應用這樣的分類討論Scientometrics期刊的論文主題在1980、1989及1997等三個不同年份的比重變化。上述的主題可以在歸納成核心的書目計量學(core bibliometrics) (2, 3, 4)和背景研究(background research) (1, 5, 6)或是理論研究(1, 3, 5)和應用研究(2, 4, 6)。Schoepflin and Glänzel (2001)的研究發現案例與方法學有明顯與穩定的成長,但社會學取向和科學政策的論文數量減少。

本研究以前50卷1443篇Scientometrics期刊的論文資料進行計量分析,這1443篇論文上包含來自60個國家的1223位作者,共包含25200個參考文獻(不重複的項目共16500個),除了382篇論文不曾被引用外,1061篇曾被引用的論文共被引用7242次。

以合作關係的分析,55.1%的論文為單一作者,只有5.4%的論文由3位以上的作者合作完成,論文的平均作者數是1.61,過去十年來合作的情形略有增加,因此科學計量學領域比較像社會科學或數學。國際合作情形較罕見,只有 7%的Scientometrics論文由一個以上的國家合作完成,但後25卷的國際合作情形是前25卷的兩倍以上。

以Price指標(the Price index)分析Scientometrics論文的25200個參考文獻,了解其引用文獻在五年內出版的比例,藉以判斷該期刊是屬於軟科學(soft sciences)或硬科學(hard sciences),結果發現在五年內出版的文獻大約占45%。其引用的期刊來源,除了圖書資訊學(Information Science & Library Science)、電腦科學(Computer Science)和跨領域應用(Interdisciplinary Applications)外,其餘多屬普通物理(general physics)、普通化學(general chemistry)、普通醫學(general medicine)等較廣泛的領域。但也可以發現有相當高比例(13.6%)是期刊自我引用的情形,就被引用的情形來看則高達47.3%是來自期刊本身。

A total of 1443 items were published by 1223 authors from 60 countries. They contained 25200 references to about 16500 different items ...1061 Scientometrics papers received 7242 citations during the 1978-2000 period (i.e., 382 papers remained uncited).

Activity Indexes show even more spectacularly the outstanding relative activity of a few countries (first of all Hungary, but also Belgium, Bulgaria, Chile, Mexico, Netherlands and, if measured against social science standards, then P.R. China, Poland, Russia and Spain, as well). A conspicuously low relative activity is shown by Italy and Japan (not so much if social science standards are concerned); interestingly, most English-speaking countries (US, England, Australia, Canada) exhibit a lower-than-average activity.

In their paper, Schoepflin and Glänzel (2001) classified the papers published in Scientometrics into six thematic categories, and studied the change in the weight of these categories by selecting three sample years: 1980, 1989 and 1997.
They used the following categories:
1. (THEO) Bibliometric theory, mathematical models and formalisation of bibliometric laws;
2. (CASE) Case studies and empirical papers;
3. (METH) Methodological papers including applications;
4. (INDI) Indicator engineering and data presentation;
5. (SOCI) Sociological approach to bibliometrics, sociology of science;
6. (POLI) Science policy, science management and general or technical discussions.

The classification permitted to group the material in several ways: the categories can be regarded from the viewpoint of core bibliometrics (2, 3, and 4) and background research (1, 5, and 6), but also with respect to theoretical (1, 3, and 5) and applied research (2, 4, and 6).

There are two obvious developments: an impressing and steady growth of case studies (Category 2) and methodology (Category 3) and the loss of position of articles on sociological (Category 5) and science policy (Category 6) issues.

In this respect, however, scientometrics resembles rather to the social sciences(or, maybe, mathematics) than to the sciences: 55.1% of the papers published in the first 50 volumes of Scientometrics is single-authored and only 5.4% of them are multi-authored (more than 3 authors). The average number of authors per paper is 1.61. In the past decade, nevertheless, there is a slight tendency of growing collaboration (see Figure 3).

International collaboration is even less favourised in the scientometrics community. There is a modest 7% of Scientometrics papers having more than one country in the authors’ affiliation section in the by-line of the publication. Nevertheless, the tendency is unambiguous: the fraction of internationally co-authored papers more than doubled from the first to the second 25 volumes.

The 25200 references of the papers form, as it were, the intellectual “hinterland” of research reported in Scientometrics. Clearly, they constitute a vast treasury of information about the history, sociology, epistemology of the field and its journal, and several attempts were made to make the most of this information (Schubert and Maczelka, 1993; Wouters and Leydesdorff, 1994; Schoepflin and Glänzel, 2001).

De Solla Price (1970) introduced an index, later named after him, with the aim of distinguishing between “harder” and “softer” sciences. The Price Index is defined as the percentage share of references to items not older than five years at the time of publishing the citing paper. Typical “soft science” journals (German Review, American Literature, Studies in English Literature, Isis, in Price’s original study) have an index value less than 10%, while, e.g., some research front physics journals may reach 80%.

The Price Index of the journal Scientometrics is around 45%, i.e., it occupies a medium position on the hardness scale.

Among the highly cited sources there is a clear dominance of SCI/SSCI-covered titles: 19 of the 25 titles belongs to this category. References to the journal itself (journal self-references) constitute 13.6% of all references – it is a typical value for a consolidated primary journal.

The journal Scientometrics itself is categorised into two subfields: Information Science & Library Science and Computer Science, Interdisciplinary Applications.

It can be seen that Information Science & Library Science would remain the main source of information for the journal even if self-references were disregarded, while Computer Science, Interdisciplinary Applications would disappear from the chart without them.

Among science journals, those from broader-scope subfields (general physics, general chemistry, general medicine, multidisciplinary sciences) contribute the most to the reference base of Scientometrics. The presence of Analytical Chemistry among the top cited fields may be connected with the fact that this is the original and main fireld of the Editor-in-Chief of the journal.

The journal self-citation rate of 47.3% is rather high, particularly if compared with the self-reference rate of 13.6%. It indicated that the “outside world” pays less attention to the journal than vice versa.

2014年1月17日 星期五

Chen, Y. W., Fang, S., & Börner, K. (2011). Mapping the development of scientometrics: 2002–2008. Journal of Library Science in China, 3, 131-146.

Chen, Y. W., Fang, S., & Börner, K. (2011). Mapping the development of scientometrics: 2002–2008. Journal of Library Science in China, 3, 131-146.

本研究利用社會網絡分析與科學地圖映射(science mapping)分析Scientometrics期刊2002到2008年發表的816筆論文。

針對Scientometrics期刊進行書目計量分析的相關研究,包括:Schoepflin and Glanzel (2001)將Scientometrics在1980、1989和1997年發表的論文分別進行歸類,發現科學政策(science policy)和科學社會學(the sociology of science)的比率在下降。Peritz and Bar-Ilan (2002)發現Research Policy和Social Studies of Science分別是1990和2000年Scientometrics論文引用的期刊次數最多的第三名和第四名。Chen, McCain, White, and Lin (2002)分析出1981到2001年間Scientometrics期刊的引用及共被引模式。Hou, Kretschmer, and Liu (2008)對2002到2004年間Scientometrics期刊上的作者合作網絡的結構特性進行分析。Dutt, Garg, and Bali (2003) 則分析Scientometrics期刊1978到2001年間論文資料上的國家、機構在主題上的分布。

本研究在816筆論文資料上共計發現57個國家,具有較大生產力的國家主要是歐洲國家。前十個較大生產力的國家裡,美國、比利時、西班牙、中國和德國都有相當快速的年增率,但印度的年增率是負的。生產力較大的國家的被引用次數也比較高。

為了國家間的研究合作情形,本研究提出相對合作強度(relative collaborative intensity, RCI),這個測量方式整合了合作的國家數和合作的次數兩種指標,其公式如(3)所示:

假設(RCI)i是第i個國家的相對合作強度,其中CCiCTi分別是這個國家合作的國家數和與其他國家合作的次數。在本研究裡,比利時是相對合作強度最高的國家,英國、荷蘭與美國則分居2到4名。

接下來將國家間的合作關係表現成網絡圖,圖形上最大的相連成分(connected component)共有37個國家。在這個相連成分上,比利時、英國和匈牙利之間都有很強的連結。

以機構來看,比利時的Katholieke Univ Leuven、匈牙利的Hungarian Academy Science和荷蘭的 Leiden Univ發表的論文數和被引用次數最多。

進一步分析前十個主要機構的被引用次數最多的前十筆論文資料,發現引用它們的論文主要來自圖書資訊學、電腦科學、資訊系統和跨領域應用(interdisciplinary applications)等領域。但台北醫學大學的一篇論文則被許多生物醫學領域的論文引用。

就論文的合作作者數來分析,本研究發現單一作者的論文有271篇,多位作者的論文有545篇,每篇論文平均有2.29位作者。Dutt, Garg, and Bali (2003) 研究1978-2001年間的論文,單一作者的論文占半數一上,平均合作作者數則為1.73。兩相比較之下,由多位作者的論文數和平均作者數增加的結果,能夠顯示Scientometrics期刊上的合作情形增多。

從引用的文獻分析Scientometrics的主題包括科學與技術的關係(the relationship between science and technology)、個人科學研究產出的量化指標(indexes to quantify an individual's scientific research output)、作者的合作現象(author collaborations)、共被引網絡(co-citation networks)、科學引響力以及國家富強(the scientific impact and wealth of nations)。

The purpose of this article is to use the methods of Social Network Analysis and Science Mapping to make an analysis on the 816 papers published in the international journal Scientometrics from 2002 to 2008.

The major tools used in this paper were TDA, NWB and Excel.

Börner (2006) discussed the mapping research on structure and evolution of science.

Börner, Penumarthy, Meiss, and Ke (2006) mapped the diffusion of information among 500 major U.S. research institutions based on the 20-year publication data set published in the Proceedings of the National Academy of Sciences (PNAS) in the years 1982-2001.

Boyack, Börner, and Klavans (2009) mapped the structure and evolution of chemistry research over a 30 year time frame based on Science (SCIE) and Social Science (SSCI).

Leydesdorff and Rafols (2009) made a global map of science based on the ISI subject categories.

For instance, Schoepflin and Glanzel (2001) found a decrease in the percentages of both the articles related to science policy and to the sociology of science by classifying the articles published in Scientometrics in the years 1980, 1989 and 1997.

Peritz and Bar-Ilan (2002) analyzed the papers published in Scientometrics in 1990 and 2000 and found that Research Policy and Social Studies of Science are the third and fourth most frequently referenced journals in articles published in Scientometrics.

Chen, McCain, White, and Lin (2002) drew upon citation and co-citation patterns derived from articles published in the journal Scientometrics (1981-2001).

Hou, Kretschmer, and Liu (2008) analyzed the structure of scientific collaboration networks in scientometrics at micro level (individuals) by using bibliographic data of all papers published in Scientometrics of the years 2002-2004.

Dutt, Garg, and Bali (2003) made an analysis of papers published by Scientometrics during 1978 to 2001 by scientometrics assessment on countries and themes distribution, comparison of institutions and co-authors.

The analysis of 816 papers published in Scientometrics during 2002-2008 showed that they were contributed by 57 countries (or regions). ... Most of the 57 countries were from Europe. Other major countries (or regions) had a larger number of papers were USA and Canada in North America, China, India, Taiwan, South Korea and Japan in Asia, Brasil in Latin America, and Australia.

Fig. 2 had clearly illustrated the average annual growth rates of TOP10 countries, from which we can conclude that USA, Belgium, Spain, China and Germany had higher growth rates and India had a negative growth rate.

From Fig. 3 we could see that all the TOP 10 countries had a higher number of times cited. It indicated that the papers contributed by those countries were of higher quality and had more impact.



In order to visualize the relative intensity of collaboration, this article introduced the concept of Relative Collaboration Intensity (RCI) indicator. The average number of collaboration countries (CC), average collaboration times (CT) and Relative Collaboration Intensity (RCI) of the 10 countries were given in formula (1), (2) and (3):



We found that Belgium had the highest relative collaboration intensity, and England, Netherlands and USA ranked 2, 3 and 4.

In order to make a clear vision about the collaborations among all the countries/regions (57), the country collaboration network had been made with the method of SNA by NWB. ... The largest connected component in the network had 37 nodes, and there is another small component with 2 nodes.

Fig. 4 showed the largest component with 37 countries, which depicted that Belgium, England and Hungary had formed an strong connection. The largest connection lied between Belgium and Hungary, and the collaboration times were 27. Fig. 4 also showed that although the USA had the largest number of papers, the collaboration activity was weaker than Belgium, Hungary, England and Finland. USA had paid much more attentions to collaborate with Canada, England and Australia. Netherlands had collaborated with many countries, however, the collaboration times were fewer compared to Belgium, England and Finland.

The data showed that Katholieke Univ Leuven (Belgium), Hungarian Academy Science (Hungary) and Leiden Univ (Netherland) ranked from first to third both in number of papers and times cited and all of them had a biggish advantage to others.

We select the Most-Cited paper (that had the highest value of times cited) of each TOP 10 TC/P institutions and get 10 Most-Cited papers finally. By analyzing their citing papers, we found that the citing papers which had cited the Most-Cited paper of each institution distributed mainly in the fields of information science & library science, computer science, information systems and interdisciplinary applications ....

So a conclusion could be made that although an institution did not have many papers or hold the advantage of research activities, it could carry out one or some significant works that had a great impact on the future development of information science & library science. And some research work on scientometrics had also affected the development of some other scientific fields, such as the work of Taipei Med Univ.

Another study carried out by Dutt et al. (2003) in scientometrics showed that the average number of authors per paper was 1.73 during the period of 1978-2001. We studied the average number of authors per paper published in Scientometrics 2002-2008 and found that the value was 2.29, which indicated that collaboration in scientometrics had been growing since 2001.

To analyze the intensity of co-authorship pattern, the whole data (816 papers) had been divided into two groups, which were single authored (271) and multi-authored (545). Compared to the result made by Dutt et al. (2003) that more than half of the papers were single authored, we found that the ratio of papers written by two or more authors had increased rapidly from 2002-2008.

Table 6 listed the TOP 10 authors according to their number of papers. Compared to Fig. 6 we could find that all the TOP 10 authors were appeared in the biggest collaboration cluster. It was interesting to note that the TOP 10 authors collaborated with each other either directly or indirectly.

Most of the TOP 20 cited references had distributed in big co-citation clusters shown in Fig. 7. ... All these four highly cited papers in the biggest cluster were focusing on the relationship between science and technology especially for the effect of science on technology. ... The second largest cluster contained 19 nodes, two of which were ranked in TOP 20. The topics were about indexes to quantify an individual's scientific research output (Hirsch, 2005). The third largest cluster included three nodes listed in TOP 20, whose topics were about author collaborations (Glanzel, 2001; Katz & Martin, 1997; Narin, Stevens, & Whitlow, 1991). There were another two clusters containing two TOP 20 nodes, and one had 10 nodes, whose topics were on co-citation networks (De Solla. Price, 1965;Small, 1973), the other had only two nodes published in Nature and Science individually with the topic of the scientific impact and wealth of nations (King, 2004; May, 1997).

The major topic were social network analysis (Wasserman & Faust, 1994), Matthew effect in science (Merton, 1968), author self-citation (Glanzel, Thijs, & Schlemmer, 2004), country research performance (Moed, 2002), evaluation indicators of publication and citation (Schubert & Braun, 1986) and the calculation of web impact factors (Ingwersen, 1998).