![\"GS1\"](\"http:\/\/sites.massey.ac.nz\/wp-content\/uploads\/sites\/19\/2013\/09\/GS1.jpg\")
<\/a><\/p>\nThere is no obvious author for this report so poor old GS chose three headings at random from the sidebar at the left – Bulletins Portal, Avian Influenza and West Nile Virus. Looking at the list of options it could have been worse –<\/p>\n
For those with too much time on their hands, it used to be possible to have great fun doing this sort of thing, but they do seem to have cleaned their act up a bit over the years and you no longer get massive numbers of hits by author-searching the names of nasty diseases. For glass-half-full people, on the other hand, there is a huge upside to GS\u2019s cheap-and-cheerful approach and that relates to its ability to find stuff right in the middle of articles, reports and even books. Let\u2019s look again at jellyfish attacks on ad hoc networks – you can click here<\/a> to run this search in Google Scholar. Now we get 150 results and it\u2019s pretty clear from the first couple of pages that many or most of them are from bona fide scholarly journals in the IT field. Even if we go to the last page they still look okay, and even if six of the links are to the same passage in the Encyclopedia of Cryptography and Security who is going to worry about that when we see the results from doing the same search in the conventional databases? Here\u2019s what we find –<\/p>\n Scopus 12 Game over. No brainer. Google Scholar is hands-down winner. Choose your clich\u00e9. And wait, there\u2019s more. If you look at the first twenty results of our search, thirteen of the items found come with links to copies of the documents in digital repositories<\/p>\n What this means is that those thirteen articles are directly available to any Internet user regardless of whether or not they have access to a subscribed (aka paywalled) copy<\/strong>. In terms of Open Access and Information Democracy this is huge, and it is difficult to imagine that documents in repositories would get a fraction of the use that they do without this sort of exposure. Four cheers for Google Scholar.<\/p>\n So what\u2019s the downside? Nothing can be that good, right? Right. In the results our search above, you may have noticed that nothing on the first page of results was more recent than 2011, and the top hits were relatively old for such a hot topic. This is because the sorting algorithm favours highly cited items which tend to be older ones – as I said last week, it takes time to get cited – and you need to limit your results to recent years to be looking at the the latest work. Of the nine articles from 2013 none appears before the third page of results. This is fine if you know that you have to apply the date limit, but many students will not know to do this, not to mention members of the general public. And then get this – our search of Scopus tuned up the following 2012 paper from Communications in Computer and Information Science<\/em> – \u201cJAM: Mitigating jellyfish attacks in wireless ad hoc networks\u201d but even with both our keyword phrases in the title it didn\u2019t show up in the list of 150 results on GS, at least not today, 13 September 2013. So phooey to Google Scholar too, sometimes you just can\u2019t trust it.<\/p>\n Actually none of this is very new and, love GS or hate it, we have learned to live with it and profit from the experience. I wrote an article expressing qualified support back in 2006 – Examining the claims of Google Scholar as a serious information source<\/a> – and the other day someone asked me if I still stood by the opinions I expressed then. I do, and looking back at it I\u2019m surprised at how little GS has changed. At the time, though, opinions were quite strongly divided, with many in the library profession arguing against its appearance on library websites alongside \u201cproper\u201d databases, and it seemed to be necessary to speak out in support of its use as a practical information discovery tool. Over time new functionality has been added, obviously in response from users wanting GS to behave more like a database, and one of the first was the facility to create records for EndNote, RefMan and BibTex from GS data. This works pretty well, but only operates on one record at a time and records don\u2019t include abstracts or keywords – it is not a database, so that sort of data isn\u2019t really present – and users have to be warned to check records to ensure that the authors don\u2019t turn out to be Meningococcal Disease and Oral Vaccination. But, as I said, GS is cheap (free actually) and cheerful and a little wild inaccuracy is all part of the fun.<\/p>\n What has changed since 2006 is the world, or more precisely that part of the world impacted by the growth of research evaluation and bibliometric analysis of research outputs . Major evaluation exercises have been undertaken in The United Kingdom, Australia and New Zealand, and while the United States does not have the same centralised funding system, citation counts and the h-index<\/a> are routinely used in hiring and tenure decisions. The good folks at Google Scholar (hi there!) don\u2019t venture out much to consult or explain, but they obviously take careful note of what is going on and the fact that their citation counts were routinely higher than those found in Web of Science and Scopus was clearly attractive to many scholars. Unless you are playing golf, a larger number is somehow much more satisfying than a smaller one, and GS nearly always has the advantage there; its spider has access to all of the major digital journal collections covered by WoS and Scopus, and as well as this GS covers the mass of worthwhile smaller titles like New Zealand Studies in Applied Linguistics<\/em> and He Pukenga Korero<\/em> that are overlooked by the big databases. So, all good. If you want to know who cited your work then look on Google Scholar; give or take the odd botch-up you will find not only all the citing journal articles, but the theses and reports that had mentioned it as well, plus a number of books. The latter can be topped up by a visit to Google Books and then you have a really rich picture of the influence of a publication, much more nuanced and informative than simply knowing that Journal Article A was cited by Journal Articles B through X between the years Y and Z. Knowing that it has been cited in government or NGO reports, for example, could indicate that a piece of research has informed policy and helped bring about change, while its appearance in books could be a sign of the wider dispersal of its ideas. Brilliant.<\/p>\n Okay, not so fast. Remember that I said that Google Scholar was a search engine, created by a spider, rather than a database with a clear structure and conforming to clearly understood principles of inclusion and exclusion. (Most of the time<\/a>.) Well, this is where things begin to get murky because GS does a thorough job of dredging that part of the web which it designates scholarly and its scoop really does capture everything, oysters and pearls, yes, but also old boots and the supermarket trolley some students tried to use as a boat. I exaggerate of course, but the difficulty lies in defining what we might count as a citation. By more or less inventing the notion of citation counting, the Institute of Scientific Information under Eugene Garfield (now Thomson Reuters Web of Science) put in place a de facto definition that it was citation in a peer-reviewed journal that counted – i.e. that literally contributed to the count – and for many years that was more or less our understanding too, partly because we had no alternative and partly because it made some sort of sense. A citation in a peer-reviewed journal was a real pat on the back, not just a pat on the back from your friend Johnny or from your cousin\u2019s girlfriend but a pat on the back from one of the teachers. Awesome! However, by extending this little sign of approval (and it usually is<\/em> approval) from the boring old peer-reviewed sources to include working papers of uncertain status, draft documents that are themselves titled \u201cNot For Citation<\/a>\u201d, reports of uncertain origin, undergraduate student essays, PowerPoints and just plain old Word documents sitting there on the web for reasons no one can remember, then we inevitably change the meaning of the number that is returned. I\u2019m not saying that they don\u2019t have a meaning – it\u2019s always nice to be noticed – but in many cases this meaning may be more like an altmetrics number than what has been traditionally defined as bibliometrics. And yes, I do know that the world moves on, but as it moves on it changes and part of our task as a community of librarians and scholars is to notice these changes and to think clearly about their meaning.<\/p>\n This is the point at which I say that there is a darker side to all of this. There is a darker side to all of this. If it is possible for clever people to game the databases by \u201ccitation stacking<\/a>\u201d then Google Scholar really is an unlocked door with no one at home. I draw your attention to a forthcoming paper in the Journal of the American Society for Information Science and Technology<\/em> by L\u00f3pez-C\u00f3zar, Robinson-Garcia and Torres-Salinas. Titled \u201cThe Google Scholar Experiment: how to index false papers and manipulate bibliometric indicators<\/a>\u201d it\u2019s about the ease with which citations can be dumped onto GS in order to inflate an individual h-index. I\u2019m not saying for sure that we are going to be deluged by a flood of academic spam, but where there\u2019s a way there\u2019s almost certainly some scallywag out there with a will, so it won\u2019t be for want of trying.<\/p>\n So, am I saying that you should simply stay away from Google Scholar when trying to evaluate the influence of your research? Hell no! If you don\u2019t keep track of GS citations you will miss out on a lot of pats on the back and also some important evidence of how your work has been received. One thing published scholars can do, and really should do, is to register with Google Scholar Citations<\/a> and \u201cclaim\u201d their publications and make this public. I have done this<\/a> and while it inflates my citation counts and credits me with an h-index, that\u2019s just fine by me – as long as I don\u2019t go around bragging about it to anyone who might know better. It also does another couple of things which are useful – sending me alerts when any of the works are cited (I can tell you now that that is a rare and happy event) and creating for me a GS portfolio that links any of the works that someone might find to all of the others. In the example below, because the document in question is linked to my GS Citations profile my name is underlined, which means anyone clicking on it will link through to the portfolio with all the other stuff. I actually think that this portfolio approach is much more important than any number, especially as the number is currently subject to significant \u201cgrade inflation\u201d.<\/p>\n So here in a nutshell is what I\u2019m saying. Google Scholar good to great. Google Scholar Citations – really interesting but use with care. But anything purely metric, like the egregiously-named Publish or Perish<\/em> (a piece of software that turns GS data into fancy-looking metrics) or Google Scholar Metrics<\/a> is best avoided by anyone with a concern for the meaning and validity of numbers in the evaluation of scholarly influence. And that\u2019s all for now. As usual tweet, retweet, and if anyone wants to spend the weekend doubling my h-index that\u2019s good too*.<\/p>\n<\/a><\/p>\n
\nWeb of Knowledge 6
\nACM Digital Library 5
\nIEEE Xplore 3 (25 if you do a full-text search)<\/p>\n<\/a><\/p>\n<\/a><\/p>\n