EBL 101

Research Methods: Scoping Studies

Virginia Wilson

Director, Centre for Evidence Based Library and Information Practice (C-EBLIP)

University Library

University of Saskatchewan

Saskatoon, Saskatchewan, Canada

Received: 2 Nov. 2014 Accepted: 16 Nov. 2014

2014 Wilson. This is an Open Access article distributed under the terms of the Creative Commons-Attribution-Noncommercial-Share Alike License 4.0 International (http://creativecommons.org/licenses/by-nc-sa/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly attributed, not used for commercial purposes, and, if transformed, the resulting work is redistributed under the same or similar license to this one.

This time around, I’m going to take a look at scoping studies or scoping reviews. A scoping study consists of a fairly comprehensive search of the literature around a particular topic. When I came across this methodology, my first question was, “how are these different from systematic reviews?” which I’ve written about previously (Wilson, 2013). As I looked deeper, I’ve discovered that a scoping study seems to sit somewhere between a literature review and a systematic review and is “one method among many that might be used to review literature” (Arksey & O’Malley, 2005, p. 20). This column will provide an overview of the scoping study methodology, some further reading on the subject, and some citations of examples of scoping studies in library and information studies.

But what exactly is a scoping study? A number of definitions have been put forward and several have been collected in a paper by Levac, Colquhoun, and O’Brien (2010). For this column, I’m going to use the definition quoted by Arskey and O’Malley (2005): A scoping study aims “to map rapidly the key concepts underpinning a research area and the main sources and types of evidence available” (Mays, Roberts & Popay, 2001). Levac, Colquhoun, and O’Brien (2010) also include a definition from the Canadian Institutes of Health Research which states that scoping studies “are exploratory projects that systematically map the literature available on a topic, identifying the key concepts, theories, sources of evidence and gaps in the research” and are often “preliminary to full syntheses” (p. 2 of 9). The name of this methodology has been a bit confusing, as it has been referred to as “scoping study”, “scoping review”, “scoping literature review”, and “scoping exercise” in various studies. Perhaps its relative newness as a defined methodology means that standard terminology has yet to be adopted.

Table 1

Adapted from Arksey & O’Malley (2005) and Grant & Booth (2009)

Systematic Reviews	Scoping Studies
· focus on a well-defined research question	· address broader topics
· specific study designs can be identified prior to searching based on the question	· different study designs may be applicable and included
· attempt to provide answers from a narrow range of “quality assessed studies” (Arksey & O’Malley, p. 20)	· less likely to assess quality of studies included
· the goal is thorough, comprehensive searching	· how complete the searching is depends on time and scope constraints

In order to illustrate how a scoping study differs from a systematic review, I have put together a table (Table 1).

The literature outlining and advancing the methodology of scoping studies is fairly recent. Arksey and O’Malley (2005) presented a framework that they adopted for the undertaking of a scoping study (p.22), to which I have added clarifying points:

Stage 1: identifying the research question – this guides the development of search strategies

Stage 2: identifying relevant studies – the depth of this often depends of time and budget constraints

Stage 3: study selection – some search results will not be applicable to the research question

Stage 4: charting the data – material is sorted according to key issues and themes

Stage 5: collating, summarizing and reporting the results

An optional, although strongly recommended, Stage 6 was also proposed, consisting of a consultation exercise “to inform and validate findings from the main scoping review” (p. 23). Levac et al (2010) also recommend incorporating this stage, as it “adds methodological rigor and should be considered a required component” (p. 7 of 9). Stage 6 involves consultations with stakeholders who may be able to “provide additional references about potential studies to include in the review as well as valuable insights” about other issues pertinent to the review (Arksey & O’Malley, 2005, p. 29). In 2013, Daudt, van Mossel, and Scott published an article further enhancing the methodology from the perspective of a large, inter-professional team’s experience using the original Arksey and O’Malley steps. They too agree that Stage 6 should be a fully incorporated rather than optional step.

Why might one conduct a scoping study? Arskey & O’Malley (2005) offer up four reasons:

1. To examine the extent, range and nature of research activity... [and when] mapping fields of study

2. To determine the value of undertaking a full systematic review...

3. To summarize and disseminate research findings...

4. To identify research gaps in the existing literature... (pp. 21-22)

A scoping study is a viable and useful methodology for a rapid scan of literature on a specific topic. I strongly recommend delving into the papers that I have consulted for this column; these are listed in the reference list. And, if you do conduct a scoping study, you might consider contributing your own experience to the literature as well. To get a broad overview of the many review strategies you might explore, check out the article by Grant and Booth (2009).

The following are some examples of the scoping study methodology used in library and information studies.

· Baxter, G. J. & Connolly, T.M. (2014). Implementing Web 2.0 tools in organisations: Feasibility of a systematic approach. The Learning Organization, 21(1), 6-25. http://dx.doi.org/10.1108/TLO11-2012-0069

· Gardois, P., Colombi, N., Grillo, G., & Villanacci, M.C. (2012). Implementation of Web 2.0 services in academic, medical and research libraries: A scoping review. Health Information and Libraries Journal, 29, 90-109. http://dx.doi.org/10.1111/j.1471-1842.2012.00984.x

· Norwood, J. & Skinner, B. (2012). Implementing RFID in a hospital library: A scoping study. Health Information and Libraries Journal, 29(2), 162-165. http://dx.doi.org/10.1111/j.1471-1842.2012.00987.x

· Younger, P. (2010). Internet-based information-seeking behaviour amongst doctors and nurses: A short review of the literature. Health Information and Libraries Journal, 27(1), 2-10. http://dx.doi.org/10.1111/j.1471-1842.2010.00883.x

References

Arksey, H. and O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodologies, 8(1), 19-32. http://dx.doi.org/10.1080/1364557032000119616

Daudt, H. M. L., van Mossel, C., & Scott, S. J. (2013). Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Medical Research Methodology, 13(48). http://dx.doi.org/10.1186/1471-2288-13-48

Grant, M. J. & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26, 91-108. http://dx.doi.org/10.1111/j.1471-1842.2009.00848.x

Levac, D., Colquhoun, H., & O’Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5(69). http://dx.doi.org/10.1186/1748-5908-5-69

Mays. N., Roberts, E., Popay, J. (2001). Synthesizing research evidence. In: Fulup, N., Allend, P., Clarke, A., Black, N. (Eds). Studying the Organisation and Delivery of Health Services: Research Methods (pp.188-220). London: Routledge.

Wilson, V. (2013). Research Methods: Systematic Reviews. Evidence Based Library And Information Practice, 8(3), 83-84. Retrieved from http://ejournals.library.ualberta.ca/index.php/EBLIP/article/view/20437/15740