{"presentation":{"slides":[{"elements":[{"x":15.250544662309368,"y":15.053763440860214,"width":70.80610021786492,"height":10.75268817204301,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"

EDI and the Assessment of Research Excellence<\/span><\/strong><\/p>\n"},"subContentId":"9b5e71d6-54e2-4bc8-b438-95ba69641556","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":15.250544662309368,"y":62.36559139784946,"width":68.62745098039215,"height":23.65591397849462,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"

Click through the slides to read guiding principles presented in the Leiden Manifesto<\/a> and the San Francisco Declaration on Research Assessment (DORA)<\/a> surrounding EDI and metrics for assessing research excellence. <\/em><\/span><\/p>\n"},"subContentId":"305882e5-25ba-40b5-9f34-672ae2518cc6","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}},{"elements":[{"x":2.1743899782135077,"y":4.292666666666666,"width":68.62745098039215,"height":10.75268817204301,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"

Considerations When Evaluating Scholarship<\/strong><\/span><\/p>\n"},"subContentId":"7f1d427c-3c7e-41b8-add2-8ccde028c43c","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":3.2679738562091503,"y":17.204301075268816,"width":93.68191721132898,"height":77.41935483870967,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"Reasons why someone with a strong scholarly profile might be disadvantaged by evaluations of research excellence that rely on bibliometrics<\/strong>:<\/span>\n\n

\n\t
\n\tBuilding relationships needed for community-based research takes time<\/span>\n\t<\/li>\n\t
\n\tAcademic journal articles are not always the most effective, meaningful, and ethical forms of knowledge<\/span> mobilization<\/span>\n\t<\/li>\n\t
\n\tLack of access to informal mentorship and support networks for scholars from equity-deserving groups<\/span>\n\t<\/li>\n\t
\n\tBias and citation gaps<\/span>\n\t<\/li>\n\t
\n\tGeographical bias against scholars from outside Europe and North America<\/span>\n\t<\/li>\n\t
\n\tBias against non-English scholarship<\/span>\n\t<\/li>\n<\/ul>\n"},"subContentId":"9c82736c-c0bf-4e7c-8ffa-918f21639f00","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}},{"elements":[{"x":2.1743899782135077,"y":4.292666666666666,"width":33.769063180827885,"height":8.602150537634408,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
The Leiden Manifesto<\/strong><\/span><\/p>\n"},"subContentId":"8814e439-8375-4d8e-bd9d-c1941256c148","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":3.2679738562091503,"y":23.65591397849462,"width":92.5925925925926,"height":62.36559139784946,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
The <\/span><\/span>Leiden Manifesto<\/span><\/a><\/span><\/span> for research metrics offers guiding principles for how to move beyond blanket understandings of research excellence. <\/span><\/span><\/span><\/span><\/span><\/p>\n\n
Its authors note the abuse of research metrics that rely on H-indices when citation counting became popular and possible in the early 2000s with the advent of Google Scholar, Incites, SciVal, and other tools. Citation counting is often used as an easy metric for research impact, but there are pitfalls to using them exclusively. <\/span><\/span><\/span><\/span><\/span><\/p>\n\n
The next slide lists the best practices in metrics-based research assessment outlined in the Leiden Manifesto.<\/span><\/span><\/span><\/span><\/span><\/p>\n\n
<\/p>\n"},"subContentId":"c8b5b54c-216c-42c9-8580-edfc5a9495e6","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}},{"slideBackgroundSelector":{},"elements":[{"x":2.178649237472767,"y":4.301075268817204,"width":56.64488017429194,"height":8.602150537634408,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
10 Principles of the Leiden Manifesto<\/strong><\/span><\/p>\n"},"subContentId":"5ce6c5b9-9145-401c-a445-c3a9cab728d9","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":2.178649237472767,"y":12.903225806451612,"width":91.50326797385621,"height":86.02150537634408,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
\n\t
Quantitative evaluation should support qualitative, expert assessment.<\/li>\n\t
Measure Performance against the research missions of the institution, group or researcher.<\/li>\n\t
Protect excellence in locally relevant research.<\/li>\n\t
Keep data collection and analytical processes open, transparent, and simple.<\/li>\n\t
Allow those evaluated to verify data and analysis.<\/li>\n\t
Account for variation by field in publication and citation practices.<\/li>\n\t
Base assessment of individual researchers on qualitative judgement of their portfolio.<\/li>\n\t
Avoid misplaced concreteness and false precision<\/li>\n\t
Recognize the systemic effects of assessments and indicators<\/li>\n\t
Scrutinize indicators regularly and update them<\/li>\n<\/ol>\n\n
<\/p>\n"},"subContentId":"71ebfa67-36b1-4b2c-8c6f-ae2435de20ac","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}]},{"elements":[{"x":2.1743899782135077,"y":4.292666666666666,"width":87.14596949891067,"height":8.602150537634408,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
San Francisco Declaration on Research Assessment (DORA)<\/strong><\/span><\/p>\n"},"subContentId":"7e42b297-98b3-4190-bf14-0ef1422f8ef0","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":2.176525054466231,"y":15.04116129032258,"width":95.86056644880175,"height":81.72043010752688,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
Many research funding agencies and institutions, including the Tri-Council funding agencies in Canada, have adopted t<\/span><\/span><\/span><\/span><\/em>he San Francisco Declaration on Research Assessment<\/span><\/a> <\/span>(DORA). In 2012, a group of editors and publishers of scholarly journals developed a set of recommendations to improve the ways in which funding agencies, academic institutions, journals, organizations that supply metrics, individual researchers, and other parties evaluate the output of scientific research.<\/span><\/span><\/span><\/span><\/p>\n\n
The following themes run through DORA recommendations:<\/span><\/span><\/span><\/span><\/p>\n\n
\n\t
The need to eliminate the use of journal-based metrics, such as Journal Impact Factors, in funding, appointment, and promotion considerations<\/span><\/span><\/span><\/span><\/li>\n\t
The need to assess research on its own merits rather than on the basis of the journal in which the research is published<\/span><\/span><\/span><\/span><\/li>\n\t
The need to capitalize on the opportunities provided by online publication (such as relaxing unnecessary limits on the number of words, figures, and references in articles, and exploring new indicators of significance and impact)<\/span><\/span><\/span><\/span><\/li>\n<\/ul>\n"},"subContentId":"8b256577-43af-4cc2-badc-785c454c90c4","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}},{"elements":[{"x":2.178649237472767,"y":6.451612903225806,"width":95.86056644880175,"height":83.87096774193547,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
Highlights of the DORA Recommendations for Researchers<\/span><\/span><\/span><\/span><\/span><\/span><\/strong><\/span><\/p>\n\n
\n\t
When involved in committees making decisions about funding, hiring, tenure, or promotion, make assessments based on scientific content rather than publication metrics<\/span><\/span><\/span><\/span><\/li>\n\t
Wherever appropriate, cite primary literature in which observations are first reported rather than reviews in order to give credit where credit is due<\/span><\/span><\/span><\/span><\/li>\n\t
Use a range of article metrics and indicators on personal\/supporting statements, as evidence of the impact of individual published articles and other research outputs<\/span><\/span><\/span><\/span><\/li>\n\t
Challenge research assessment practices that rely inappropriately on Journal Impact Factors and promote and teach best practice that focuses on the value and influence of specific research outputs<\/span><\/span><\/span><\/span><\/li>\n<\/ul>\n\n
<\/p>\n"},"subContentId":"34ce291f-f597-41e9-80ba-e1f5aed0025e","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}},{"elements":[{"x":3.2594662309368196,"y":6.434817204301075,"width":59.912854030501094,"height":8.602150537634408,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
DORA Reccomendations for Institutions<\/span><\/strong><\/p>\n"},"subContentId":"f0fff4f3-9831-4171-a93f-a239d68be628","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""},{"x":4.348790849673203,"y":19.32963440860215,"width":91.50326797385621,"height":68.81720430107526,"action":{"library":"H5P.AdvancedText 1.1","params":{"text":"
\n\t
Be explicit about the criteria used to reach hiring, tenure, and promotion decisions, clearly highlighting, especially for early-stage investigators, that the scientific content of a paper is much more important than publication metrics or the identity of the journal in which it was published<\/span><\/span><\/span><\/span><\/li>\n\t
For the purposes of research assessment, consider the value and impact of all research outputs (including datasets and software) in addition to research publications, and consider a broad range of impact measures including qualitative indicators of research impact, such as influence on policy and practice<\/span><\/span><\/span><\/span><\/li>\n<\/ul>\n"},"subContentId":"bdd54ee3-5a09-4689-8752-e28159c3d1bb","metadata":{"contentType":"Text","license":"U","title":"Untitled Text"}},"alwaysDisplayComments":false,"backgroundOpacity":0,"displayAsButton":false,"buttonSize":"big","goToSlideType":"specified","invisible":false,"solution":""}],"slideBackgroundSelector":{}}],"keywordListEnabled":true,"globalBackgroundSelector":{"fillGlobalBackground":"#ffffff"},"keywordListAlwaysShow":false,"keywordListAutoHide":false,"keywordListOpacity":90},"override":{"activeSurface":false,"hideSummarySlide":false,"summarySlideSolutionButton":true,"summarySlideRetryButton":true,"enablePrintButton":false,"social":{"showFacebookShare":false,"facebookShare":{"url":"@currentpageurl","quote":"I scored @score out of @maxScore on a task at @currentpageurl."},"showTwitterShare":false,"twitterShare":{"statement":"I scored @score out of @maxScore on a task at @currentpageurl.","url":"@currentpageurl","hashtags":"h5p, course"},"showGoogleShare":false,"googleShareUrl":"@currentpageurl"}},"l10n":{"slide":"Slide","score":"Score","yourScore":"Your Score","maxScore":"Max Score","total":"Total","totalScore":"Total Score","showSolutions":"Show solutions","retry":"Retry","exportAnswers":"Export text","hideKeywords":"Hide sidebar navigation menu","showKeywords":"Show sidebar navigation menu","fullscreen":"Fullscreen","exitFullscreen":"Exit fullscreen","prevSlide":"Previous slide","nextSlide":"Next slide","currentSlide":"Current slide","lastSlide":"Last slide","solutionModeTitle":"Exit solution mode","solutionModeText":"Solution Mode","summaryMultipleTaskText":"Multiple tasks","scoreMessage":"You achieved:","shareFacebook":"Share on Facebook","shareTwitter":"Share on Twitter","shareGoogle":"Share on Google+","summary":"Summary","solutionsButtonTitle":"Show comments","printTitle":"Print","printIngress":"How would you like to print this presentation?","printAllSlides":"Print all slides","printCurrentSlide":"Print current slide","noTitle":"No title","accessibilitySlideNavigationExplanation":"Use left and right arrow to change slide in that direction whenever canvas is selected.","accessibilityCanvasLabel":"Presentation canvas. Use left and right arrow to move between slides.","containsNotCompleted":"@slideName contains not completed interaction","containsCompleted":"@slideName contains completed interaction","slideCount":"Slide @index of @total","containsOnlyCorrect":"@slideName only has correct answers","containsIncorrectAnswers":"@slideName has incorrect answers","shareResult":"Share Result","accessibilityTotalScore":"You got @score of @maxScore points in total","accessibilityEnteredFullscreen":"Entered fullscreen","accessibilityExitedFullscreen":"Exited fullscreen"}}

EDI in Research Excellence - Considerations

Brief Introduction