Tag Archives: ukcorr

Results of the Sherpa FACT accuracy testing – 95% accurate

UKCoRR welcomes the results of a  recent exercise – undertaken by UK librarians, repository managers and Sherpa Services – that has shown that the results produced by SHERPA/FACT (Funders & Authors Compliance Tool) have an accuracy rate of over 95%

The FACT service was developed to help researchers get a simple answer to the question “does this journal have an open access publishing policy compliant with my funder’s open access mandate?”. The FACT service – which draws its information from the SHERPA/ROMEO and SHERPA/JULIET databases – seeks to provide a yes/no answer to this question, as well as providing information about how an author can comply with a funder policy.

There had been some discussion at the SHERPA/FACT Advisory Board, raised by UKCoRR members and their institutions – as to whether the information provided by FACT was accurate.

To address this issue an exercise was undertaken – by members of UKCoRR – to manually check a statistically significant number of journal/funder combinations and then compare the information this group had found with the information provided by FACT. Where the independent reviewers arrived at a different conclusion to that provided by FACT, then that journal/publisher combination was subjected to detailed and exhaustive investigation to arrive at an evidenced answer.

At the end of this exercise, it was found that the FACT service provides correct information in over 95% of cases.

The study clearly highlighted the difficulties that even highly experienced repository staff have at deciphering publisher OA policies. Indeed, the initial testing undertaken by UKCoRR members suggested that FACT was only accurate on 57% of occasions. When these journal/funder combinations were investigated further, however, close examination of the often complex conditions and the interactions between different statements and policies showed that FACT was correct in almost all of the cases.

The SHERPA/FACT team as well as the SHERPA/FACT Advisory Group would like to extend their thanks to the UKCoRR Members who took part in this checking process for their time commitment as well as their extensive knowledge of this area of work. This exercise has proved that the SHERPA/FACT service can be relied upon as a source of advice for UK researchers. UKCoRR also encourages it’s members to continue to communicate with SHERPA/FACT where discrepancies are found to continue to improve the quality of the information SHERPA/FACT relies upon.

Issues of interpretation and the interaction between the various policies have been seen to be the key to the discrepancy between our manually checked results and Sherpa’s findings. There is further work to be done here and UKCoRR looks forward to continuing to work with the SHERPA/FACT Advisory Group to develop increased clarity in this area.

To see the full data and study methodology, visit Figshare.

The study was commissioned by the SHERPA/FACT Advisory Board – which includes representatives from UKCoRR, Jisc, Wellcome Trust, Research Councils UK (RCUK), CRC Nottingham, Association of Learned & Professional Society Publishers (ALPSP), Higher Education Funding Council for England (HEFCE), Publishers Association and SCONUL.

A blog post from Jisc on this project is available as well as a press release on the project.

Tagged , , , , , , ,

Decision trees for RCUK OA compliance

These are some examples of decision trees that have been developed at UK HEIs to help inform academic staff how to make their work OA (particularly in respect to RCUK compliance) – the Oxford example is notable in that it starts from the standpoint of Green rather than Gold, in contrast to the Department of Business, Innovation and Skills own decision tree at http://www.publications.parliament.uk/pa/ld201213/ldselect/ldsctech/122/12206.htm

If you know of any more please comment below or tweet @ukcorr

University of Oxford – http://openaccess.ox.ac.uk/decision-tree/
University of York – http://www.york.ac.uk/library/informationfor/researchers/openaccess/guide/
University College London (UCL) – http://www.ucl.ac.uk/library/publications/MRC-flowchart.pdf
University of Edinburgh – http://www.ed.ac.uk/schools-departments/information-services/services/research-support/publish-research/open-access/how-to-guides
University of Exeter – http://as.exeter.ac.uk/media/level1/academicserviceswebsite/library/documents/openaccess/General_Open_Access_publishing_workflow_Jan13.pdf
University of Manchester – http://www.openaccess.manchester.ac.uk/showmehow/

Tagged ,

Could the so-called Gold Rush actually result in Green reinforcement?

This is a guest post by Pablo de Castro, UK RepositoryNet+ Consultant.

Please do also take the time to complete the RepNet survey at http://ukcorr.org/events/future-events/teesside-university-friday-9th-november-2012/repnet_survey/


Much has been said in recent months about the Gold Rush and the financial unsustainability of a given way of planning the transition to research output dissemination through Gold Open Access publishing models. However, the ‘Gold Rush’ may be better than no rush whatsoever, and the post-Finch emphasis on Gold OA models has resulted in the profile of colour-agnostic Open Access getting significantly raised among Research Committees at HEIs following effective communication efforts by Institutional Repository (IR) managers and University Libraries. Furthermore, the current analysis on potential Open Access policy compliance mechanisms could well result in a substantial wave of supporting policies at institutions towards IRs and Green Open Access.

All these issues were discussed last Tuesday Dec 4th at the RSP webinar ‘The Role of Institutional Repositories after the Finch Report’. Three prominent IR managers -Sally Rumsey, U Oxford, Dominic Tate, Royal Holloway U London (RHUL) and Miggie Pickton, U of Northampton- were delivering presentations on the present state of IR/Open Access awareness and the role IRs will play for policy compliance purposes at their universities.

oxford_reaction_to_OA_policy (2)

Each of them provided a very useful specific insight on the point discussions are right now at their institutions: research-intensive U Oxford (80k publications/year) has set up an OA@Oxford Programme lead by the Bodleian Libraries and involving Research Services, IT Services and Academic Divisions. The programme comprises ten projects, three of which are focused on the Oxford Research Archive (ORA) IR (see Sally Rumsey’s presentation to learn more). Royal Holloway Research Online manager and his Library Director presented a brief and solid report to their Research Committee last September on the current state of OA policies which was praised by the Committee and has lead the way to subsequent discussions on possible ways to deliver compliance – Dominic Tate incidentally made an offer to share this report with other IR managers interested in carrying out their own awareness raising activities for their Research Committees. Finally, Miggie Pickton mentioned her calculation of the costs attached to Gold Open Access publishing of the U Northampton yearly research output as an input to the University Research and Enterprise Committee.

All three IR managers agreed that there were big opportunities for IRs as a result of the endorsement for Open Access delivered by the Finch report, regardless of what the recommended form was for realising it. As a result of the Finch report and the subsequent RCUK Open Access policy, scholars and institutional administrators now need to be aware of what Open Access is and what the requirements will be for universities in order to be eligible for receiving RCUK funding. Central Open Access publishing funds -such as the one already available at the University of Nottingham – are currently under consideration at many HEIs as a mechanism for effectively dealing with RCUK block grants and other funders’ requirements in terms of Open Access publishing. This discussion may very much reinforce the role IR managers and Libraries play in conveying the Open Access agenda to institutions, since no-one knows better about Open Access than they do. Preliminary Gold Open Access publishing cost analysis provided by IR managers to their Research Committees in the course of this discussions have resulted in Institutional Repositories being brought into consideration as a much cheaper, already available option for delivering compliance at institutional level.

IRs are however unevenly placed to take advantage of these opportunities: many of them are presently very poorly populated and feature large rates of metadata-only items. In order to be able to stand up to the requirements in terms of monitoring policy compliance, IRs will need to offer institutions a reliable set of functionalities for tracking Open Access outputs (and eventually payments, see the recently released RIN/OAIG report on the issue). This is what the UK RepositoryNet+ (aka RepNet) Project is working for: to provide the means to extend already existing IR tools and services to the whole IR network and to promote the implementation and use of new repository functionalities that allow IRs to become central pieces in the institutional research information management (RIM) services.

After the project presentations delivered a few weeks ago at the UKCoRR membership meeting at Teeside University, the RepNet put out a survey for collecting information from IR managers on the current state of service tool awareness and availability at IRs. The results of this survey -which account for over 20 answers so far- will shortly be disseminated from this UKCoRR blog. One of the questions in this survey deals with available RIM infrastructure at institutions, since we consider there is a pressing need for having an accurate landscape of CRIS/IR availability at HEIs in order to avoid effort duplication in building reporting tools. A preliminary RepNet note is already available examining use cases for RIM infrastructure configurations at HEIS, from IR-only and IR-as-CRIS to CRIS-only and CRIS-as-IR case studies through all possible ways of system co-existence. Once this CRIS/IR directory is complete, it will be made available by the RepNet and we hope it will be useful for building models on top of it, be it for REF reporting or now also for delivering OA compliance and reporting about it.

An overview of the different strategies for supporting and enhancing IRs the RepNet is working on will be delivered at the joint RepNet/RSP WS to be held in London next Jan 21st. After useful discussions last November at Teesside University, the RepNet will again be eager to promote discussion and to collect feedback and suggestions from the wider IR manager community.

Tagged , , , , ,

EPrints REF2014 plugin

Natalia Madjarevic from the London School of Economics describes the experience of installing the EPrints REF2014 plugin in LSE Research Online.

My presentation at the UKCoRR annual meeting focussed on our experience of installing the EPrints REF2014 plugin in LSE Research Online. The repository will be the main source of bibliographic data for the Research Excellence Framework (REF) in 2014 and the plugin has enabled us to make use of the high quality bibliographic records for reporting publications information to HEFCE for the REF. Reusing bibliographic information in this way has provided a clear extension of the services LSE Research Online (LSERO) offers and, without a CRIS with an active publications module, enabled us to do so without needing to build a bespoke in-house solution to pull out publications reports in the REF format.
Our road to the installation of the EPrints REF2014 plugin was a slightly winding one, with an untraditional implementation set-up – we have the plugin installed on a separate instance of LSERO due to confidential information held within it. It’s now fully installed and running on the latest version, v1.2.2. In the video below I give a background to the repository set-up at LSE, describe our preparations for installation and reflect on the entire process so far:

As I explain in my presentation, we have now added details of our REF selections (REF2) and staff details (REF1) to the REF2014 plugin. We have also exported the full details of a Unit of Assessment in Excel format (converted from the CSV plugin report) and imported this successfully to the REF2014 test submission system. Reports are also available in XML format. This was a relatively straightforward process and the tweaks to reports on v1.2.2 helped tidy up previous bugs. As data in the plugin changes, we can simply re-upload files to the REF2014 submission system and this updates existing data. We’re also using the plugin REF2 reports functionality to check for missing metadata fields.

During the entire process, the repository community, EPrints team and REF submission system support have been helpful in sharing experiences and offering technical advice. If you are considering using the EPrints plugin, I’d recommend keeping an eye on the EPrints REF2014 Plugin Releases Changelog and signing up to the mailing list: EPRINTSREF@JISCMAIL.AC.UK. There’s also a User Guide, which is useful for initial set-up and instructions on creating benchmarks and assigning user privileges.

The slides from my presentation are available here – http://ukcorr.org/files/2012/11/REF-Preparations-LSE-UKCORR.pdf. The next steps for us in the REF2014 process will be continuing to update publications information, complete the metadata clean-up process and considering when to make the final transition from the plugin to using the REF submission system.

Tagged ,

Living in Interesting Times?

After a busy year that has included the Finch report and a new policy from RCUK, UKCoRR Chair Yvonne Budden delivers the opening presentation of the annual meeting at Teesside University on 9th November 2012.

Tagged ,