Skip to Main Content

Research Impact Metrics

Provides an overview of Research Impact Metrics

Non-Traditional Research Outputs (NTROs)

Non-Traditional Research Outputs (NTROs) are works that do not fall under the usual output categories of journal articles, books, book chapters, etc. These works may include;

  • Original creative works
  • Live performances or creative works
  • Recorded or rendered creative works
  • Curated or produced substantial public exhibitions and events
  • Research reports for an external body or Government
  • Portfolio of work
  • Research Datasets: Collections of data generated during research
  • Software Code: Programs or algorithms developed as part of research

 

Evaluating Non-Traditional Research Outputs (NTROs) involves several criteria and methods, often tailored to the specific type of output. Here are some common approaches:

  1. Peer Review: Similar to traditional research outputs, NTROs can be evaluated by experts in the field. This is often used for creative works, performances, and exhibitions

  2. Impact and Reach: The influence and dissemination of the NTRO are considered. This includes the reputation of the venue, gallery, or event where the work was presented, audience size, media coverage, and social media engagement

  3. Usage Metrics: For digital outputs like datasets or software, metrics such as downloads, citations, and usage statistics are important. Platforms like Altmetric and PlumX can track these metrics

  4. Qualitative Assessments: Detailed descriptions of the research's significance, innovation, and contribution to the field are often required. This might include the context of the work, its aims, and its impact on advancing knowledge

  5. Documentation and Accessibility: Ensuring that NTROs are well-documented and accessible, such as through institutional repositories, can also be a factor in their evaluation

These methods help to capture the diverse nature and impact of NTROs, ensuring they are recognised alongside more traditional research outputs.

Since NTROs (Non-Traditional Research Outputs) are not usually published in conventional ways, it's crucial to ensure your work is both discoverable and accessible. Here are some steps to help you achieve that:

  1. Create and Attach a Persistent Identifier: Consider obtaining a DOI or ISBN for your work.
  2. Update Your Profiles: Make sure your PURE, Google Scholar, and ORCID profiles are current and include your NTROs.
  3. Seek Advice: Discuss with peers and supervisors to identify the best platforms and outlets for your work.
  4. Check Copyright: Review the copyright implications of any third-party content included in your work.

The Macquarie University Research Data Repository (RDR) is an institutional platform where Macquarie University researchers can publish, showcase and share research data, other NTROs like videos, artworks or unpublished reports can be added to Pure and displayed in your staff profile. 

Key benefits of sharing your data in the Research Data Repository:

  • Enables discoverability and access to your research data online from anywhere in the world 
  • Complies with Macquarie University research data management policies, standards and codes
  • Enhances a researcher's public profile with dataset statistics and demonstrates the impact of your research
  • Contributes to new research by helping others find and reuse your data whilst enhancing your academic reputation
  • Issues a persistent citable DOI (Digital Object Identifier)
  • Allows you to apply Creative Commons or other appropriate licenses which define terms of re-use of your data
  • Complies with funder and publisher requirements to make data open
  • Participates in a quality-assured and supported data management process that complements and smoothly aligns with the research project lifecycle
  • Promotes collaboration, data sharing and discovery amongst researchers globally according to FAIR data principles

Here are some tools for tracking NTROs (Non-Traditional Research Outputs):

  • Altmetric Explorer: Tracks mentions of research publications online, including social media, media, patents, and policy documents. It allows you to browse and generate analytical reports for Macquarie authors, groups, or departments, analyse mentions of individual publications, and view any individual mention in the Altmetric database.
  • ImpactStory: Lets you create a free profile to track activity in social media, blogs, news outlets, and more.
  • MQ Research Data Repository (RDR)- FigShare: An institutional platform where Macquarie University researchers can publish, showcase and share research data. 

More information on these tools and other ways to track NTROs and research outputs, can be found here.

There are other indicators of research quality or academic esteem.   Measures of esteem may provide additional evidence of research quality and/or research capacity, to sit alongside traditional metrics. They may be relevant for competitive grant applications and academic promotions.

It is suggested that researchers keep a record of these measures listing:  activity, date, and relevance to your research. Also, Pure can be used to keep a record of esteem measures and as such be used to enhance a researcher's public profile.

Such measures include:

  • Awards and Prizes
  • Conference presentations, keynotes, and publications
  • Editorial or reviewer role for a significant journal or reference work
  • International engagement and collaboration
  • Partnerships with other institutions, research groups, or industry.
  • Previous successful grant applications and completed research projects.
  • Research Commercialisation Income
  • Research Fellowships
  • Membership of professional or academic organisations
  • Influence on government or public policy
  • Industrial advisory roles
  • Research fellowships
  • Patents or other commercial output