A Template-Driven Platform for Contextualised Researcher Profiles

Dionysis Diamantis; Kleanthis Vichos; Paris Koloveas; Serafeim Chatzopoulos; Thanasis Vergoulis

arxiv: 2605.14722 · v1 · pith:2TE5V3X6new · submitted 2026-05-14 · 💻 cs.DL

A Template-Driven Platform for Contextualised Researcher Profiles

Serafeim Chatzopoulos , Paris Koloveas , Kleanthis Vichos , Dionysis Diamantis , Thanasis Vergoulis This is my paper

Pith reviewed 2026-06-30 19:39 UTC · model grok-4.3

classification 💻 cs.DL

keywords researcher profilestemplate-driven profilingcontextualized profilesresearch assessmentdiverse research outputscontribution rolesprofiling platforms

0 comments

The pith

A template-driven platform lets researchers build profiles that reflect diverse outputs and roles beyond traditional publications.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Modern research involves many activities besides publishing papers, including different contribution roles and varied outputs that responsible assessment initiatives now recognize. Existing profiling systems stay centered on publications and their metrics, which limits how fully careers can be shown in different contexts. This paper presents a platform that uses customizable templates to let researchers create tailored profiles suited to specific presentation or assessment needs. The templates come in track-based, narrative-style, or hybrid forms that capture broader activities. The approach also lets assessment experts design and test new template designs.

Core claim

The paper claims that a template-driven platform supports flexible researcher profiling by allowing the creation of context-specific profiles through track-based, narrative-style, or hybrid templates, which in turn enable the representation of diverse outputs, contribution roles, and broader research activities that publication-centric systems overlook.

What carries the argument

The template-driven approach using track-based, narrative-style, or hybrid templates that organize and display research contributions for different contexts.

If this is right

Researchers gain the ability to represent non-publication outputs and varied roles in profiles tailored to specific needs.
Research assessment experts can design, deploy, and evaluate experimental templates for different evaluation purposes.
Profiles become adaptable across presentation contexts rather than fixed to a single publication-centric format.
Broader research activities receive structured representation that aligns with evolving assessment guidelines.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

Such templates could reduce reliance on single metrics when researchers apply for positions or funding by making other contributions visible by default.
The platform might encourage standardization of how impact or service roles are documented across institutions if templates are widely shared.
Integration with data sources could allow partial automation of populating template sections from existing records.

Load-bearing premise

A template-driven platform will be adopted and will meaningfully improve upon the limitations of publication-focused profiling systems when used in practice.

What would settle it

A study showing that researchers and assessors continue to default to publication lists and standard metrics even when template-based profiles are available and promoted.

Figures

Figures reproduced from arXiv: 2605.14722 by Dionysis Diamantis, Kleanthis Vichos, Paris Koloveas, Serafeim Chatzopoulos, Thanasis Vergoulis.

**Figure 1.** Figure 1: Example profile based on the “Informative Profile” template of BIP! Scholar. builds upon open scholarly knowledge graphs, such as the OpenAIRE Graph [7]. Its key features are elaborated in the following sections. 2.1 Creation, management, and sharing of researcher profiles BIP! Scholar enables researchers to create, manage, and share profiles tailored to different presentation and assessment contexts throu… view at source ↗

**Figure 2.** Figure 2: BIP! Scholar template editor interface. research topic or access license. This allows profiles to adapt to different exploration and assessment needs. For example, [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

**Figure 3.** Figure 3: Overview of the BIP! Scholar architecture. functionalities related to template validation, including feedback collection and usage analytics generation to support template evaluation and refinement. The Indicators Calculator component is responsible for computing a variety of researcher-level indicators including output counts (e.g., number of publications), aggregated impact indicators (e.g., based on th… view at source ↗

read the original abstract

Modern researchers engage in diverse activities, assume multiple contribution roles, and produce a variety of outputs beyond traditional publications. This broader view of research contributions is increasingly recognised by responsible research assessment initiatives. However, existing researcher profiling platforms remain largely focused on publications and publication-centric indicators, offering limited support for contextualised and multi-dimensional representations of research careers. This paper presents BIP! Scholar, a platform that supports flexible researcher profiling through a template-driven approach. Researchers can create profiles tailored to different presentation or assessment contexts using track-based, narrative-style, or hybrid templates which support the representation of diverse outputs, contribution roles, and broader research activities. The platform also supports research assessment experts who wish to design and evaluate experimental profile templates.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

BIP! Scholar describes a template system for richer researcher profiles but offers no evidence it performs better than existing tools.

read the letter

The main takeaway is that this paper outlines a platform called BIP! Scholar for building contextual researcher profiles via templates, yet it stops at the design stage with nothing to show the approach delivers on its goals.

The work is clear on the mechanics. It explains three template styles—track-based, narrative, and hybrid—that let users record diverse outputs, contribution roles, and non-publication activities. The platform also includes support for assessment experts to create and test their own templates. This matches the stated need for profiles that go beyond publication counts, and the architecture description is consistent.

What stands out is the practical focus on different use contexts, such as tailoring a profile for a specific evaluation. The motivation section ties the design to responsible research assessment discussions, which is reasonable.

The soft spot is the lack of any testing. There are no user studies, adoption figures, comparative benchmarks against systems like ORCID, or even small-scale examples showing that these templates produce profiles assessors find more useful. The claim that the templates overcome publication-centric limits therefore rests on the description alone.

This paper suits readers who work on research information systems or responsible assessment tools. Someone looking for concrete design patterns in that area could extract ideas from the template types.

It deserves a serious referee. The description is detailed enough for technical review, and the problem it targets is current. I would send it to peer review but flag that the next version needs at least a case study or pilot data to move the contribution beyond a system sketch.

Referee Report

1 major / 0 minor

Summary. The paper presents BIP! Scholar, a platform that supports flexible researcher profiling through a template-driven approach. Researchers can create profiles tailored to different presentation or assessment contexts using track-based, narrative-style, or hybrid templates which support the representation of diverse outputs, contribution roles, and broader research activities. The platform also supports research assessment experts who wish to design and evaluate experimental profile templates.

Significance. If the platform functions as described, the template-driven design offers a concrete architecture for moving beyond publication-centric profiles in alignment with responsible research assessment initiatives. The contribution lies in the system description itself, which is internally consistent, but the absence of any validation data means demonstrated significance remains limited to the proposed approach rather than proven outcomes.

major comments (1)

[Abstract] Abstract: The claim that the platform enables 'contextualised and multi-dimensional representations of research careers' that address the 'limited support' in existing systems is presented without any supporting user studies, adoption metrics, comparative evaluations, or implementation details demonstrating effectiveness in practice.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the feedback. We address the single major comment below. The manuscript is a system description of the BIP! Scholar platform design.

read point-by-point responses

Referee: [Abstract] Abstract: The claim that the platform enables 'contextualised and multi-dimensional representations of research careers' that address the 'limited support' in existing systems is presented without any supporting user studies, adoption metrics, comparative evaluations, or implementation details demonstrating effectiveness in practice.

Authors: We agree that the paper contains no user studies, adoption metrics, or comparative evaluations, as it is a system description focused on the platform architecture rather than an empirical evaluation. The abstract describes the supported capabilities of the template-driven design (track-based, narrative-style, and hybrid templates for diverse outputs, roles, and activities). To address the concern, we will revise the abstract to state that the platform offers mechanisms intended to support such representations, without implying demonstrated effectiveness or outcomes. This revision will be incorporated. revision: yes

Circularity Check

0 steps flagged

No circularity: descriptive platform paper with no derivations or fitted claims

full rationale

The manuscript is a system description of BIP! Scholar. It presents architecture, template types (track-based, narrative, hybrid), and intended use cases but contains no equations, no parameter fitting, no predictions derived from data, and no load-bearing self-citations or uniqueness theorems. The central claim is simply that the described templates support contextualised profiles; this is an assertion of design, not a reduction of any output to its own inputs. No steps meet any of the enumerated circularity patterns.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

No mathematical claims, empirical results, or derivations; the paper is a descriptive account of a software platform. No free parameters, axioms, or invented entities are invoked.

pith-pipeline@v0.9.1-grok · 5659 in / 972 out tokens · 22083 ms · 2026-06-30T19:39:45.444386+00:00 · methodology

discussion (0)

Reference graph

Works this paper leans on

11 extracted references · 4 canonical work pages · 1 internal anchor

[1]

American Society for Cell Biology: San Francisco declaration on research assess- ment (DORA) (2012)

2012
[2]

Learned Publishing 28(2), 151–155 (2015)

Brand, A., Allen, L., Altman, M., Hlava, M., Scott, J.: Beyond authorship: attri- bution, contribution, collaboration, and credit. Learned Publishing 28(2), 151–155 (2015). https://doi.org/10.1087/20150211

work page doi:10.1087/20150211 2015
[3]

https://coara.eu/ agreement/the-agreement-full-text/ (2022), accessed: 2025-04-24

CoARA: Agreement on Reforming Research Assessment. https://coara.eu/ agreement/the-agreement-full-text/ (2022), accessed: 2025-04-24

2022
[4]

Derrick, G.E., Hettrick, S., Baker, J., Karoune, E., Kerridge, S., Fletcher, G., Chue Hong, N., Ballantyne, L., Fransmann, J., Roche, T.: Shaping the future of research evaluation: Insights from the festival of hidden REF (Apr 2024)

2024
[5]

https://doi.org/https://doi.org/10.31222/osf.io/praxg_v1

Farrell, G., Alloza, E., Bouhraoua, A., Capella-Gutierrez, S., Goble, C., Hermjakob, H., Smith, A., Suﬁ, S., Vergoulis, T., Zoubiri, M., Quaglia, F., Tosatto, S.C.E.: Credit, recognition, and reward for non-traditional research artefacts in the life sciences (2026). https://doi.org/https://doi.org/10.31222/osf.io/praxg_v1

work page doi:10.31222/osf.io/praxg_v1 2026
[6]

Learned publishing 25(4), 259–264 (2012)

Haak, L.L., Fenner, M., Paglione, L., Pentz, E., Ratner, H.: ORCID: a system to uniquely identify researchers. Learned publishing 25(4), 259–264 (2012)

2012
[7]

https://doi.org/10.5281/zenodo.7488618

Manghi, P., Atzori, C., Bardi, A., Baglioni, M., Schirrwagen, J., Dimitropoulos, H., La Bruzzo, S., Foufoulas, I., Mannocci, A., Horst, M., Czerniak, A., Iatropoulou, K., Kokogiannaki, A., De Bonis, M., Artini, M., Lempesis, A., Ioannidis, A., Manola, N., Principe, P., Vergoulis, T., Chatzopoulos, S., Pierrakos, D.: OpenAIRE Research Graph Dataset (Dec 20...

work page doi:10.5281/zenodo.7488618 2022
[8]

PLoS Biol

Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M.H., Barbour, V., Coriat, A.M., Foeger, N., Dirnagl, U.: The hong kong principles for assessing researchers: Fostering research integrity. PLoS Biol. 18(7), e3000737 (Jul 2020)

2020
[9]

OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts

Priem, J., Piwowar, H., Orr, R.: OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv preprint arXiv:2205.01833 (2022)

work page internal anchor Pith review Pith/arXiv arXiv 2022
[10]

In: Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries

Vergoulis, T., Chatzopoulos, S., Vichos, K., Kanellos, I., Mannocci, A., Manola, N., Manghi, P.: BIP! Scholar: a service to facilitate fair researcher assessment. In: Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries. pp. 1–5 (2022)

2022
[11]

In: Companion Proceedings of the Web Conference 2021

Vergoulis, T., Kanellos, I., Atzori, C., Mannocci, A., Chatzopoulos, S., Bruzzo, S.L., Manola, N., Manghi, P.: Bip! db: A dataset of impact measures for scientiﬁc publications. In: Companion Proceedings of the Web Conference 2021. pp. 456–460 (2021)

2021

[1] [1]

American Society for Cell Biology: San Francisco declaration on research assess- ment (DORA) (2012)

2012

[2] [2]

Learned Publishing 28(2), 151–155 (2015)

Brand, A., Allen, L., Altman, M., Hlava, M., Scott, J.: Beyond authorship: attri- bution, contribution, collaboration, and credit. Learned Publishing 28(2), 151–155 (2015). https://doi.org/10.1087/20150211

work page doi:10.1087/20150211 2015

[3] [3]

https://coara.eu/ agreement/the-agreement-full-text/ (2022), accessed: 2025-04-24

CoARA: Agreement on Reforming Research Assessment. https://coara.eu/ agreement/the-agreement-full-text/ (2022), accessed: 2025-04-24

2022

[4] [4]

Derrick, G.E., Hettrick, S., Baker, J., Karoune, E., Kerridge, S., Fletcher, G., Chue Hong, N., Ballantyne, L., Fransmann, J., Roche, T.: Shaping the future of research evaluation: Insights from the festival of hidden REF (Apr 2024)

2024

[5] [5]

https://doi.org/https://doi.org/10.31222/osf.io/praxg_v1

Farrell, G., Alloza, E., Bouhraoua, A., Capella-Gutierrez, S., Goble, C., Hermjakob, H., Smith, A., Suﬁ, S., Vergoulis, T., Zoubiri, M., Quaglia, F., Tosatto, S.C.E.: Credit, recognition, and reward for non-traditional research artefacts in the life sciences (2026). https://doi.org/https://doi.org/10.31222/osf.io/praxg_v1

work page doi:10.31222/osf.io/praxg_v1 2026

[6] [6]

Learned publishing 25(4), 259–264 (2012)

Haak, L.L., Fenner, M., Paglione, L., Pentz, E., Ratner, H.: ORCID: a system to uniquely identify researchers. Learned publishing 25(4), 259–264 (2012)

2012

[7] [7]

https://doi.org/10.5281/zenodo.7488618

Manghi, P., Atzori, C., Bardi, A., Baglioni, M., Schirrwagen, J., Dimitropoulos, H., La Bruzzo, S., Foufoulas, I., Mannocci, A., Horst, M., Czerniak, A., Iatropoulou, K., Kokogiannaki, A., De Bonis, M., Artini, M., Lempesis, A., Ioannidis, A., Manola, N., Principe, P., Vergoulis, T., Chatzopoulos, S., Pierrakos, D.: OpenAIRE Research Graph Dataset (Dec 20...

work page doi:10.5281/zenodo.7488618 2022

[8] [8]

PLoS Biol

Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M.H., Barbour, V., Coriat, A.M., Foeger, N., Dirnagl, U.: The hong kong principles for assessing researchers: Fostering research integrity. PLoS Biol. 18(7), e3000737 (Jul 2020)

2020

[9] [9]

OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts

Priem, J., Piwowar, H., Orr, R.: OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv preprint arXiv:2205.01833 (2022)

work page internal anchor Pith review Pith/arXiv arXiv 2022

[10] [10]

In: Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries

Vergoulis, T., Chatzopoulos, S., Vichos, K., Kanellos, I., Mannocci, A., Manola, N., Manghi, P.: BIP! Scholar: a service to facilitate fair researcher assessment. In: Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries. pp. 1–5 (2022)

2022

[11] [11]

In: Companion Proceedings of the Web Conference 2021

Vergoulis, T., Kanellos, I., Atzori, C., Mannocci, A., Chatzopoulos, S., Bruzzo, S.L., Manola, N., Manghi, P.: Bip! db: A dataset of impact measures for scientiﬁc publications. In: Companion Proceedings of the Web Conference 2021. pp. 456–460 (2021)

2021