IIT Bombay NLP researcher linking scientometric evaluation benchmarks with LLM-driven schema–ontology mapping.
2
papers here
2
reviewed by Evolve
0
first-author
0
corresponding
—
works · OpenAlex
11
h-index · OpenAlex
Bibliometric figures come from OpenAlex (2026-10-15) and cover the author's entire public record, not just the papers listed here. Reproducibility signal comes from Evolve's own reviews.
Research profile
Output—
No output score is computed yet: this snapshot lacks the verified publication-volume totals that axis requires. Once complete, it would measure total scholarly output and its distribution across venues and years.
Impact—
Impact is not scored yet because citation-based evidence in this snapshot is insufficient for the axis. When populated, it would measure citations, citing works, and influence on follow-up research.
Focus0/100
The focus score of 0 reflects maximal breadth rather than absence of direction: the field distribution is an even 50/50 split between AI evaluation / scientometrics (NLP) and semantic web / data integration (knowledge representation with NLP). Topic data reinforces this duality — topic modeling leads with 35 items, followed by multimodal machine learning applications (15), NLP techniques (12), software engineering research (10), and information retrieval and search behavior (9).
Collaboration46/100
The collaboration score of 46 rests on 9 distinct coauthors in the underlying record. Frequent partners named in the data include Xiao Zhou, Yilun Zhao, Owen Jiang, Tiansheng Hu, Cai Xu, Arman Cohan, Siddhesh Thombre, and Sunita Sarawagi. Both cataloged 2026 papers list the researcher in a middle author position without corresponding-author responsibility, indicating participation in multi-author teams rather than solo or leading-small-group work.
Activity100/100
Activity is the strongest axis at 100: the record shows 43 works in the most recent three-year window, and annual counts climb from single digits through most of the 2010s (1 in 2010, 5 in 2016, 6 in 2018 and 2020) to 7 in 2023, 8 in 2024, then a sharp acceleration to 18 in 2025 and 17 in 2026 — the two highest years on record.
Reproducibility55/100
The reproducibility score averages 55 across the 2 papers Evolve has assessed, both carrying a medium repro-readiness label. Evolve's verdicts flag concrete reproduction constraints: BackTrend's low system scores (F1 ≤ 10.1%) may partly reflect strict matching and benchmark-construction bias, while the schema-ontology mapping paper reports strong gains across only 3 scenarios with no significance testing.
Research summary
Manasi Patwardhan is a researcher at the Indian Institute of Technology Bombay whose work spans two equally weighted directions — AI evaluation and scientometrics with NLP on one side, semantic web and data integration through knowledge representation with NLP on the other — each accounting for half of the field distribution in the underlying OpenAlex record. The topic profile is led by topic modeling (35 items), followed by multimodal machine learning applications (15), natural language processing techniques (12), software engineering research (10), and information retrieval and search behavior (9). Bibliometric aggregates include an h-index of 11 and an i10-index of 13, though impact scoring for this profile has not been finalized. Activity is the standout signal: 43 works fall in the most recent three-year window, with annual counts rising from 1 (2010) and 5 (2016) to 18 (2025) and 17 (2026). Two 2026 arXiv papers are cataloged and reviewed by Evolve: BackTrend, a validated retrospective benchmark for scientific weak-signal prediction whose low system scores (F1 ≤ 10.1%) may partly reflect strict matching and construction bias, and a study on self-demonstrations for LLM-based schema-ontology mapping reporting 0.56 average F1 on RODI, with strong gains but only 3 scenarios and no significance testing. Both papers carry medium reproducibility readiness, and the reproducibility dimension averages 55 across them.
Collaboration pattern
The record lists 9 distinct coauthors and a mid-range collaboration score of 46. Recurring partners include Xiao Zhou, Yilun Zhao, Owen Jiang, Tiansheng Hu, Cai Xu, Arman Cohan, Siddhesh Thombre, and Sunita Sarawagi, spanning both NLP evaluation and semantic-web strands. Both 2026 catalog papers place her in a middle, non-corresponding author role, consistent with contribution inside larger teams rather than sole leadership.
Research keywords
Highlights
BackTrend: a retrospective benchmark for scientific weak-signal prediction
Self-demonstrations lift LLM schema–ontology mapping
A 2026 evaluation-methodology thread across both strands
Both cataloged papers, released as 2026 arXiv preprints, share an LLM-capability evaluation core: one benchmarks deep research agents and RAG systems on scientific weak signals, the other probes in-context self-demonstrations for mapping tasks. This mirrors the 50/50 field split and the 17 works recorded for 2026.
Timeline
- 2010First year with a recorded publication in the OpenAlex-sourced counts (1 work).
- 2016Output reaches 5 works, the highest annual total of the mid-2010s.
- 20206 works published, matching the 2018 level.
- 20237 works — output edges past the 2018/2020 plateau.
- 2025Annual output jumps to 18 works, the highest year on record.
- 202617 works so far, including the two arXiv papers reviewed in the Evolve catalog (BackTrend and the self-demonstrations study).
Papers in the Evolve catalog
Frequent co-authors
About this profile
This profile is AI-structured by Evolve.Pub from public bibliographic data (OpenAlex) and Evolve's own paper reviews. It is not written or endorsed by the researcher unless the profile is claimed. Radar dimensions are computed from real bibliometrics with fixed formulas — raw figures are shown alongside; missing dimensions mean insufficient data, never zero. Errors? Claim the profile to correct or hide it.
- Bibliometrics are drawn from an OpenAlex identity resolution (ORCID 0000-0002-2775-3497); name-based ambiguity cannot be fully excluded.
- Output and impact dimensions are unscored in this snapshot; h-index and i10-index are quoted as provided but were not converted into axis scores.
- The reproducibility score (mean 55) rests on only 2 Evolve-reviewed papers, both rated medium repro-readiness.
- The frequent-coauthor list includes the researcher's own name, likely a disambiguation artifact in the source data.
