Repository navigation
feat(arxiv): list new papers from Zenodo and journals too - #15
Merged
Merged
Conversation
Much new physics never reaches arXiv: many researchers post on Zenodo, including authors without arXiv access, and journal articles and other repositories reach OpenAlex. recent_papers now also searches both when given a query (a `sources` argument selects arxiv, zenodo and openalex; a category listing stays on arXiv). * Zenodo: publications whose first version was uploaded inside the window (every version is searched and only first versions are kept, so a new version of an older upload is not listed as new), newest first. * OpenAlex: works published inside the window that are not on arXiv (arXiv is searched directly) and, when Zenodo is searched, not on Zenodo; datasets and software are left out. * Both treat bare words as OR, so a plain query searches its phrase and then all words joined by AND. * Every paper passes the same window and topic checks as arXiv papers and carries its source. Sources take turns filling the list, so a busy source cannot crowd out the others, and a title found in several sources is listed once, arXiv first. A failing source becomes a note; the call fails only when every source fails. arXiv field syntax and the arxiv-only backend search arXiv only. Zenodo requests are paced under its guest limit of 30 a minute. Checked live on 2026-09-30: "reflection positivity" over 30 days lists the arXiv paper alongside Zenodo uploads, with Figshare copies of the same work dropped as duplicates; "reflection positivity neural network" over 60 days returns nothing from any source; "neural network field theory" adds a Physical Review D article. Full suite 13048 passed with the three known environment failures.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Much new physics never reaches arXiv: many researchers post on Zenodo, including authors without arXiv access, and journal articles and other repositories reach OpenAlex.
recent_papersnow also searches both when given a query. A newsourcesargument selectsarxiv,zenodoandopenalex; a category-only listing stays on arXiv.source. Sources take turns filling the list, so a busy source cannot crowd out the others. A title found in several sources is listed once, arXiv first.arxiv-onlybackend search arXiv only. Zenodo requests are paced under its guest limit of 30 a minute.Checked live, 2026-09-30
Tests
New tests cover source merging and labels, first-version Zenodo queries, excluded arXiv and Zenodo works in OpenAlex, per-source failures, arXiv-only cases, turn-taking and duplicate titles. Full suite: 13048 passed, with the three known environment failures.
Limits