KG-access/Paper-Monitoring-SW
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: integrate Google Scholar alerts and improve paper filtering pipeline #1

Merged
KG-access merged 1 commits from feature/googlescholar into main 2026-08-20 15:29:19 +00:00
Conversation 0 Commits 1 Files Changed 8
+233 -51
KG-access commented 2026-08-20 15:29:04 +00:00
Owner
Copy Link
Copy Source

  • Add Google Scholar Alert collection via Gmail IMAP

  • Add Gmail App Password based authentication

  • Add Google Scholar environment variables to NAS compose configuration

  • Enable Google Scholar Alert source in config.nas.yaml

  • Disable subject filtering that incorrectly excluded Scholar alert emails

  • Parse paper titles and links from Google Scholar alert HTML emails

  • Deduplicate collected Scholar papers by normalized title

  • Filter Scholar UI/control links such as update alert and unsubscribe entries

  • Filter bracket-only alert labels such as [automotive radar]

  • Add Google Scholar specific relevance threshold

  • Keep global min_relevance at 2

  • Set Google Scholar minimum relevance to 3

  • Reduce Scholar candidates from 229 collected / 207 merged to 28 accepted

  • Add Gemini API rate limiting

  • Enforce minimum 13 second interval between Gemini requests

  • Apply shared rate limiter to abstract and full-text enrichment

  • Prevent Gemini free-tier 5 RPM quota errors

  • Verify retry processing of previously failed AI enrichment jobs

  • Verify end-to-end NAS workflow

  • Google Scholar Alert collection successful

  • Gemini enrichment successful without HTTP 429 errors

  • Joplin report generation and WebDAV synchronization successful

- Add Google Scholar Alert collection via Gmail IMAP - Add Gmail App Password based authentication - Add Google Scholar environment variables to NAS compose configuration - Enable Google Scholar Alert source in config.nas.yaml - Disable subject filtering that incorrectly excluded Scholar alert emails - Parse paper titles and links from Google Scholar alert HTML emails - Deduplicate collected Scholar papers by normalized title - Filter Scholar UI/control links such as update alert and unsubscribe entries - Filter bracket-only alert labels such as [automotive radar] - Add Google Scholar specific relevance threshold - Keep global min_relevance at 2 - Set Google Scholar minimum relevance to 3 - Reduce Scholar candidates from 229 collected / 207 merged to 28 accepted - Add Gemini API rate limiting - Enforce minimum 13 second interval between Gemini requests - Apply shared rate limiter to abstract and full-text enrichment - Prevent Gemini free-tier 5 RPM quota errors - Verify retry processing of previously failed AI enrichment jobs - Verify end-to-end NAS workflow - Google Scholar Alert collection successful - Gemini enrichment successful without HTTP 429 errors - Joplin report generation and WebDAV synchronization successful
KG-access added 1 commit 2026-08-20 15:29:05 +00:00
feat: integrate Google Scholar alerts and improve paper filtering pipeline 2543b0c23f 
- Add Google Scholar Alert collection via Gmail IMAP
- Add Gmail App Password based authentication
- Add Google Scholar environment variables to NAS compose configuration
- Enable Google Scholar Alert source in config.nas.yaml
- Disable subject filtering that incorrectly excluded Scholar alert emails
- Parse paper titles and links from Google Scholar alert HTML emails
- Deduplicate collected Scholar papers by normalized title
- Filter Scholar UI/control links such as update alert and unsubscribe entries
- Filter bracket-only alert labels such as [automotive radar]

- Add Google Scholar specific relevance threshold
- Keep global min_relevance at 2
- Set Google Scholar minimum relevance to 3
- Reduce Scholar candidates from 229 collected / 207 merged to 28 accepted

- Add Gemini API rate limiting
- Enforce minimum 13 second interval between Gemini requests
- Apply shared rate limiter to abstract and full-text enrichment
- Prevent Gemini free-tier 5 RPM quota errors
- Verify retry processing of previously failed AI enrichment jobs

- Verify end-to-end NAS workflow
- Google Scholar Alert collection successful
- Gemini enrichment successful without HTTP 429 errors
- Joplin report generation and WebDAV synchronization successful
KG-access merged commit eb80fd1cb0 into main 2026-08-20 15:29:19 +00:00
KG-access deleted branch feature/googlescholar 2026-08-20 15:29:21 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
KG-access
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: KG-access/Paper-Monitoring-SW#1