arXiv Feed: Keep up with AI research, the easy way.

Submitted by BullyMaguireJr t3_10iyx52 in deeplearning

Hey Reddit!

As someone working in AI, I've always found it hard to keep up with the fast pace of AI research going on.

So, I built arXiv Feed as a fun side project (https://arxiv-feed.vercel.app/).

It's a feed of recent AI papers with a one-liner summarizing what problem each one is solving.

It offers semantic search for finding AI papers covering particular topics (e.g., "connecting LLMs to external data").

You can also use it to find papers that are similar to a given paper.

If you'd like this content as a free weekly newsletter, subscribe here: https://arxiv-feed.beehiiv.com/subscribe

Hope you find this project useful, and would love to hear the community's thoughts & feedback!

PS: I've only indexed ~9K+ papers so far (with more added daily), and currently most of the papers are around LLMs. Will add papers in other research areas as well, lmk if you have any favorites I should prioritize!

56

Comments

You must log in or register to comment.

XecutionStyle t1_j5hj63c wrote

Is it possible to sign-up for the newsletter to periodically email me on certain topics (using the semantic search, say "motor control for robotics") or keywords like "VR/Wifi"?

4

BullyMaguireJr OP t1_j5hjz6r wrote

I'm actually working on that next, it'll probably be live in ~1-2 weeks.

Once it's live, I'll send an email to all the current newsletter subscribers so that people can set their own filters if they'd like.

7

abhasatin t1_j5idw0p wrote

Interested. Is there GitHub for PR for other fields?

3

BullyMaguireJr OP t1_j5j8pnu wrote

Dang, I don't have this app on a public Github repo yet since it currently has a lot of moving parts running on AWS lol.

But were there any specific fields you wanted to add?

2

fasync t1_j5iklnf wrote

Nice! Is there an option for rss readers?

3

BullyMaguireJr OP t1_j5j8w6m wrote

That's a nice idea! I don't have an RSS feed yet, but maybe adding one could be useful! Will add support for this soon!

3

TheLoneKid t1_j5jh3k9 wrote

This is awesome! Someone at my work is actually trying to build something similar but for chemistry publications. I would love to see how you implemented this if you ever want to share your code.

2

Ayakalam t1_j5loxsx wrote

Awesome tool!

Some qs, how do you actually index those papers exactly ? Do you use openalex or ?…

Secondly, are you using a library for semantic search ?

2

BullyMaguireJr OP t1_j5n3itx wrote

Thanks! I'm currently just using the arXiv API with OpenAI embeddings for semantic search.

1

Ayakalam t1_j5pa0uo wrote

Ok, but when you say you are “indexing papers”, what do you mean exactly ?

1

BullyMaguireJr OP t1_j5pq2uj wrote

Calculating embeddings for the paper using OpenAI's API.

1

Ayakalam t1_j5pvihn wrote

Ah, so you hand pick LLM papers and compute their embedding s essentially ?

1

BullyMaguireJr OP t1_j66d9um wrote

I just pull the latest Arxiv papers from their API and then compute their embeddings, index them for semantic search, etc.

1