Could the 4 bit (edit: or 8 bit) version of the 65B model parameters be run on vanilla-llama to use less than 100GB VRAM?

Maybe I'm being "dense", but what task was your network trained to accomplish? That wasn't clear to me from your description.

This is actually a very cool approach, if more narrow in application. Other domains that have these linear representations like the Morgan fingerprint might also benefit.

I'll give it a try, thanks

It's not the best at Q&A or chat (yet), but kudos for all the work behind this super interesting approach. Maybe with time it will continue to improve, and I like seeing non-transformer methods showing some potential.

Was there supposed to be a link to your blog post?

Some 3 dimensional understanding and up/down/gravity seem possible. I think examples of light/shadow/reflection have already been shown. I can't see how it could ever do full tracing but maybe there are heuristics (or overfitting) to be found.

I think you might be a little too in love with words like "neuromodulatory", while overlooking whether a simple deep FF network might be able to achieve what you're proposing. Just add a layer, nodes, and weights and you get this "modulatory" effect through linear combinations of the subsequent layers. Maybe I'm not grasping your intent, but I think if you can reduce it to math, you can then try to prove this is something that isn't already achieved through FF and backprop.

I think I see where you are going but this demo didn't really seem that useful. An LLM agent capable of dialogue doesn't need a prompt generator and you can just clarify or ask it for alternatives. So I think you need to work on your concept a bit more.

So........... you are just generating multiple samples from the LLM with the same prompt?

50 textbooks later...

Show if the reference really says what the paper says it says.
Show if claims are disputed elsewhere.
Identify plagiarism or likely use of AI.
Jump internally to referenced statements or sections.
Open supplements in a side panel or tab.
Zoom to figures in full screen.
Link to grant funding info.
Similar articles search.
Quick word definitions.

Hi, thanks for doing this! A few questions: 1) Given the recent tech layoffs, what do you think the mood is among sponsors and attendees where hiring is concerned? Is there a lot of active recruiting? 2) Do you feel like the sponsors/vendors are exclusively hiring people fresh out of school, or is there a range of openings? 3) Are you seeing any groups working on neuro-symbolic methods to leverage the successes of LLMs?

(You were kind to address my earlier question in this sub about job seeking at NeurIPS - unfortunately I wasn't able to come this year. )

Ah. Well there is lots of research on understanding user intent (from queries or other actions) so I'd start there.

Omnipotence - I don't think that word means what you think it means

Kate Bush for the win.
https://youtu.be/JfK9T4SfQqU

Your university should provide legal consultation. The answer is probably yes under "fair use", but I think a lot of people here really don't know what they're talking about so beware of legal advice on reddit. "IANAL"

Perhaps dig deeper on activation functions, optimization algorithm, or step sizes. Try some alternatives.
If your domain images (and things that differentiate between classes) are very different than those in the pretrained network maybe it doesn't have the features you need.

I can't wait to visit the beigeverse

Sorry you didn't get a more definitive or satisfactory result. Up to you how much to continue to push it, but you could let them know you'll think twice about reviewing for them in the future without anonymity. You can also reject papers from people you know or have any link to (possibly harder).

I understand you may feel constrained by knowing the author. But this issue is bigger than just their paper and their feelings. I would 100% contact the Chair, and it (edit: if) they do nothing, raise it with the organizion as a whole.

If you wish you can let the author and other reviewers know this is not normal. Reviewers shouldn't break anonymity and authors shouldn't be able to see reviewers or directly ask them to change reviews, and for that reason you will be contacting the Chair. You can tell them you"re not going to make the issue about reprimand for their specific actions but about protecting the anonymity of peer review.

I doubt you will find datasets like this that aren't closely guarded. Doing post-hoc chart review is very expensive. Also helpful/not helpful is not how doctors approach diagnosis since they must rule out alternative diagnoses.

I'm trying to help but I have no idea what "review" means as a column. The word is generic and doesn't clearly and uniquely describe a medical attribute. So if you want help you'll have to be more descriptive.

What does a "review" column or variable mean in this context?

Review?