ajt9000

ajt9000 t1_jd5w735 wrote

Reply to [D] Running an LLM on "low" compute power machines? by Qwillbehr

Speaking of this do you guys know of ways to inference and/or train models on graphics cards with insufficient vram? I have had some success with breaking up models into multiple models and then inferencing them as a boosted ensemble but thats obviously not possible with lots of architectures.

I'm just wondering if you can do that with an unfavorable architecture as long as its pretrained.

1

ajt9000 t1_janfx47 wrote

Reply to comment by sugar_scoot in [D] Are Genetic Algorithms Dead? by TobusFire

This comment make me wonder if the same rules about using one-hot encoding instead of ordinal encoding for classifiers still apply to a neural net trained with a gradient-less search algorithm like a GA instead of backprop.

1

ajt9000 t1_janfj0c wrote

Reply to [D] Are Genetic Algorithms Dead? by TobusFire

Who says genetic algorithms are dead? They're pretty much dead for training neural nets absolutely, but there are tons of other more general optimization problems that GAs (or more generally evolutionary algorithms) are well suited for.

Not to mention they still have plenty of utility as a search algorithm for hyperparameters so they aren't even dead for neural applications.

3

ajt9000 t1_izdf0ty wrote

Reply to comment by Gmroo in The hard problem of metaphysics: figuring out if other phenomena exist in our universe that like consciousness require we bear a specific metaphysical relation to them - i.e. you can't know of consciousness without being conscious. by Gmroo

I agreeof course, but does the subjectivity really have anything to do with consciousness? You could taste something and have a totally different experience than i would because your taste buds are different.

Likewise, a non conscious agent like a software bot or simple organism can have a different subjective experience than an identical agent because of similar environmental differences.

If i just ate a giant meal and you didnt, and we both experience a day without food, then my subjective experience would be very different than yours for example. Regardless of whether we are conscious or not.

I dont think consciousness = subjective experience. I think consciousness is a thought process that happens in our brains, and subjective experience is a very abstract concept that can be influenced by many, many things but exists independently of consciousness.

2

ajt9000 t1_iz41r3e wrote

Reply to The hard problem of metaphysics: figuring out if other phenomena exist in our universe that like consciousness require we bear a specific metaphysical relation to them - i.e. you can't know of consciousness without being conscious. by Gmroo

Who says you cant "know" of consciousness without being conscious? What does it even mean to know something anyway?

Is just being able to regurgitate a definition enough? In that case a dictionary website is intelligent enough.

I think that a lot of the problems with many metaphysical arguments is that they are rooted in definitions of consciousness which are based on junk science or no science at all. Its a hard pass for me when I see arguments about consciousness that don't come from any kind of understanding of how the brain works, because thats where it all begins.

4

ajt9000 t1_isyibso wrote

Reply to comment by visarga in [D] How frustrating are the ML interviews these days!!! TOP 3% interview joke by Mogady

I don't publish most of my projects publicly either, but I have a long list of historical projects that I can talk about, and many of them I can produce code for upon request. I think that is quite a bit better for demonstrating ability than any crap that I write in under an hour. Especially when the code exams have stipulations like "you cannot use any code or algorithms that you searched for on the internet".

1

ajt9000 t1_isinimd wrote

Reply to [D] Is the GAN architecture currently old-fashioned? by teraRockstar

Am I the only one who finds it a little bizarre how quick people on this sub are to assume concepts have gone obsolete? I understand how quickly this industry is progressing, but just because something isn't the center of attention currently doesn't make it useless or outdated.

I'm definitely not qualified to criticize but sometimes it feels like people are so desperate to be the inventor of the next big thing that they get lost chasing trends and in a weird way inhibit themselves from being able to invent the next visionary concept by doing the same stuff everyone else is into at the time.

32