Viewing a single comment thread. View all comments

Ortus14 t1_j2zx5bv wrote

Most people are unaware of the exponential progress and feedback loops.

Ai is being used for every piece of Ai advancement now (Solar energy cost reduction, computer chip design, super computer design, cooling management, coding assistance, code and algorithm optimization, as well as product value bringing in more capital for reinvestment in researchers and production). These are all feedback loops amplifying each-other. The Foom has begun.

19

[deleted] t1_j306hi6 wrote

[deleted]

1

Ortus14 t1_j30qgb4 wrote

One example is Deep Mind's Alpha Tensor which optimizes matrix multiplication which is used in Ai. An Ai, optimizing algorithms used in Ai.

https://thenewstack.io/how-deepminds-alphatensor-ai-devised-a-faster-matrix-multiplication/

As far as ChatGPT/CoPilot, I can't speak for your company specifically but it would certainly surprise me if a company like Open Ai didn't use their own coding assistant product. CoPilot is also based on GPT-3 so it's going to lag behind GPT-4/Chat-GPT (which Open Ai has access too because they are the developers).

Programing is also sped up by other feedback loops such as new programing languages being written in old programing languages, which has been accelerating software development for decades. The distinction between "Ai" and non-intelligence comes down to semantics but I would consider any information processing system that's used to solve problems as intelligent, to include programing languages and IDEs. Most people have a more limited and anthropomorphized concept of intelligent systems, but regardless of whatever you want to call it these are also feedback loops speeding up software development to include Ai.

6

[deleted] t1_j31mwg2 wrote

[deleted]

1

ebolathrowawayy t1_j32ls76 wrote

> solving novel problems

What is a novel problem? I've never really come across one and I've been in the field for over a decade. Maybe I am unskilled. I imagine that a day in the life of a typical programmer is ... do X Y and Z feature, don't break CI, move some tasks to the QA column, talk to a dev about an issue they found, fix CI that someone else broke, explain to the manager why Z feature is taking too long and go home. X Y and Z features could be: cobble together a home page, add a physics collider to a component that triggers an event, add a column to a DB and create a new REST endpoint, etc. All super basic ass stuff that eventually turns into a product that prints money for someone higher up.

Where's the novelty in software dev, excepting fields like ML? I predict that 90% of SW engineers do tasks that LLMs can do (including architecture design) within a year.

Edit: I've talked with other programmers a lot about this and architecture design comes up a lot. IMO, architecture design is basically picking your pokemon team. I need fast messaging with 100k users and the app should be accessible to many people across devices and there is no complex data analysis -- Ok Nodejs, React and MongoDB, I choose you!

I need an app that does heavy image manipulation that is resource intensive with a lot of interactive data analysis -- Ok C++, ImageMagick, D3js and Postgres, I choose you! etc. Architecture is simple, I'd like to hear why it isn't.

3

[deleted] t1_j32qpy5 wrote

[deleted]

2

ebolathrowawayy t1_j32twcm wrote

I just don't see it as novel if a customer asks you to build them a website with a data dashboard. I think the majority of work is cobbling together small pieces of stuff in very slightly new ways and that mostly the value comes from displaying domain data, connecting data to other data or connecting users to other users.

If a majority of software work required novel problem solving then I don't think very popular and widely used libraries like React, Angular, Tableau, Squarespace, Unity, etc. would exist. Today's developer picks a couple of libraries, slaps together some premade components and then writes a data parser for a customer's data and does stuff to it. I really do think the majority of work can be done by following medium articles and stackoverflow posts.

Even gamedev, widely considered to be "hard", is really not that novel. It's composed of a bunch of small pieces of code that everyone uses. Most AAA games don't deviate from typical game design patterns, they innovate by pouring money into small details, like horse balls physics in rdr2 or by hiring 1000 voice actors or by creating hundreds of random "theme park" quests that feel amazing or by doubling the number of 3D assets as the last record holding game. But those aren't actually novel things, they're money and time sinks but they're not difficult to implement.

If we're talking about Netflix-scale then yeah that's still novel and not easily done, but 90% of devs aren't doing that. The reason it's difficult is because there aren't a lot of resources on how to go about doing it at scale and what the tradeoffs are of different stacks. If it was deeply and widely documented like React apps are then it would be trivial for a LLM to do.

I think novel software problems that are difficult to automate would be anything that advances the current SOTA, like advancing ML algorithms, implementations of AI that solve intractable problems (protein folding), really anything that can't be easily googled. (Edit: for near future. Once AGI/ASI arrives, all bets are off).

I think a useful rule of thumb for whether or not something can be automated is that if it's well-documented then it's automatable.

I'm not arguing just to argue and I'm sorry if I come across that way. We've had SW team conversations about this at work a few times and I think about it a lot.

2

ebolathrowawayy t1_j32kry7 wrote

I use chatgpt to write code when trying out new libraries or just need to bounce some ideas off of something. It's more helpful than official docs for libraries or just quick evaluation. I don't copy/paste the code over though unless it's incredibly simple and I always completely change the code anyway to fit into the codebase. It does save time though.

1