Viewing a single comment thread. View all comments

futebollounge t1_j6x36l4 wrote

Not sure this is actually a huge bottle neck. You will just dedicate a few people to always ensuring that the metadata and documentation is updated. That is then how data roles start to shift in an AI world. You then might not need a team of 20 data people, but can get away with 10.

5

dgrsmith t1_j6xe2bu wrote

Totally agree. The company's CTO or business users need to buy into this in order to allow resource allocation. It's promising, it just requires a hell of a lot of "human in the loop" at the moment in order to finess the data to a point that the AI could produce reliable results from hidden concepts and constructs in raw tables. I think the assumption currently is that your data is finessed already for GPT to take over and produce reliable and clean results. Those 10 data people will certainly be supported by data cleaning staff. That's where it should be anyhow. No data scientist likes spending the 80% of their time cleaning and prepping the data, but that's where we are now.

7