As an ML developer, what are the top 3 pain points that you would love to see solved. This could be something very specific (Example: I spend a lot of time in building a model architecture using Keras) or something broad (Example: I struggle with Model Serving because of the lack of easy to use infrastructure). Also, please mention how you workaround these paint points. Looking forward to the discussion. Thank you!

Comments

You must log in or register to comment.

SnooPears7079 t1_jecm2bt wrote on March 31, 2023 at 12:59 AM

Best of luck with your startup

General-Wing-785 OP t1_jeconzd wrote on March 31, 2023 at 1:19 AM

Thank you!

cthorrez t1_jecv5ox wrote on March 31, 2023 at 2:09 AM

Code quality of my own and my team's code

The reliability of the engineering platforms we use. (spark, gpu clusters, ci/cd build pipelines)

The correctness and completeness of the data we ingest

General-Wing-785 OP t1_jedkzcg wrote on March 31, 2023 at 6:23 AM

Thanks! A few follow up questions:

do you do most of your experiments in a notebook and then manually translate it to a classic python project for code review/deployments?
what has been the most frustrating part about the engineering platforms? Non deterministic build/compute times?
do you use any data auditing libraries for data quality?

[deleted] t1_jedo307 wrote on March 31, 2023 at 7:05 AM

[removed]

Philpax t1_jed8vd0 wrote on March 31, 2023 at 4:07 AM

Deploying anything developed with Python to a end-user's machine

General-Wing-785 OP t1_jedl8nt wrote on March 31, 2023 at 6:27 AM

Is this because of a lack of tools to deploy Python models/functions to the edge? Also when you say user’s machine, is it a browser or a native app?

Philpax t1_jee04jo wrote on March 31, 2023 at 9:59 AM

It's just difficult to wrangle all of the dependencies; I want to be able to wrap an entire model in a complete isolated black box that I can call into with a C API or similar.

That is, I'd like something like https://github.com/ggerganov/llama.cpp/blob/master/llama.h without having to rewrite the entire model.

For my use cases, native would be good, but web would be a nice to have. (With enough magic, a native solution could be potentially compiled to WebAssembly?)

[deleted] t1_jecolnj wrote on March 31, 2023 at 1:19 AM

[deleted]

a_beautiful_rhind t1_jeeab0q wrote on March 31, 2023 at 11:56 AM

People using creepy newspeak like "pain points".