Definitely don't try and build this yourself. There are some platforms that work well. Things like cnvrg.io and dominodatalab already have a lot of mlops functionality built in. Otherwise, you are going to go down the path of stringing together many open source resources together.