Viewing a single comment thread. View all comments

jobeta t1_jbgnfsq wrote

> a model that can generate more accurate embeddings in general

What do you mean by this? Accuracy is an evaluation metric that doesn't really mean anything "in general" but only with respect to a specific prediction being made. I think this is a slightly ill-posed question

1

keisukegoda3804 t1_jbgrbmx wrote

More accurate, as in it can more accurately capture the semantic meaning of jargon that is typical in financial documents.

1

jobeta t1_jbhg8xy wrote

Right. But to be able to assess this you need to define a task and evaluate your model’s performance to perform that task. Embedding accuracy cannot be discussed completely in the ether. Even the most general comments you will read about a model beating another, will refer to that new model performing better for specific tasks on benchmark datasets.

It would be a lot easier to help you if you explained what you are trying to accomplish that requires “higher accuracy”

1