>or is it just a convention we just agreed on?

Pretty much. It's called PEMDAS.

You could, in your daily life, go against it BUT you would need to be consistent with it. So does everyone.

You could do it with numbers (the symbols) just as long as the flow of logic is consistent.