That is my thinking exactly

My guess as well.

If someone actually said that in my hearing, I'd be trying to figure out what they meant by the context of the conversation.

Actually ... "daisies won't tell" is not an expression, I don't think ... or at least not where I'm from or have lived.