As a native speaker of English, born and educated in America, the saying "I have no brief" is foreign to me. Thanks for being so kind as to explain the term. Just because one is a native speaker doesn't mean that one knows every idiom in the American/British language system. Native speakers know this best of all.