That is not how I understand it, as I understand copyright: if you use anything which is not your own invention, fair use can only be invoked under limited circumstances, it is unnecessary that a coyyright owner need sue me to retain the rights that the law gives them. Perhaps I misunderstand your contention. It is not mine to use simply because I want to use it.