and will need to recompile the source code to create your own binaries

Canonical have repeatedly been asked whether that's necessary even if the use of the trademarks would not be infringing, and haven't answered. It'd be easy to clarify, and that would remove most of the problems.