Of course, you could also train a LLM to utilize ControlNet settings solely through prompts, since LLMs allow us to use our own personal vocabulary as a high-level Natural Language Programming language.

I really don’t understand what you mean by this. It sounds like a very inefficient way to use controlnet. What settings would you be tweaking with an llm? Why would you use an llm for that, instead of a slider/checkbox?