For many people it’s not just a luxury but essential to their workflow and a reason to use other devices or plugins instead.
That’s right. Of course you could use scene mode to bypass your blocks but that’s somehow limited (can not toggle on one switch).
If you want to have a hybrid mode, upvote the existing feature requests or if you want some other functionality (e.g. freely programmable) create a new one.
Also have a look at New mode : Page Mode : Control everything for a suggestion how a freely programmable hybrid mode might be implemented.