Clean DI signal audible even when direct monitor is off?

I’m using the Fortin Nameless plugin and for some reason, I can still hear the clean DI signal from the guitar under the distortion, especially when playing chords.

This also happens when exporting the recorded track, so I don’t it has to do with direct monitoring.

Does this happen to everyone, or could it be a problem with my audio interface/technique?