Hi, is this a common problem? It's like something decides to go to sleep after no keys were pressed on the piano keyboard for a few seconds.
Following the support article, I've disabled USB device sleeping for all USB root hubs, and selective sleeping in the Power Plan settings.
My setup is I'm just running Kontakt 8 that takes input from the KK S88 keyboard and outputs to the WASAPI Shared audio device. Just to reiterate: it is not a latency issue, it is a going to sleep after a few seconds of inactivity issue. After the first key press, all following key presses produce immediate audio without any problems. Until the next idle pause.