Welcome to the forum!
Maybe modulation mappers could do the job, but just thinking about it hasn’t brought me to a solution yet, I need to be in fort of Falcon in order to try this. I would probably just use key-switches and switch between layers, the other layers could remain un-switched and only the layer with the granular oscillators would be affected by the key-switches. One can also script the key-switches so that they become available in the user interface. But maybe it can be done with a single Macro.