Your intro posting is a bit hard to understand.
But I have a certain feeling, that this quick fix might solve your issues. My own CF was doing all kind of weird things out of the sudden, and neither the CF contour knob nor the target assigns did help. Solution:
https://community.enginedj.com/t/faulty-prime-4-crossfader-read-here
Shoutout to @DjAj