Man, user end capture card chipsets really do suck. Anyway, with more tweaking and the right level (default for CBS, imagine that) and full luma range enabled:
A much much better look at the luma stepping scale that’s unique to the PCE’s VCE (that I’ve seen yet).
Once I figure out the correct values, and I get m fpga dev kit (which should be soon), I’m gonna make a RGB ADC index to a simulation table, to output back out as component and RGB. A real RGB and component converter for the PCE.