In the onnxruntime documentation, for quantization here:

.html#quantize-to-int4uint4

It sets accuracy_level=4 which means it's a 4 bit quantization corresponding to int4/uint4.

However in the MatMulNbits documentation, accuracy level of 4 means int8:

.md#attributes-35

And if using that script to apply quantization the MatMulNbits node's accuracy level is 4 and bits is 4, however the type for the tensor is int8.

So is this quantization converting weights to int4?