The "Pull Quote" block comes with the "Color settings" option which is located in the sidebar.

I am aware that we can remove the style using wp.blocks.unregisterBlockStyle but is there a way to remove a specific control for a specific block.

In this case, I am wondering if it's possible to remove the "Color settings" option just for the "Pull Quote" block.