The inertia of verbal clichés
I understand your insistent desire to get an answer to this fundamental question, because I have thought a lot about this too. Just take a look at the list of links at the end to get an idea of how great the interest in the differential arrangement is and what effort it has cost me to show what the idea behind it is. Human thinking tends not to delve deep but to use formal, worn-out explanations, because this is easier and yields fast results. It is a fortunate circumstance that there are people like you who are not satisfied with such superficial explanations and persistently seek the idea, which motivates us to find a worthy answer to such a profound question.
Short answer
Is there still any practical benefit of the differential pair, and what noise/offsets is the CMRR rejecting?
The answer depends on what kind of op-amp you have in mind in this inverting amplifier circuit.
If this is a conceptual circuit with an "ideal" op-amp, the answer is, "No, there is no benefit from an amplifier with a differential input. Its use is meaningless and only complicates the circuit."
However, if this is a practical circuit with a real op-amp, which is subjected to certain harmful effects, the answer is, "Yes, there is a benefit from a differential input stage, because it will compensate for them."
But how does this "magical" suppression of harmful effects and amplification of useful effects happen?
Basic idea
The idea is ingeniously simple. Instead of using just one single-ended amplifier, we take another (single-ended) amplifier, place it close to the first one, and connect it in the opposite direction.
In this way, all "common" effects (which act simultaneously on both amplifiers) destroy each other, and the output voltage does not change. Examples include the supply voltage, temperature, the transistors' beta, and others.
However, the input voltages play a more specific role—since we have applied them to two separate inputs, they can be both the same (common mode) and different (differential mode). This finds application in transmitting signals over long distances and in the non-inverting op-amp amplifier.
In the inverting amplifier, however, the input voltages are used only in differential mode. For this purpose, one input is fixed to ground or a fixed potential, and only the other input is used. Thus, the op-amp is sensitive to (responds to, amplifies) only one input voltage; it has, as you call it, a "single-ended input".
However, all other common effects (the supply voltage, the temperature, the transistors' beta, etc.) remain compensated and do not affect the output voltage. This is why there is a point in using an op-amp with a differential input even in the case of an inverting amplifier.
The essential thing here is to understand that the common mode of the input voltages has nothing to do here, and the classic example of transmitting a signal over a distance is not relevant. Only the other quantities (including non-electrical ones) remain, which always act in common mode.
Related answers
Inverting configuration
Conception of an inverting op-amp with a specific gain
Differential configuration
Is the voltage on the negative of a differential pair actually below the ground voltage used to generate the signals?
Transistor implementation
Designing a differential amplifier
What is the best way to analyze this differential amplifier?
Questions about a differential emitter follower
What is the idea behind the transistor differential amplifier?
How does the current and voltage stabilize in a differential amplifier?
BJT Differential Amplifier problem
How does an op-amp know where ground is?
Op-amp implementation
Ground in differential opamp situation
Differential Amplifier with Unity Gain Source vs Instrumentation Amplifier
When is it an instrumentation amplifier (In-Amp) and not an operational amplifier (Op-Amp)?
What is the idea behind the op-amp instrumentation amplifier?
Is a common ground need in a differential amplifier?