Both Canon M5 and Canon 77D have APS-C sized 24.0 MP resolution sensors so sensor size and resolution is not a differentiator between these two cameras.
Below you can see the M5 and 77D sensor size comparison.
Sensor Size and Resolution Comparison image of Canon M5 and Canon 77D Cameras
Canon M5 and Canon 77D have the same sensor sizes so they will provide same level of control over the depth of field when used with same focal length and aperture.
DxOMark Sensor Scores
DxOMark is a benchmark that scientifically assesses image quality of camera sensors. It scores camera sensors for color depth (DXO Portrait), dynamic range (DXO Landscape) and low-light sensitivity (DXO Sports), and also gives them an overall score. Canon M5 and Canon 77D sensors have been tested by DxO and the results show that 77D has a better overall score of 78, 1 points higher compared to M5's score of 77.
Model
Overall
Color Depth
Dynamic Range
Low-light ISO
Canon M5
77
23.4 bits
12.4 Evs
1262 ISO
Canon 77D
78
23.6 bits
13.3 Evs
971 ISO
Sensor size sets the circle of confusion, so it drives how much depth of field each
of these bodies gives you at a given aperture. You can calculate it exactly for the
Canon M5
or the
Canon 77D ,
including hyperfocal distance.