Here's my story with camera gear and using it for mostly family, days out or holiday stuff
I sold all my Canon gear as like you i found i wasn't using it with its size and weight even though i could easily carry it
So i committed myself to M43 but then once i did i missed the Canon gear lol at the time with the E-M5 it was great and still is at getting initial focus yet when following my kids running about i didn't rate it ( I thought you had a E-M5 once
) and the max 4000 shutter speed if i shot wide open would max out which i found a annoyance when shooting wide open on a sunny day with fast primes..
Yea i know use a ND filter before anyone points it out.
So i then gave the Fuji X series a go liked them the focusing wasn't quite as fast initially yet the tracking on X-T1 was better and i really liked the lens and images from the X series.
But i ended up going back to Canon after it all as i just found
apart from the size and weight it was "imo" best
i have the 5D3.... and something smaller for when i can't be bothered carrying the DSLR a Sony A6000 but unless i was at the point of struggling with the weight i personally wouldn't replace a DSLR again with any CSC.. The A6000 is a good nice all rounder as a CSC body for the money AF tracking for the kids is very good but the lens choices are limited in comparison to the excellent selection from M43 or Fuji X series.