I found a lot of caregivers on NextDoor with good references from neighbors. Just search for "elderly, caregiver, nurse" etc. They might be cheaper but also not licensed/insured.
There are lots of companies that do it. The cheapest I have found is Vita Care at $31/hour. I found them via A Place for Mom and spoke to some referrals but never ended up using them.