I completely agree. I think if/when hyperkit gets M1 support that feels more seamless and a similar feature set, so I'd be keen to see that happen.
Others have mentioned Rancher Desktop as an option too that feels pretty slick - I believe it uses lima/QEMU behind the scenes also but I haven't had a chance to try it out yet. I'll edit this post if I do!