Thanks @MitchellMc. I made an attempt at filling the gap after removing the remaining loose grout. I’m not very strong to begin with but applying even ...

Thanks @MitchellMc! The remaining grout to the right is still quite set. Should I still try to remove it and break it apart with something like a chis ...