I would guess the shifter. It sounds like you are shifting and then needing to trim, single click, as the chain gets to the lower end of the cassette. What I don’t know is it you can adjust it out, or replace the cable; or if the shifter is gummed or too worn.
John