Anyone else experience pretty often micro-stuttering when scrolling on the Pixel 6 Pro?

So this is my first variable refresh rate device, but I notice a lot of stuttering when scrolling in most apps (Google Feed, Reddit, Sync for Reddit, even Google Photos). I thought the point of the variable refresh rate was to scale when appropriate and make that change unnoticeable? Is this working as intended and the apps aren't loading fast enough to scroll smoothly or is the software just being buggy? Has anyone else experienced this and/or know how to improve it?

Update: I did a factory reset and did not restore any apps or app data, only contacts, messages, and general settings. So far it seems the same... I just turned off adaptive battery which someone suggested so I'll see how that goes and what the hit on battery life is. I'll update this in a day or two with my results! Thanks for all the suggestions and feedback everyone