Gotta love Botw..I found all the memories but yet on my check list it says I missed the one by the Oasis but I went to it and no glowing ground.And I did watch it my first time through the desert
If you check your mission list on the far right tab it should show the memories you've unlocked. The one you're talking about should be the Yiga one (I forgot the number).