Why can’t I see my last color in recently used colors?

A recently used color is specific to the background or the widget you are in so if you are editing another widget, then you won't see that recently used color from the previous widget (A). 

For example if you added a text widget and change its color and then edit an image widget – the recently used colors are only saved for the text widget. 

For more info see how to choose color.