if you are on the move then it is possible the phone will adjust constantly as the sunlight's angle changes. If you/phone are staying still and is doing that, it could be some setting issue.
Check to see that the phone does not fluctuate brightness while you are still with the sun at a constant angle towards the phone, if it shows the issue then immediately report error to samsung members app > get help > error report