I have an expiriment showing two images on the screen and using scale response to give the preference. So the participants will choose their preference from the two images by clicking the box under each image. In order to conterbalance the pair of images, the paired images are shown twice by switching their relative place (right to left and left to right).

The problem is by switching the order of the paired pictures, e.g. if they prefer A image ( on the right) by clicking the right box under the picture, they will also click A image (on the left, after switch with the left image B in previous display) by clicking the left box under that picture again.

My question is the data will be recorded, in the example above, A image will be recorded as 1 in the first order and be recorded as 2 in the second order. But this will be difficult to analysis the data afterward.

Do you have a better way to record the data to faciliate the analysis?

Thanks.