recall list data misplaced (case 1747)

[jarvis24]

So just to be clear here, I understand that it is affect all of your data files which is very useful to know. And that it happens with the final release of v2008. What I'm not clear on is this:

I also have tried to systematically replicate the problem using the Recall.que file in between the two questionnaires that it follows and precedes in the full experiment. However, I have not been able to replicate the problem using 30 different variations of responses (see attached zip file Au2010 test).

I like the "I have not been able to replicate the problem" part but I'm not clear on the conditions under which you are NOT replicating. I had been wondering of you would see the issue occur if you just ran the recall que alone--is this part of what you are describing here? If not, are you describing conditions under which you can see the issue or not see the issue (e.g., turn the problem "on" or "off") depending on what questionnaires you place before and after it (esp re 30 variations). I'm going through the attachment but these are my first thoughts/questions.

[jarvis24]

One other comment--if it is the case that you found you cant replicate the problem without the greater surrounding experiment--can you discover how much of that greater experimental context you *can* take away and still reliably experience the problem? That is, can you find the "tipping point" at which the problem will or will not occur depending on some critical change you can make or item/parameter you can take away. That sort of thing is akin to the holy grail of what you could offer us from a problem solving perspective.

[bstewart]

See below for my response to your query about "the conditions under which you are NOT replicating.”
Conditions under which I am NOT replicating: Used the entire experiment, but skipped through questionnaires until the Choice.que. At that point, I answered the questions for the Choice.que, Recall.que, Weighting.que, and NeedCog.que. These are the questionnaires between which the Recall.que falls in the experiment file and in the data file (for Order by Que file). 15 of my 30 variations were in regard to the responses (i.e., answer all 12 recall items for each of the four cars in the Recall.que; or answer some and press escape; or answer none and let it time out; etc...). The data file for this test was the “Au2010 NC Presentation – Harriet ALTERED” file. In this file, subjects 1 through 13 are real participants, while 887 through 873 are my unsuccessful attempts to replicate problem.
My main problem is that I was never able to replicate the problem doing the procedure above or when I just sandwiched the Recall.que file in between the Choice.que and Weighting.que files (Au2010 test file uploaded onto forum) as it is ordered in the entire experiment.
Tested Recall.que alone? I have just run 15 variations of responses for with just the Recall.que and haven’t replicated the problem. I answered all the recall items for the first 6 variations, then I answered all for all except for the last car and either escaped out, or let it time out.
I will keep working on testing the Recall.que by itself, however, I have had to begin running another experiment with the Recall.que in it, and have run some participants, and the problem happened for the very first participant. I have attached the file (Su2011 NC). ???

[jarvis24]

So I just ran through su 2011 nc. To try to replicate, I didn't skip anything. I answered some recall questions fully and escaped on others. Followed through to completion and got full data set. I have a suspicion that it has to do with the timed events in the second and third que files (e.g., Cars Configural 2 sec Order 1.que, conscious.que). If you run ONLY those two questionnaires and then your recall que file--can you then produce the missing data? If so, try adding a simply untimed instruction item to the end of each que file. Something like "Click continue to proceed". i.e., at the end of any que file that ends with a timed item.

Another option would be to try the latest release of MediaLab v2010 just in case that is part of the issue.

[jarvis24]

Here is an example .exp file--wondering if you can get the missing data with this..

[bstewart]

I've tried putting the Cars Configural 2 sec Order 1.que, Conscious.que, and Recall.que in consecutive order (Su2011 NC Testing Recall Problem), and with Choice.que and NCdebriefing.que interspersed (su2011b), but was not able to replicate the problem (note: even tried with and without randomization in the recall.que. See Su2011 NC Testing...). Not sure what to do as I don't have a license for the 2010 version.

[bstewart]

Hello,

I have found a solution to my data organization problem with the "recall listing". If I change the "recall listing" to a "thought listing" I do not have a problem with faulty data organization within Media Lab 2008.