graphic cues superimposed on video sequences

[jarvis24]

Hi Alvarom,

Awesome question. First off I think we *may* have added a function to superimpose graphics over video but I will need to check. For now, let's assume not and I'll try to answer your other question. In theory, absolutely, yes--if you have a 100Hz display which refreshes every 10ms, then a 10ms refresh rate would match nicely with a video encoded with 10ms frames. That sounds beautiful but in world of real things--I don't expect it would work that precisely. First, your encoder software would have to know you are really actually very serious about the 10ms frame rate--I don't know how much variability there is in that field. The other important variable I can not tell you is whether or not the frame rate would be matched perfectly with the screen refresh rate. In the vast majority of cases (I'm *guessing*) the frame rate would not be equal to the refresh rate (or equal to multiples of each other). Consequently, I can't see anybody having put effort into syncing them in the rare cases where they could be precisely coordinated.

So all of that is to say superimposing text over the video, or elsewhere on the screen (which you *certainly* can do) would be more accurate.

One thought--if there is any video codec out there that allows you to execute programmable events within the video you could take advantage of that. I have some recollection that .wmv (?) files many years ago would let you trigger events during the video. If you could embed text *and* send a TTL signal at the same time THEN you could know exactly when that text was presented.

Anyways, those are some initial thoughts. I will check through the code though and see if we got anywhere with text overlays in v2010. I wouldn't hold my breath but I do recall the effort to make it happen.

[jarvis24]

Looks like you can not overlay a text or image stimulus upon a video--even if you use a clear value of 0 for the text. The video will simply overwrite the space (the text or image will actually be behind it). *However* I tried playing a second video over top of the initial video after 1000ms delay. It had no problem paying on top. So if you could create your overlay stimulus/stimuli in any kind of video format (mpg, avi, animated gif) then you could locate and display it exactly as you like with as much precision as possible.

There was only significant problem I couldn't immediately work around. Videos do not automatically clear themselves from the screen. So the stimulus remained. Maybe this could be cured to some extent with an animated gif (or simply clearing the second video to a blank frame when it finishes) but you would still not see that region of the underlying video again. Some way to completely clear the second video without affecting the first would be necessary for this to be an easy method.

Some initial thoughts!

[alvarom]

Hi Jarvis,

Thanks a lot for your replies. I tried to do that -I've read in a different blog that the problem most likely arose for the text or graphic cues being still images. Unfortunatelly, when the videos were supposed to be shown, the experiment froze completely. Probably this was due to my lack of experience with Direct RT

I'll try to get both videos playing (most likely video and animated gif) and then try to find solution for clearing the 'cue video'.

I may come back to you in a couple of days.

Best,

Alvaro

[alvarom]

Hi again, Jarvis,

I still couldn't get to play the second video on top of the first one, but I did manage to play an animated gif on top of a video. However, I still faced some problems.

I thought that the best way to avoid the problem of the top video not clearing was to use an animated gif with a transparent frame showing for a long time. However, transparent areas/frames of animated gifs appear solid black. These areas appear transparent in Mozilla Firefox, MS PowerPoint and Open Office Impress.

Just for the record, there is an image distortion everytime a new loop starts.

I still couldn't manage to get a second video playing on top of a first one. When I try to do that, DRT freezes and get the following error message: "Empirisoft executeDRT has detected a problem and needs to close". At this point, my screen resolution changes from 1280x800 to 800x600.

Still, the most critical point would be to get rid of the black rectangle where the animated gif (or eventually the video) was showing.

Any ideas on how to proceed?

Best,

Alvaro

[jarvis24]

What version of DirectRT (20xx.x.x.x) are you running and on what version of Windows?

[alvarom]

I'm using version 2010.2.103.1115 on Windows XP.

Alvaro

[jarvis24]

DirectRT v2010 has a new feature where you can launch an executable (.exe) file. You use ^ as the prefix and copy the exe into your stim folder (or perhaps supply the full path if it's elsewhere). E.g., if your exe were called popup.exe, you would simply enter ^popup in the STIM column.

Haven't experimented with it much yet but this morning I did try to launch an exe after a video and it was more than happy to appear on top of the movie as long as I used a "0" as the clear value in the LOC column. You can use a 0ms delay in the time column after the movie begins or enter an onset time such as "1000" to delay the start of the exe from when the movie begins playing.

I think this may be a solution. All that is needed is a short exe that simply presents whatever you like and is timed to disappear after a fixed length of time.