Easily remove tracking markers

Written by Mohamed Selim on .

Easily remove tracking markers

When you work in a small company you have to constantly come up with fast solutions for tedious tasks, in this case tracking markers. I developed this workflow while working on a 1000+ frames plate where a marker was constantly intersecting with the actress's hair.

This technique lets you easily remove tracking markers from backing screens without the hassle of painting, even when they intersect with the foreground elements. The idea is to make them very close or identical in some cases to the backing color.

It works in most cases, but after some testing with different plates I found that there are scenarios where it won’t go smoothly and you’ll need to consider alternatives.

Example 1:

This is the easiest case, where the markers are only visible in 1 channel.

  0rgb

0r 0g.png 0b.png


Our first target here is to make sure the marker is mostly visible in one channel and blended or not seen at all in the other two. We start by making a rough mask around our markers and animate the shapes if needed. Keep this matte on the side for now.

1roughMask.png

In this example we have orange markers on a green screen and the markers are dominantly apparent in the red channel only. Put a shuffle node and replace the red channel with the blue channel.

2blueShuffle.png 2blueShuffle dag.png

Notice how now the markers have disappeared, but also obviously all the plate colors shifted. The screen color shifted slightly and our foreground subject turned greenish. Put a grade node and let’s grade our new red channel so that the screen color matches our original plate.

Use a wipe viewing only the red channel to accurately match them. In the grade node either split the gain control and only change the red knob or just uncheck the green and blue channels.

3wipe.png 3wipe dag.png

Now the screen color is back to it's original state but still our foreground subject needs work. We need to restore her colors without affecting the green screen.

4rRestored.png 4rRestored rgb.png  4rRestored dag.png

Copy the marker’s rough mask in and premultiply then merge this over the original plate.

5premultrMask.png  5premultrMask dag.png

6hair.png 6hair dag.png

This makes our problematic area just limited to the rough mask we prepared earlier. We now need to isolate the foreground subject so we can stencil it from all this mess and since we now have a marker free green screen that becomes easy.

Drop in a keyer node and pull a quick matte. 

7hairMatte.png 7hairMatte dag.png

Channel merge this matte with our modified unpremultiplied RGBA using a stencil operation and premult that.

8hairStencil rgba.png 8hairStencil rgba dag.png

Now we only have a patch, where our markers were stenciled from any intersecting foreground and that can then be merged over our original plate.

Note that you can add some edge tools to refine your screen matte. Here is our final product, the plate is now ready for comp.

9done

9done dag.png 


Example 2:

Here is another not as simple example where we have green markers on a blue screen. The markers dominant channel is obviously green but it’s also visible in the red and blue channel.

This time we need to Pre-grade the markers in the red channel to blend in more before we go ahead and shuffle the blue channel to replace the green. Remember this works best if the marker is mostly visible in one channel.

0rgb.png

0r.png 0g.png 0b.png

I used a hue keyer to make a mask to feed a grade node where I dialed down the red color. You can also use a hue correct or anything that does the job done.

1 result.png

1 dag.png

Notice how the marker intersecting with the 3 characters is now gone without loss of detail in their hair. The other surrounding markers are still visible but are mostly blue so they will be easily keyed with the blue screen. 

The target is always to focus on the intersecting markers since they are the most difficult to remove. 

I put together all this in a gizmo that makes the process easier and works in the steps described above.

Conclusion

We now started to only place orange markers on green screens and pink on blue since they give us the best results. Obviously there will be times when this will not be possible due to a number of elements so hopefully a pre-grade will get us there.

Comments   

 
+1 # iMan Javaherypour 2015-12-12 17:19
Thanks for sharing!
 
 
+6 # Mohamed Selim 2015-12-15 20:04
Your welcome, hope it was useful for you.
 
 
0 # Sri kanth 2015-12-30 11:18
Great! Thanks Mohamed :-)
 
 
0 # djati waskito 2016-01-20 03:57
Thanks Mohamed...HELPS A LOT !
 
 
0 # nader salah 2016-02-15 09:12
Thanks selim
 
 
0 # Cornelia Richter 2016-04-04 14:14
Great tip! Thanks a lot.
 

You have no rights to post comments

We have 190 guests and 14 members online