One of the main objectives of filmmaking is making the audience forget that there is a camera. Tracking shots like camera tracking and motion tracking helps in doing that – engaging the viewers. If done right, tracking shots allow filmmakers to draw the audience deeper into the characters’ story and share their narrative. I found out that there is a gray area on the difference between motion tracking and camera tracking. I will share with you where the confusion might be from and provide you with applications for both techniques to clear the confusion.
What is the difference between camera tracking and motion tracking? Their difference is in the standpoint of the action being followed. Motion tracking tracks the motion of an object from a cameras perspective. Camera tracking tracks the camera’s motion and projects it as if you are in a VR or augmented reality world, making the scene more immersive.
We’ll look at how tracking came about in the film and its role in the industry. What it is and how it affects the world of cinematography. We’ll also explore the common applications of both motion tracking and camera tracking as well as the different softwares used for both.
Motion and Camera tracking is an important part of the VFX pipeline where it is often also called Matchmoving.
Check out my other articles on the topic that go a lot deeper.
What is the Difference Between Camera Tracking and Motion Tracking
Motion tracking and camera tracking are often confused with each other. Let’s define each and figure out how to differentiate them.
Motion Tracking
As simple as the name implies, you track the subject’s motion or object within the frame.
Motion tracking is used when: the subject is in motion or both the camera and subject are moving.
Motion tracking is tracking an object that moves and uses this information in a 2-dimensional composition frame. In motion tracking, you use real-time data streams and use these to manipulate a frame or effect.
Here’s a quick easy tutorial how to do simple motion tracking in After Effects
Imagine a highway car chase in an action film – that is motion tracking. Let’s use a SimCity setting for another example: your Sim’s movement is tracked against your house’s steady scene. Regardless of your Sim’s action, the frame is focused on your Sim.
Camera Tracking
Camera tracking can be used as an alternative to motion tracking when the circumstances call for the camera to be in motion while the object being “tracked” is static. Camera tracking uses information from a recorded live shot using a live camera. And then, this information is used to project a parallel virtual camera in a three-dimensional composition frame. Wherein scenes are recreated, and new 3D elements are inserted.
Usually used when space is limited in set to shoot, elements can be recreated in the live shots to add 3D details. It translates the motion of the camera from the real world into the 3D virtual space.
In general, camera tracking is a subset of motion tracking. But in camera tracking, it is non-real-time data collection using the live camera shot, and the information is used during after effects.
Let’s use the same SimCity example mentioned but now applying camera tracking. A Central Park scene was shot using a drone and incorporated in the 3D SimCity software, and then two Sims talking to each other added into the frame.
The Art of Tracking
Tracking is the process of locating a point or a series of points, automatically, from frame to frame in a sequence. Let’s look how it evolved from tracking lateral movements to running with robots.
The Past of Tracking
A tracking shot is used to only refer to the lateral movements of the camera following a character. They were referred to as dolly shots because they were taken using a dolly. Left and right movements and forward and backward movements are often referred to as dolly-in and dolly-out.
With the advancement of technology, tracking shots show the entire scene and characters moving into the perspective for extended action. Dolly shots now refer to any shot taken in a dolly, which means it can be from and to any direction
Tracking Shot and its Role in Film
Tracking shots immerses the audience into the scene for a more engaging narrative. They are specifically meant to follow the subject (a person or an object) as they move along through the scene, engaging the viewers with all the actions going on.
Tracking shots’ primary objective is full immersion, making the audience forget that there is a camera. It is all about the action going about within the frame.
Tracking shots considers three camera movements: speed, stability, and duration. Along with the three tracking shot aspects: blocking, location, and production design or the set.
When To Use Camera Tracking Or Motion Tracking In Films
Motion tracking is used when the subject is in motion. For example, you are filming a sports event, you keep the focus on one player and track his movements throughout the game. Camera tracking on the other hand is used when you combine a 3D object with a live action shot. For example is when you film the sky wherein you plan to insert a spacecraft in the after effects program.
Here is another nice little tutorial on how to use the point tracker in After Effects
Applications of Motion Tracking and Camera Tracking
Our minds may have been conditioned to think of films when we mention motion tracking and camera tracking, but the truth is that that both can be used outside films. Numerous applications in technology such as vehicles and machineries can benefit from both.
The Future of Motion Tracking
Aside from the obvious application of motion tracking in films, this tracking technique has other applications in animation and after-effects.
Motion tracking will play a large role on the Internet of Vehicles. IoV will use your vehicle’s motion and project this along the 2D path. Then using your surrounding data informs you if there are obstructions along the way.
Stabilization and motion tracking uses the same principle. Both track a moving object. In stabilization, you identify the spot you want to be centered and focused despite the motion. In motion tracking, you track the item you want to focus on while in motion.
Motion tracking is also used in sports footage, commonly on football and basketball footages. Wherein a circle is placed around the player as he runs around the field or the basketball court.
It is also used on edited videos for weddings or parties. Remember when the bride was walking down the aisle, and all the guests and background was blurred? That is motion tracking in action.
Beyond Movies: Applications of Camera Tracking
Robots running in the city, alien spaceships flying in or being sucked-in by blackholes are some of the after effects using camera tracking softwares. Let’s look into where else do we use camera tracking.
Since camera tracking uses a live action shot and then using this shot to add elements into the scene, camera tracking applications are usually for after-effects.
Camera tracking’s biggest contribution is in augmented reality. Adding 3D objects into a video shot in reality. Remember Space Jam? The basketball court, Michael Jordan and other players were shot using a live camera and Looney Tunes characters were added later.
Matchmoving also uses camera tracking. Wherein insertion of computer graphics in a live action footage happens. Matchmoving is an application of camera tracking, because you are trying to match the movement of the virtual camera.
As mentioned above, the same tracking technology is also used in autopilots for cars like any Tesla. This video showcases nicely how the software works.
This just goes to show how software like this finds lots of applications outside of VFX. Which other ones can you think of?
Quick Software Guide for Motion Tracking and Camera Tracking
Given the wide range of available software in the market, here is a quick rundown of some software used for camera tracking and motion tracking and their advantages.
Adobe After Effects and Boujou are the top camera tracking software. Adobe AE is included in the Adobe Suite; hence it is compatible with most other Adobe editing programs. It is beginner-friendly like the Boujou software, but its advantage from the latter is Adobe’s established users that provide numerous tutorials on the internet. To compete with Adobe’s presence in the editing market, Boujou boasts constant updates to stay competitive with the changing technology.
A lot of Visual Effects studios also use PFTrack or Syntheyes.
There are a lot of video editing softwares that have embedded motion-tracking applications. Both Blender and Adobe Premiere PRO have a steep learning curve in using motion tracking. Blender is an open-source application; hence it is free software but is packed with essential video editing tools, including motion tracking. Adobe Premiere PRO is part of the Adobe Suite. It has both 3D camera tracking and motion tracking applications, but its motion tracking is way better than the 3D camera tracking.
Conclusion
Motion tracking and camera tracking are widely used techniques in video editing. Though often deemed similar, both use different standpoints in showing motion. Motion tracking keeps the moving subject in focus by following its movement throughout the frame. Camera tracking is an after-effect process that uses a pre-shot video’s information to project a parallel virtual camera to show a 3D perspective. If there is one thing that motion tracking and camera tracking share, they both immerse the audience into the character’s narrative, making them part of the story. This leaves your viewers with a feeling of being a character in the movie and allows your film to leave a lasting emotional and visual impression long after the film has finished.