A peek behind the scenes of Avatar

avatar

I’m sure it won’t shock you when I say that Adobe software is used extensively in Hollywood. Avatar, James Cameron’s new movie, is no exception. So which Adobe software did they use and how?

PHOTOSHOP was used during the early conceptual stages to create art for getting the film green-lit by FOX. In addition to being a core production and design tool, it was also used to create many of the ultra-high resolution matte paintings and textures that were used as finished artwork passed along to the 3D pipeline for CG environments, vehicles and creatures.

LIGHTROOM was used by artists in the previsualization (previs) animation department to organize and catalog the thousands of set and lighting reference images.

AFTER EFFECTS had a multitude of uses as you can probably imagine:

  1. In the early stages of production, AE was used to place flowing camera moves on still artwork for concept art reels.
  2. On the live and mocap sets, AE was used to quickly create test composites to see if the live-action and “simulcam” green screen shots were lining up with the virtual animation and backgrounds. Within a few minutes of each take being shot, artists were able to mock-up composites for James Cameron to look at and approve or re-shoot.
  3. Automated rough comping of the video of the facial performances of the actors (recorded head via mounted miniature video cameras) into CG character face textures for the previs portion of the production. This allowed Jim a quick and easy way to know if the actor’s facial performances were going to be OK or if a take needed re-shooting.
  4. AE is being used by some of the vendors hired for VFX work to create 3D stereo composites for finished shots, to create complex motion graphics for use in the 3D holographic screens in the various control room scenes, and to create “heads-up” displays for various high-tech vehicles in the film.
  5. Adobe provides documentation to write complex procedural scripts for AE, and the AVATAR artists took full advantage of this. They created an automated rendering pipeline for comping the previs shots using AE’s scripting capability.

PREMIERE PRO was also used in different ways:avatar_cameron

  1. Each time Jim Cameron does a review/critique of VFX work, an HD recording is made of the session. Premiere Pro is used to take the edited recording and format into various packages for digital distribution. The process is automated, with typically 8 hours or more a day of reviews that need to be processed.
  2. Premiere Pro was used extensively on set in combination with AE to check rough composites in playback context with animated sequences. A/B comparisons of VFX vendor work are easily set up and reviewed.
  3. Although the creative editing for AVATAR is done using an AVID based system, Premiere Pro is able to read in cut-lists and other important metadata using its built-in AVID “AAF” import feature. Rather than bog down AVID editors with having to render out updated sequences for the animation department, the AVID editor can export the virtual “recipe” for the new cut to a small file that Premiere Pro then uses to automatically assemble the cut to match the AVID. Digital video files of the shots that are online in the master shot database are sourced as clips by Premiere Pro.

ACROBAT CONNECT was used for collaboration throughout the making of the film. In one example, it was even used by one of the Digital Supervisors to remotely connect to the computer of one of the interns on-set to to take control of her desktop and help her get through the temp composites that Jim Cameron (the director) needed ASAP.

FLASH PLAYER is used to deliver the movie’s website with high quality images and high definition video.

And to top it off the movie also has a very slick AIR application that provides exclusive content to fans including video interviews with the cast. In addition, the interactive trailer provides a way for fans to track official updates posted to Twitter,YouTube and Flickr.

If you were lucky enough to be in the MAX audience during the Avatar sneak peek, you’ll agree that the visual effects in Avatar are absolutely stunning. It’s great to see that Adobe software made some of it happen.

Avatar opens worldwide on December 18th, 2009.

Tags: , , , , , , , ,

22 Responses to “A peek behind the scenes of Avatar”

  1. Chocolate 26. Nov, 2009 at 10:35 am #

    It’s amazing that for such movies the very same software is being used as we have at our disposal at home. Especially Photoshop has reached mythical popularity, although its a very expensive software program to use.

  2. Gaspy 26. Nov, 2009 at 11:22 am #

    So basically Adobe software was used mostly for proofs and non-essential stuff.

    I’m pretty sure they used Word too :)

    In all seriousness, I’d love to know what they used for ‘real’ stuff – you know Mo-cap, CGI, compositing (other than the relative simple screens or HMDs). Avid, Maya perhaps, what else?

  3. Darren 27. Nov, 2009 at 9:34 am #

    Though I love adobe and (almost) everything it stands for, I have to agree with Gaspy that this atricle is somehow misleading.

    All good and well for the minor usages on james’ kids computers.. but in (hollywood) vfx adobe is not that popular and I guess that’s what this movie is all about right ? :)

    One of the reasons is most visual effects companies are running on linux, an operating system adobe doesn’t even care developing tools for (correct me if I’m wrong)

    The only adobe tool that IS used all over the place is Photoshop (as it’s truly awesome and The Gimp doesn’t come close yet:) for texture artists, concept, etc. And most companies have some dedicated mac boxes for only that purpose :)

    For compositing it’ll be either Shake and/or Nuke (after fx is great for what it is but not powerful enough for this sort of compositing). Further on the usual vfx tools like Maya and a whole bunch of mainly in-house developed tools.

    Is the vfx market to small for adobe to care for ? Would be great to hear some thoughts on that.

  4. Serge Jespers 27. Nov, 2009 at 9:45 am #

    @Darren: Misleading? Don’t really see how. It’s exactly that… a peek. I think you and Gaspy aren’t giving enough credit to the Adobe software used in the making of this movie. While it may seem insignificant to you, I think that the early stages of movie making are probably the most important stages. The article also mentions the creation of mattes and textures using Photoshop and final compositing in After Effects etc. Maybe you guys only read what you wanted to read ;-). A behind the scenes video will soon be posted on Adobe.com. Hopefully that will clear up some of your doubts about how important these things were in the making of this movie.

  5. Chad 01. Dec, 2009 at 3:47 pm #

    I’m pretty sure that these guys used everything under the sun from Autodesk for the CGI work, and more than likely Autodesk Flame, Flint, Inferno for the composting. Mudbox, Maya, and possibly Softimage Face Robot for facial animations. Any thing to get the job done I suppose. They have so much money invested in this movie that they could buy every piece of software available and not be able to make up their minds about which to use!

  6. Sandeep 26. Dec, 2009 at 7:17 pm #

    Been a practical user of Nuke/Shake/Digital fusion and After Effects I know one thing is that there is nothing you can achieve in one software that you cannot in another. Way of doing is different. Any shot composited in Shake could have been easily done in After effects also. But the ease of use and 3D capability of AE makes it the first choice for anyone during preping and pre-viz. There is a log list of 1sts with Adobe products in vfx history ie: resolution independent composting etc. which took a long for others to have. Agree its slower and depends heavily on the kind of system you run it on but its the most handy. I work mostly on Nuke and Digital fusion for comps but whenever needed I don’t even mind AE. For 3D I am a Pro 3D Max user from 3DS Dos time now adding Houdini in my arsenal.

  7. Sandeep 26. Dec, 2009 at 7:25 pm #

    My EX company worked on all the 3D holographic interfaces in the command station and HUD etc for Avatar. All done with After Effects and 3D Max. All you need is bid and get the contract and get doing with whatever software you have. We had Flame, Inferno Fire everything but still Major Vfx production shots happens on Nuke and Digital fusion. Adobe After effects is always there without any doubt in all the studios, everyone uses it but never acknowledge.

  8. Richy Rojous 13. Jan, 2010 at 5:12 am #

    Good review.. And i go with Serge, doesn’t much matter they use word or office.. Its important WHERE and HOW importantly they used at times.. Richy.

  9. pranjal 14. Jan, 2010 at 11:15 pm #

    Well, Motion builder was used to edit the motion capture data.There was a mocap artist on the set to show Jim instant results of the capture.

  10. Sabin 27. Feb, 2010 at 2:41 am #

    I was also searching the net for the questions asked by guys like Gaspy. and here is what i fished regarding the softwares used in Avatar.

    Autodesk MayaPixar Renderman for MayaAutodesk
    SoftImage XSILuxology Modo (model design, e.g. the Scorpion)
    Lightwave (low-res realtime environments)
    Houdini (unknown area)
    ZBrush (creature design)
    Auodesk 3ds max (space shots, control room screens and HUD renderings)Autodesk MotionBuilder (for real-time 3d visualisations)
    Eyeon Fusion (image compositing)
    The Foundry Nuke Compositor (previz image compositing)
    Autodesk Smoke (color correction)
    Autodesk Combustion (compositing)
    Massive (vegetation simulation)
    Mudbox (floating mountains)
    Avid(video editing)
    Adobe After Effects (compositing, real-ime visualizations)
    PF Track (motion tracking, background replacement)
    Adobe Illustrator (HUD and screens layout)
    Adobe Photoshop (concept art, textures)
    Adobe Premiere (proofing, rough compositing with AE)

  11. Claudio 28. Feb, 2010 at 10:38 pm #

    I think Gaspy and Darren made the point.

    Apart from Photoshop, every other Adobe product was only used in preliminary work… in other words: all the things where the best of quality was not yet needed.

    So please, stop worship adobe… They make really nice products, but they are not the best, in many areas…. Every stunning fx in hollywood movies come from something else (Maya, RenderMan, Nuke, Fusion)

  12. Larry Shultz 02. Mar, 2010 at 3:28 am #

    spent several months working in the VAD (Virtual Art Dept) at Lightstorm on Avatar during the design phase.
    Lightwave was the main workhorse to build the virtual sets mainly because we had a ton of assets that had to be created daily based on concept designs given us by the concept artists. The fast worflow enabled us to keep up with massive workload.
    Much of what we created in 3d was inspected by James Cameron himself and would be appr oved by him and put into the sets under his direction. The virtual sets had to look as photoreal as possible and those were passed along to Weta for uprezing and placement. The movie itself was really made in the VAD and the shots we did were also passed onto WETA.
    Lightwave was definately the workhorse during this phase. We did also use Maya and Motionbuilder but most of what was done in Maya at that stage was mainly to help translate assets from LW into motionbuilder. Whether or not anything else could have kept up with the workload is debatable to some degree. I know that the Maya artists had a difficult time keeping up with a fraction of what we were doing with LW.
    The point here being that despite the hype I know what was used and how much it was used firsthand on one of the most important phases of the film. :)
    Heres a link to one of the realtime pandara environments:
    http://www.newtek.com/lightwave/images/profiles/imagesimage/newsletter/02_2010/avatar/Image_3_NewTek_Rob_Powers_RobOverNeteri.jpg

Trackbacks/Pingbacks

  1. Activetuts+ - 26. Nov, 2009

    A peek behind the scenes of #Avatar http://bit.ly/4CCeAx

  2. Axna popular - 26. Nov, 2009

    A peek behind the scenes of Avatar: I’m sure it won’t shock you when I say that Adobe software is u.. http://bit.ly/86tMKe

  3. zefred - 26. Nov, 2009

    A peek behind the scenes of Avatar | Serge Jespers http://bit.ly/8WOHLw

  4. George Beagley - 27. Nov, 2009

    RT @tweetmeme A peek behind the scenes of Avatar | Serge Jespers http://bit.ly/5CBCzG

  5. rodoneill - 27. Nov, 2009

    I love you Adobe – http://www.webkitchen.be/2009/11/26/a-peek-behind-the-scenes-of-avatar/

  6. Deden Ramadhan - 27. Nov, 2009

    Adobe software is used extensively in Hollywood. Avatar, James Cameron’s new movie, is no exception http://bit.ly/4CCeAx

  7. herdiansah - 27. Nov, 2009

    RT @deden: Adobe software is used extensively in Hollywood. Avatar, James Cameron’s new movie, is no exception http://bit.ly/4CCeAx

  8. Rui Abrantes - 09. Dec, 2009

    A peek behind the scenes of Avatar http://bit.ly/4CCeAx

  9. Aplicaciones Adobe que se usaron en la película Avatar | Alojate.com Tu Proveedor de Web Hosting, Dominios, VPS, Servidores Dedicados, Factura Electrónica y Marketing para Buscadores en México - 14. Dec, 2009

    [...] Post original (inglés). [...]

  10. P.B. - 22. Feb, 2010

    What technology did they use in making the film AVATAR. It's all Adobe behind the scene and upscreen. http://tinyurl.com/y9qoskg

Leave a Reply