ILM’s Hal Hickel on the symbiotic relationship between actor and animator

Warcraft3_final

At the recent Trojan Horse was a Unicorn event in Malta, I had the opportunity to sit down with ILM animation supervisor Hal Hickel for a THU TV interview.

We talked about the wealth of CG characters Hickel has overseen which began with live action and motion captured performances, including Davy Jones from the Pirates of the Caribbean films, the Orcs in Warcraft, and Tarkin and K-2SO in Rogue One (in which the original actor playing Tarkin, Peter Cushing, had in fact passed away).

DSC_4815
Hickel (centre) gears up for the THU TV interview. Photo by John Crowcroft.

With before and after images from those films, here’s some of Hickel’s main takes on how he and his team tend to tackle a character where actor and animator need to combine to craft the final result.

DavyJones_plates
When we were gearing up to do Pirates 2, we had a bunch of problems to solve. One of them was, we knew we needed to do body motion capture on location, which is something we at ILM had not done before. We needed to do it in jungles and on ships at sea and on sets, because we didn’t want to capture Bill Nighy’s performance separately on a motion capture stage. We wanted him there with the other actors. And then we had Davy Jones’ beard, which was a massive problem. It’s probably the single most difficult thing we had to do on the show. So, we decided not to tackle facial motion capture, but we opted instead to shoot Bill on-set in a motion capture suit – what we called iMocap are is our version of on-set motion capture.
DavyJones_final
So, we’d filmed him and then the animators would just study the footage of face and keyframe animate Davey’s face. The thing is, it wasn’t just a mechanical process of saying, ‘Oh well this, you know, the mouth corner moved this much, so we’ll move our mouth corner that much.’ You really had to look at it and try and figure out what his intention was as an actor. Sometimes that’s a bit like tasting a stew and trying to figure out what they put in it. When an actor is doing something really subtle and there’s no subtext, really teasing that out and getting it right as you transform it, because that’s the other thing, is it wasn’t a one to one transfer. I mean, if Bill got angry and flared his nostrils, well, Davey doesn’t have a nose. So we had to find other ways to communicate certain things. So there was a translation that had to happen, but the intent was always to preserve exactly what Bill had done and communicate that faithfully.
Warcraft2_capture
On Warcraft, it was definitely our impression that at least some of the actors who had done shows before where they were creating characters using motion capture, that they seemed to have the impression that that was all good and everything, but ultimately later on the visual effects crew was going to just bulldoze over that with animation and obliterate it and kind of do their own thing. So we did a test pretty quickly, just a few weeks into principal photography where we took some early phase capture of Robert Kazinsky and transferred it onto Orgrim.
Warcraft2_final
Even though our Orgrim asset wasn’t quite finished yet, we got a nice looking render with some nice lighting and we took that back to set on a laptop and just went around and showed it to the actors to say, ‘Look, what you’re doing on set is gold and we are going to treat it with kid gloves because the whole idea is to get that from a to b – you will see yourselves in these characters at the end of the process. And I think it was a great comfort to them. I think they felt that was great, like, ‘It actually matters what I do on camera.’
RogueOne_Tarkin_capture
With Rogue One and Tarkin, the actor having passed away introduces a very difficult thing that I don’t think we have all the answers for in terms of our technology and our processes. Because the very hardest thing from my point of view on it was, well, we had a terrific actor – Guy Henry. But Guy doesn’t use his face the way Peter Cushing uses his face. We all use our face differently. He doesn’t smile like him. He doesn’t form the phonemes the same. So while we could get a great performance from Guy and we could apply that to Tarkin and get a realistic looking movement, it lacked Tarkin’s likeness. We had high realism, but we had problems with likeness. It looked like Peter Cushing’s cousin or something. So we’d have to then adjust the motion to the face. The animation team would have to adjust it – if he did a smile, say, to get it to look like a Tarkin smile or a Peter Cushing smile.
RogueOne_Tarkin_final
The problem was if you messed with it too much, of course it would start to feel like you’ve messed with it. It’s very easy to break capture. Even body capture people who’ve worked with it know that it’s sort of an interconnected web of motions. And if you just tweak the hips a little or move this a little, you can break stuff pretty quickly and it starts to look weird and Frankenstein’d together. So we had to find a line. We were trying to chase realism, but we’re also trying to chase likeness. And sometimes we had the sacrifice likeness a little bit to keep it feeling real and it would be a little less Cushing because we just didn’t want to push the motion around that much.
null
We didn’t do facial capture with K-2SO on Rogue One, but Alan Tudyk’s performance, his comic timing, every little choice of how he moved his head and the delivery of his lines – we never messed with his timing. We had to fit the body capture to K-2SO and his posture and everything, but, again, the whole job there was to preserve what Alan had done, not to change what he’d done, especially his timing. We never messed with his time. It was perfect comedy gold.
RogueOne_K2SO
Actors are still at the heart of the process. They’re the foundation on which we build everything else. To me that’s kind of exciting. It’s funny because when motion capture was first coming onto the scene in visual effects, there were a lot of animators who were afraid of it because it took away some of their creative authorship over the work and I think they assumed that pretty soon just everything would be done with motion capture. But in fact it’s provided us with some really creative interesting tasks to build characters where we’re partnering with an actor.

SIGGRAPH Asia in Tokyo: a sneak peek at the VFX talks

siggraphasia

It’s not long now until SIGGRAPH Asia hits Tokyo. The computer graphics event begins December 4th, and runs at the Tokyo International Forum until December 7th.

SIGGRAPH Asia will have some fantastic talks, papers, displays and experiences for attendees. vfxblog will be there, and I highly recommend signing up now. You can find out more about how to do that right here.

Meanwhile, vfxblog has secured a special sneak preview of some of the VFX and animation-related talks that will be held at SIGGRAPH Asia. These feature some of the biggest studios around, including ILM, Pixar and Weta Digital. Check out the details below.

From Gollum to Thanos: Characters at Weta Digital

ata_1500_pubStill_raw4k_v222.1267

Of course, Weta Digital is another major player in the visual effects world, and they continue to stun audiences with photoreal and emotional performances. VFX supervisor Matt Aitken, who helped bring Thanos to life for Avengers: Infinity War, will run-down how Weta Digital continues to innovate on CG characters.

Production Session by Pixar

INCREDIBLES 2

There’s more to CG animated film than just animation, and that’s something that will be explored by Pixar Director of Photography Erik Smitt, who recently worked on Incredibles 2. He’ll break down the lighting and camera work in the film and give an overview of how Pixar managed to make this incredible sequel to the original film.

The History of VFX at ILM from Jurassic Park to Ready Player One

the-lost-world-jurassic-park-san-diego

ILM is a name synonymous with visual effects – the studio has been in existence for more than 40 years. Which is why this presentation from Nigel Sumner, Creative Director, ILM Singapore and Nico Delbecq, Effects Supervisor, ILM Singapore, is a must-see, because it will show all sorts of imagery and give all kinds of details from ILM projects over the years.

Behind the scenes of Solo: A Star Wars Story

Solo3

Nigel Sumner, Creative Director, ILM Singapore and Atsushi Kojima, Lead Animator, ILM Singapore, will talk through ILM’s visual effects for the latest Star Wars film, including how a lot of the work included old-school fx techniques combined with the latest in computer graphics and compositing.

Beyond the Uncanny Valley: Creating Realistic Virtual Humans in the 21st Century

Digital humans are currently one of the holy grails of VFX, and they’re also a big part of VR/AR and gaming developments in recent times. Several experts will weigh-in on where we are at in relation to the crafting of virtual beings:
– Christophe Hery, Senior Scientist, Pixar Animation Studios
– Hiroshi Ishiguro, Professor, Director of the Intelligent Robotics Laboratory, Department of Systems Innovation, Graduate School of Engineering Science, Osaka University
– Matt Aitken, Visual Effects Supervisor, Weta Digital Ltd
– Prasert “Sun” Prasertvithyakarn , Senior Game Designer, Luminous Production
– Erik Smitt, Director of Photography, Pixar Animation Studios

Hope to see you in Tokyo, and keep an eye out on vfxblog for more SIGGRAPH Asia previews!

Come for the VIEW, stay for the workshops and masterclasses

troy-saliba-backing_feature

Here at vfxblog, we’ve already previewed a bunch of great talks set to happen at the VIEW conference in Turin, which takes place 22-26 October. But there’s also a wealth of workshops and masterclasses on offer during the event. Here’s our top five:

1. Designing the Monster

In this masterclass, ILM animation supervisor Glen McIntosh will dive into the creation of the main new dinosaur in Jurassic World: Fallen Kingdom. Glen is a stunning speaker, and some of the coolest things he tends to show are his own little character explorations and sketches.

2. A Graphic Look at Animation Posing and Staging

DNEG animation director Troy Saliba, who has just come off Venom, will share in this workshop the idea of the visual language of posing an animated character. This is a really practical workshop for artists looking to get into animation, straight from a professional.

3. NUKE Compositing

Hugo Guerra is a serious NUKE expert and he’ll run through in this masterclass a whole bunch of things that will help you make a good VFX shot become outstanding. Hugo is a fantastic demo artist, it’s really fun following along with him.

4. Masterclass in immersive sound

The diverse kinds of things you can takeaway from VIEW is kind of insane. In this masterclass you’ll learn about immersive sound from Gianni Ricciardi and Matteo Milani, who are experts in what’s required for VR and 360 degree sound.

5. Business pitches

The business pitches, happening right before VIEW kicks off on Sunday 21 October, are a little different to the workshops and masterclasses, but still incredibly practical in nature. One of them will detail how to deliver a business pitch, thanks to a number of game venture capitalists. And the other is with PDI founder Glenn Entis. Keep an eye out on the website for more details on these.

Follow the links for each masterclass or workshop above to find out more, and to find out how to buy tickets for the whole event or just each masterclass or workshop.

Solo’s old-school hyperspace jump

Solo4

A new clip promoting Solo’s Blu-ray release is out, and it showcases the old-school techniques used to realise the hyperspace sequences on the Millennium Falcon. It includes a description of the technique by ILM’s Rob Bredow. Check out the clip below.