At the recent Trojan Horse was a Unicorn event in Malta, I had the opportunity to sit down with ILM animation supervisor Hal Hickel for a THU TV interview.
We talked about the wealth of CG characters Hickel has overseen which began with live action and motion captured performances, including Davy Jones from the Pirates of the Caribbean films, the Orcs in Warcraft, and Tarkin and K-2SO in Rogue One (in which the original actor playing Tarkin, Peter Cushing, had in fact passed away).
Hickel (centre) gears up for the THU TV interview. Photo by John Crowcroft.
With before and after images from those films, here’s some of Hickel’s main takes on how he and his team tend to tackle a character where actor and animator need to combine to craft the final result.
When we were gearing up to do Pirates 2, we had a bunch of problems to solve. One of them was, we knew we needed to do body motion capture on location, which is something we at ILM had not done before. We needed to do it in jungles and on ships at sea and on sets, because we didn’t want to capture Bill Nighy’s performance separately on a motion capture stage. We wanted him there with the other actors. And then we had Davy Jones’ beard, which was a massive problem. It’s probably the single most difficult thing we had to do on the show. So, we decided not to tackle facial motion capture, but we opted instead to shoot Bill on-set in a motion capture suit – what we called iMocap are is our version of on-set motion capture.So, we’d filmed him and then the animators would just study the footage of face and keyframe animate Davey’s face. The thing is, it wasn’t just a mechanical process of saying, ‘Oh well this, you know, the mouth corner moved this much, so we’ll move our mouth corner that much.’ You really had to look at it and try and figure out what his intention was as an actor. Sometimes that’s a bit like tasting a stew and trying to figure out what they put in it. When an actor is doing something really subtle and there’s no subtext, really teasing that out and getting it right as you transform it, because that’s the other thing, is it wasn’t a one to one transfer. I mean, if Bill got angry and flared his nostrils, well, Davey doesn’t have a nose. So we had to find other ways to communicate certain things. So there was a translation that had to happen, but the intent was always to preserve exactly what Bill had done and communicate that faithfully.On Warcraft, it was definitely our impression that at least some of the actors who had done shows before where they were creating characters using motion capture, that they seemed to have the impression that that was all good and everything, but ultimately later on the visual effects crew was going to just bulldoze over that with animation and obliterate it and kind of do their own thing. So we did a test pretty quickly, just a few weeks into principal photography where we took some early phase capture of Robert Kazinsky and transferred it onto Orgrim.Even though our Orgrim asset wasn’t quite finished yet, we got a nice looking render with some nice lighting and we took that back to set on a laptop and just went around and showed it to the actors to say, ‘Look, what you’re doing on set is gold and we are going to treat it with kid gloves because the whole idea is to get that from a to b – you will see yourselves in these characters at the end of the process. And I think it was a great comfort to them. I think they felt that was great, like, ‘It actually matters what I do on camera.’With Rogue One and Tarkin, the actor having passed away introduces a very difficult thing that I don’t think we have all the answers for in terms of our technology and our processes. Because the very hardest thing from my point of view on it was, well, we had a terrific actor – Guy Henry. But Guy doesn’t use his face the way Peter Cushing uses his face. We all use our face differently. He doesn’t smile like him. He doesn’t form the phonemes the same. So while we could get a great performance from Guy and we could apply that to Tarkin and get a realistic looking movement, it lacked Tarkin’s likeness. We had high realism, but we had problems with likeness. It looked like Peter Cushing’s cousin or something. So we’d have to then adjust the motion to the face. The animation team would have to adjust it – if he did a smile, say, to get it to look like a Tarkin smile or a Peter Cushing smile.The problem was if you messed with it too much, of course it would start to feel like you’ve messed with it. It’s very easy to break capture. Even body capture people who’ve worked with it know that it’s sort of an interconnected web of motions. And if you just tweak the hips a little or move this a little, you can break stuff pretty quickly and it starts to look weird and Frankenstein’d together. So we had to find a line. We were trying to chase realism, but we’re also trying to chase likeness. And sometimes we had the sacrifice likeness a little bit to keep it feeling real and it would be a little less Cushing because we just didn’t want to push the motion around that much.We didn’t do facial capture with K-2SO on Rogue One, but Alan Tudyk’s performance, his comic timing, every little choice of how he moved his head and the delivery of his lines – we never messed with his timing. We had to fit the body capture to K-2SO and his posture and everything, but, again, the whole job there was to preserve what Alan had done, not to change what he’d done, especially his timing. We never messed with his time. It was perfect comedy gold.Actors are still at the heart of the process. They’re the foundation on which we build everything else. To me that’s kind of exciting. It’s funny because when motion capture was first coming onto the scene in visual effects, there were a lot of animators who were afraid of it because it took away some of their creative authorship over the work and I think they assumed that pretty soon just everything would be done with motion capture. But in fact it’s provided us with some really creative interesting tasks to build characters where we’re partnering with an actor.
I go to a few different VFX and animation industry events each year, but here’s a little secret about Trojan Horse was a Unicorn that I found out on the first day of the first year I went there: It is one of the only events designed to help artists find their place in the world.
What does that mean? Well, I think a lot of artists – young and old – are drawn to the industry (the industry being the areas of design, concept art, CG, visual effects or animation), but it’s one that can be hard to break into, and even stay in. A lot of the artists I met at that first Trojan Horse said they were ready to quit the industry, but after going to THU they found a new wave of inspiration, or a new side of their craft they hadn’t found before.
Perhaps you’re a VFX artist who feels the same way? Well, I would totally recommend considering going to Trojan Horse this year – September 24-29 – as a way of meeting new people, meeting experienced professionals and finding a way to find out more about yourself and your craft. What’s more, this year is – I think – super-heavy on the VFX side in terms of talks, masterclasses and recruiters (yes, a bunch of CG/VFX/animation studios will be there to talk jobs with attendees).
Oh, and this year it’s at a pretty incredible location: Valletta in Malta.
Just a few of the big VFX speakers at Trojan Horse in September are:
Dylan Cole, production designer on the Avatar sequels
Virginie Bourdin, concept artist
Geoffrey Baumann, visual effects supervisor for Black Panther
Hal Hickel, animation supervisor at ILM
Kelly Port, visual effects supervisor at Digital Domain
Matthew E. Butler, visual effects supervisor at Digital Domain
At Trojan Horse you get to hear from these speakers – called Knights – and you get to meet them face to face. Also, they don’t tend to present traditional talks about films and projects they’ve worked, but instead they often discuss their own journey in the industry. You might even find out they’ve also had a challenging time in VFX too, and how they got through it.
That’s what makes Trojan Horse the place for VFX inspiration.
2017 Golden Ticket Challenge winner Te Hu with the theme, THU Clans.
I’ve been a regular attendee at Trojan Horse Was a Unicorn for a few years now. Formerly in Portugal, THU is landing in Malta this year, and the location looks stunning.
What’s exciting is, you can enter the Golden Ticket Challenge art competition to get there yourself. There are two categories – student and professional – and winners will receive a ticket to THU, flights to Malta and 5-star accommodation. The first placed student also receives a Wacom mobile pro and a Lenovo mobile workstation.
So, what do you have to do?
To enter, you need to create a piece of artwork on a set theme, ‘Land of Wonder’, which is inspired by the new Malta location.
Submissions opened on May 14th and run until July 9th. Winners are announced on ArtStation – which is partnering with THU on the Golden Ticket Challenge – July 16th.
Oh, and how good does THU look already? On the VFX front, some of the speakers include ILM’s Hal Hickel, Black Panther vfx supe Geoffrey Baumann, DD’s Matthew Butler, vfx Leslie Ekker and more. And then there’s production designer Alex McDowell, director Jorge Gutierrez, and concept designer Ian McCaig. Seriously, amazing people.
THU takes place September 24-29, 2018 in Valletta, Malta.
I spend a lot of my working life looking for great visual effects, animation and CG content. There’s a lot out there. I’m of course drawn to making ofs and studio and film profiles, particularly about visual effects, but it wasn’t until last year that I discovered a new kind of VFX content.
That’s when I got to attend Trojan Horse was a Unicorn (full disclosure: they paid). It was a stunning event held in Troia, Portugal at a summer resort that mixed art, design, visual effects, 3D and filmmaking. Both professionals from the industry and artists at all levels attended. But what’s presented at Trojan Horse was not ‘making ofs’ or studio profiles. As good as those can be, Trojan Horse, or THU, is about a lot more. Continue reading “When you crave creative content”→
3D Artist Victor Hugo is one of the nice guys in the industry and I had the pleasure of meeting him last year at Trojan Horse was a Unicorn in Troia. Here he talks more about his thoughts on THU.
vfxblog 