I planned on using Motion Capture data for my figurative animation but hit a few snags in that plan...
1, the Motion Capture room has been out of commission for some time. When we were told it was up and running again, a few of us went up to get some footage!
It wouldn't pick up data, however. It seems the cameras may have been pointed too low and they weren't able to collect enough data.
So we took some video footage to use!
Sadly, the cameras were recording at different frame rates, so when put into Max, they weren't synced up at all. Damn.
Zombie Reseach
Using the Zombie Survival Guide, I had some Physical information about Zombies which I used for acting as a zombie (in the above videos)
I also have a calendar themed on Zombies which give field notes from "Dr. Robert Twombly". Similar in style to what I got from the Zombie Survival Guide.
When I discovered that I couldn't really use the footage, I had to change my angle slightly. I planned on doing my animation in MotionBuilder (I find MB to be better for figurative animation) but the pipeline for taking a rigged character from Max in to MB, isn't as simple as from MB to Max. The way Max labels it's CAT rigs is different to how Motion Builder does it. To get it in to MB, I would have basically started rigging from scratch and renamed everything to the Motion Builder Pipeline. I didn't have enough time to do that, though, so I ended up having to use Max. I think Max is perfect for setting up controlled rigs and animating through that, for modelling environments. Interiors, props, things like that. But I prefer to animate within Motion Builder. It handles animation and motion capture data better, in my opinion. Besides, it's used in film and game for animation, where as Max isn't as much.
I did a Walk Cycle in Flash last year to use as motion reference for projects.
I turned to the other Survival book I have to help me with the motion research I would use for my final animations. The Animator's Survival Kit by Richard Williams.
The Milt Kahl walk/strut/skip. I tried to emulate this in my walk cycle. It makes fantastic use of Squash/Stretch, arcs, timing and spacing to name but three. It results in a fantastically cartoon-y walk. You see this kind of strut in a lot of Disney films. I found it difficult to emulate in 3D, but I would like to try this walk more.
This image was my reference for the arcing, trailing hands and arms for the walk. I would really like to have more time to really nail this as it can look fantastic when done right.
These screen shots show how I went about the Milt Kahl walk.
The use of "broken" joints gives the character a little elasticity in his movements and really helps exaggerate his happy walking.
I also went to make a Sneak cycle. This uses a lot of weight and balance to get right and make convincing. The lead foot connects to the ground ALWAYS at a point, where as the trailing foot leaves arched.
Sneak Contact #1
Sneak Passing Position
Sneak Contact #2
I tried to get a zombie walk made, too, but I was not impressed with the final result. There is a lot to keep track of when the character is dragging his foot like this. His balance and transference of weight is completely different to a normal walk.
When I tried making this walk/shuffle and I was adjusting the curves to remove some of the jumpy movements.
I used this video to help with my Jump animation:
https://www.youtube.com/watch?v=oiWoesDEXmU (I cannot find it on the Videos From Youtube searcher on my blog)
Some of the curve editing I had to fix on the Jump and landing portion. I used Easing extensively to give that explosive action.
Using Zbrush to edit the Ape Man model was, for me, a nightmare to start with. Once I FINALLY got to grips with the program, things started to fall back into place. For most of the targets, I used myself as reference, taking photos and working from them, but one of them was based from a chimpanzee.
The cheeks form part of the smile, but also as part of other expressions to some degree. The important part, I found, was getting the crush around the eyes right. Too much and the eyes would be shut, too little and it just wouldn't look right.
The Ape Man's nose flare is essential when making the character look either angry, annoyed or disgusted. This had the lips edited for maximum anger, if mixed with the eyebrows, or to show disdain.
Another reference shot, plus the final Ape Man result.
I thought I could improve upon the Eyebrows we were given, make them look more furious than they already did. I was sure to keep the furrow in the center of the brow. Mixed with the Nose flare/Lips, you get a really angry looking chap!
An "OO" styled mouth. This is used in both human speech and for Ape characters. I wanted to make sure the lips protruded enough to look convincing, so used multiple shots.
The eye above was a first attempt at it. After a couple attempts, I managed to make the final results. I couldn't find a way to flip the mesh in Zbrush, and when I mirrored the OBJ in Max, when I attached a slider, it would animate the Morpher flipping. Even when collapsing the stack to Editable Poly, it would continue to do it. In the end, I had to try my best to recreate the eye on either side.
Here is a comparison of my Custom Morph Target and the provided one for the Angry Eyebrows. My one (left) has a more severe angle, and the furrow in the middle really helps convey the anger.
I placed the Sliders in sections for easy use. Eyes/Brow on the top, Middle face in the middle, then mouths on the bottom.
After I finished placing all my targets onto the scene, I also made a list of which I made, as the provided morph targets would help with the animation.
Here two of the morph targets are imported into the scene, then added to the Main Rig's Morph Target list. After this was done, I would just hide the morph targets, then link the sliders to the main rig.
When programming the sliders, I found the easiest way involved adding *100 to the wiring. It became second nature to me to do this (or else the move would have been a tiny amount) and I couldn't get away with the alternate way we were shown.
The first two completed Morph Targets were the cheeks and the "OO" mouth. Here I rendered them one at a time, then together.
Using the image above as a base, I tried using a couple of the Morph Targets to make an angry Ape
This was before I had made my own Morph Targets, and was more for just getting used to animating with sliders.
This video shows my set up and shows the sliders directly affecting the rig.
Whilst preparing to animate the facial rig, I selected the sound file I would work from and imported the file into 3Ds Max
This is what I ended up with. I put this video on Youtube, and also sent it to a couple Animators I talk to through Facebook to get some critical feedback.
Stephen Brooks of Rubber Onion Animation (LINK) gave me this feedback. Once I have made this, I shall update this post.
With the feedback taken onboard, I went back and created this version. I think the cocky smile at the end is a great addition.
Really getting to grips with the Curve Editor. It often lets me down in the past, but I've really got behind it this semester in both Max and Motionbuilder. Once I got stuck in, it began to make sense to me more and more. I still have a long way to go to be perfectly comfortable in it, but it's a start!
A second review from Stephen Brooks on how to further the animation, and in some cases, step it back as there's a lot going on. Again, I will update this post as I continue.
Version 3 of the Lip Sync. Using the Curve editor, I smoothed out the "pop" on the mouth, which gave a nice Easing. The mouthing of "and" was removed (which, when looking at how I speak, "and what" are formed simultaneously.) The Eyebrows were removed from the end and the eyes opened up.
I then went and used myself as a reference instead of the Van Damme clip.
Version 4. It's nearly final! The only things I need to do to this is more of an "OO" on the mouth when he says "What" and a bit more easing on the final eye position.
Version 5, the final version. The wrinkles are ironed out and the brass is polished. A big thank you to Stephen Brooks who took time out of his schedule to give me pointers. Your help has really brought my work on in leaps and bounds.
Animator Rob Yulfo (LINK) was also asked to check my work. He liked it and was interested in how I made it.
I skinned the mesh to a CAT rig and weighted it appropriately
Using the CAT controls, I was then able to Keyframe animate the rig
Using the Curve Editor, I smoothed out any jerky movements.
I skinned the mesh to a CAT rig, then I animated the rig to give even more character.
Stephen Brooks agreed with the edits I had to make and had no further changes that he could spot.
Alan Thompson is a 3D modeller who makes models to enhance PC games, from weapons to characters. He, as of posting, doesn't have a website.
As I really enjoyed the Morph Target facial animation, Alan pointed me in the direction of a book he used in his Dissertation, Paul Elkman - Unmasking The Face. I would like to do more facial animation in the future, so this book will come in handy. Thanks, Alan!
A friend of mine who studied Architecture in at Uni asked if I would like to use Vray as my renderer! So I gave it a shot! It took about 40 minutes to render on default settings with Vray.
I did a test on High Quality and it was going to take more time that I'd want to spend on a low poly mesh which has no texture.
Instead I opted for Mental Ray. This still took almost 2 hours to render (and it's only a couple seconds. This clip is repeated for ease of viewing). It is on High Quality. I opted to stick with Mental Ray for this render, as the time difference and the image quality for Vray was not worth it. If I was doing a 3D environment, Vray would be the way I'd go, but for a low poly mesh and strict time constraints, I'll be taking Mental Ray this time.
Lip Syncing is something I've had trouble with since I started animating in Flash in High School. It was always getting the timing right that would make it or break it.
I have two excellent points of reference.
Rubber Onion have a couple "Tip in a minute" videos on Youtube and he tells you everything you need to know in that one minute. Key points are form the shape of the mouth a few frames before they say it. As Brooks says, "Think See it before you hear it"
Richard Williams has a great section on Dialogue in the Animator's Survival Kit, breaking down through the phrasing and how to set it up on a dope sheet. The interesting thing I found on the Dope Sheet example was how he broke the words down on it into the sounds, rather than the spelling. In his example "I'll slip into..." the Dope Sheet reads, "I-LL-S-L-E-P-E-N-T-EH"
This makes for the character's accent and makes it clear which mouth shape you need to use.
It's just a little thing, but it's something that I had never thought of!
Bone Rig Facial Animation
I found a couple videos of Youtube for the muscle structure rigging of the face. Although this is not how we have been shown how to set up the rig, it's good to keep this in mind.
http://www.youtube.com/watch?v=3Z0nbAm2HPw
http://www.youtube.com/watch?v=Xmz3oLrnzBw
They show great facial expressions.
Bone Rig facial animation.
I really did not enjoy this way of facial rigging. I didn't feel I had as good control over the rig. A few areas that I tried to skin, the nose, the cheeks, seemed to destroy the mesh. I had to leave those parts out as I could not get them to work, which really affected the final piece.
Having made the mouth in class, I moved on to the Eyebrows. Adding a bone from the skull, then resizing and aligning the bones in place.
I made three, then arched them around the eye. This would allow some good articulation on the eyebrow. The same was repeated on the opposite side, then they were skinned.
Using the Reaction Manager, I would link the slider to states, which would create the animations just by moving the sliders.
Sliders with the states set up.
MY FINDINGS FROM FACIAL ANIMATION
I found setting up bone structures to be a real pain and didn't allow me the control that the morph targets did. Any mistake in the animation resulted in having to redo sections from the animation layers which were time consuming, whereas the Morph Targets had their expressions pre made in Zbrush and were solely dependant on the sliders to deal with. I don't think the mesh was too helpful, either. the face seemed to have been smoothed right down. The Morph Target mesh could have possibly been a better choice. As time can be a large issue as deadlines loom, I think I could see myself using Morph Targets to do facial animation. I was just more comfortable with that pipeline and process than the bone structure.
MORE REFERENCE:
CAT rig facial animation part 1
https://www.youtube.com/watch?v=K-fLf45Z3JU
Part 2.1
https://www.youtube.com/watch?v=cnq0DmmoYgU
After watching these videos, I see that Bone Rigging, on a good looking model, can come together really nicely. If I was had to (or got the chance to remake this piece for my upload) do Bone Rigging again, I would follow this tutorial. (I really wish I had found these sooner).
I've been having problems using Zbrush. It's just all over my head and I need it to create new Morph Targets!
I found this tutorial series on Youtube which I hope can get me up to speed so I can get the facial rigging sorted. It's about to tick into Week 5.
http://www.youtube.com/watch?v=Ie4Od4eoh-U
The Motion Capture gear is in the middle of being repaired, so it's pushed me back a little in terms of getting my animation ready. I wanted to have it done by mid week, but I've not managed it. I'm now hoping to have it done by Thursday 6th March (for the Keyframed animation). I will be looking for some zombie stock Mocap footage, too, just to have a comparison.
I have noticed that I haven't uploaded my research into Zombie Movement, which I used as reference for my Keyframe guide footage (also needing uploaded), so I will be doing this this weekend.
Been working on the Storyboard for the 30 second Mocap/Keyframe interaction piece. For what I've got planned, I've ran it through in my head and it goes for just over 30 seconds. The main dance portion is 15 seconds!
I'm basing the dance from the Sophie Ellis-Bextor video for Murder On The Dancefloor, http://www.youtube.com/watch?v=BsISfQAXE60
The gentleman is going to be Keyframed and the female shall be Motion Capture data.
The initial setup for the dance is going to be in one take. The dance moves themselves shall be broken down into separate takes which I will piece together in Autodesk Motionbuilder.
The cup at the start will be a prop with a constraint, so that the female can hold it and drop it when needed.
I have learned to do this in a tutorial session where a model throws a hand grenade. I will be uploading a render of that soon.
I would like to have another interaction with a prop, but not sure where I can do that. Possibly extend the end of the piece and the female returns to the Refreshment table (from the start) and takes another drink?
I could then have extended the piece to maybe 40 seconds. The keyframe character would just watch as the female walks past him, leaving him behind.
Tomorrow I will be working a little more on the Storyboarding. On Thursday I will need to see my tutor, as I'm having an issue with cleaning up some Mocap data. It isn't allowing me to keyframe out mistakes! I will also be asking if the final piece will allow me to use cameras as my storyboard shows. If I can, the keyframe character will be a little easier to deal with (especially at the start of the clip. I'd be able to avoid animating him walking to the female, leaving more time to clean up data and focus on the keyframes elsewhere)
EDIT, 26/02/14
In the music video, the best example of the dance I will be recreating is in this link,
http://www.youtube.com/watch?feature=player_detailpage&v=Xn_hRh8AGNk#t=158
Time frame 2:38 onwards. There are less people on screen as Sophie was removed her competition through dirty tactics. Though the dance is relatively simple, it shows excellent use of arcs with the turning moves and even just the arm movements in the start of the dance.
I'll be drawing out the breakdown of the dance on paper then uploading it on here. The breakdown will be used as reference on the storyboard, but also for myself when Mocapping it, and the keyframe side of things for the other character.
Quick breakdown sketches of the dance moves performed in the video.Both the male and female characters do the same moves
EDIT, 22/03/14
Just about to upload my Performance Capture Wk7 Upload to Xstream now, so thought I'd share my finished Storyboards now.