3D Body Scans for Garage Magazine Augmented Reality App

Behind the Work: Garage Magazine Augmented Reality App

/0 Comments/in , /by

With New York Fashion Week FW15 in high gear, SCANable got in on the action with a dream assignment collaborating with The Mill, Garage Magazine, renowned makeup artist Pat McGrath, photographer Phil Poynter and Beats by Dre to bring February’s cover models to life through Garage’s smart phone app.

Source: Mill Blog
Garage Magazine Nº8 features cover models: Cara Delevingne, Kendall Jenner, Lara Stone, Binx Walton and Joan Smalls. Each model was rendered in a way that blends the magic touch of Pat McGrath and the technical skills of The Mill team. When the covers are viewed using the GARAGE Mag app, each of the cover stars literally jump out of the page as a 3D rendition and animation, using augmented reality to explore the intersection of print and digital.

‪The Covers

Led by The Mill creative director Andreas Berner, the brief was to create five different covers, each featuring a supermodel wearing a colorful set of Beats by Dre headphones. Each model was treated with a pure CG interpretation of various elements inspired by original Pat McGrath’s make up designs: android mask, graphite scribbles, shrink wrap, crystals, and smoke elements.

GARAGE Nº8

GARAGE Nº8

Cara Delevingne: Android Mask

Cara’s look was inspired by Pat McGrath’s make-up for the Spring/Summer Alexander McQueen show. Once the app is activated, segments of blue armor animate from behind her head and create an android effect.

Kendall Jenner: Graphite Scribbles

Kendall is taken over by a mesh of stone 3D graphite that swoops over her whole body and face until it engulfs her in delicate body armor. The animation is the shape of her silhouette, creating the effect that both she and the headphones are immersed in a cage of lines.

Lara Stone: Shrink Wrap

Lara appears in airtight shrink-wrap plastic, creating a smooth and almost liquid looking cover. As Lara’s head emerges from the page, the rich color tone of the headphones begins to take over and envelope her completely back into the cover.

Binx Walton: Crystals

The animation appears in midair, organically building from crystals and facets  to create a 3D crystal bust. The tiny delicate sharp crystals appear in a mask shape, gradually taking over so she is fully covered. The look is inspired by McGrath’s makeup from the Givenchy Spring/Summer 2014 show.

Joan Smalls: Smoke

Joan’s look is inspired by the movement of a smoke electric storm and the northern lights. Joan emerges from the page to the sound of her taking a deep breath. Purple smoke FX continues to build and swirl around her three dimensional head.

The Process

The idea was that each model would be a breathing, living organism consumed by the nature of the VFX. After Phil shot the models with bare makeup, SCANable captured a 3D scan on-set to generate full body CG models for post production. This allowed The Mill’s 3D team, led by Raymond Leung, to retouch and create geometry for the app.

The Mill design team then outlined the designs on top of the retouched photographs with style frames. After a final cropping & editing session with Phil, the high res prints were sent to press.

Binx Walton: Crystals

Binx Walton: Crystals

The next step was to convert the ideas from the print component into the AR app. Garage Magazine had previously teamed up with artist Jeff Koons, creating a cover where, when using the Garage app, viewers were able to walk around a virtual sculpture. The Mill team pushed the technology further for Issue Nº8 with animation, sound and additional elements.

For the app execution, in-house 2D and 3D tools were used to create FX simulations, animations and final composites. Many of the initial ideas were limited by the technology used in real-time applications and a lack of processing power, which meant the team needed to get creative.

Lara Stone: Shrink Wrap

Lara Stone: Shrink Wrap

Kendall’s effect was particularly challenging as her execution utilized disciplines across the CG department. We were up against resolution restrictions within the technology. Each strand grown was a culmination of particle effects, animation, texturing, modeling and lighting. But with some clever ingenuity, and an indication process of constant testing, updating, and retesting, her incredible look was achieved. This was the approach taken for the look of each of the models.

Kendall Jenner: Graphite Scribbles

Kendall Jenner: Graphite Scribbles

Unique music scores by Alex Da Kid and sound FX by Finger Music were incorporated to accompany each execution, building an even stronger interactive experience. The last step was integrating all finished animations into the actual app, done by Meiré & Meiré.

This issue of Garage is currently on stands and available for purchase online. You can download the app here and watch these beauties come to life.

ILM Hulk Avengers Mark Ruffalo as the Hulk in "The Avengers," courtesy of Marvel Films.

How ILM Used Laser Scanning to Give Life to the Hulk in Marvel’s The Avengers

/0 Comments/in , , /by

Industrial Light & Magic, a division of Lucasfilm Ltd. and now owned by The Walt Disney Company, forever changed the way movies are made and how we as the viewer experience them. The movie-making geniuses have continually raised the bar in computer-generated imagery (CGI) and visual effects (VFX) year after year since the company’s founding by George Lucas in May of 1975. Released today, ILM takes us behind the scenes to show us how they used laser scanning and other tools to transform Mark Ruffalo into the lovable Hulk character that almost stole the show in Marvel’s third highest-grossing film of all time, The Avengers.

Check out more ILM movie magic on their YouTube channel.

Microsoft Unknowingly Revolutionizes

Microsoft Unknowingly Revolutionizes the 3D Imaging Industry [Kinect]

/1 Comment/in , /by

Being the bleeding edge technology geeks that we are here at SCANable, we have been closely following Microsoft’s adoption of Israeli developer PrimeSense’s controller-less motion capture technology which interprets 3D scene information from a continuously-projected infrared structured light. Now released as the Kinect for Xbox 360, or simply Kinect (originally known by the code name Project Natal), defined as a “controller-free gaming and entertainment experience” by Microsoft for the Xbox 360 video game platform, and may later be officially supported by PCs. Based around a webcam-style add-on peripheral for the Xbox 360 console, it enables users to control and interact with the Xbox 360 without the need to touch a game controller, through a natural user interface using gestures, spoken commands, or presented objects and images. The project is aimed at broadening the Xbox 360’s audience beyond its typical gamer base. Kinect competes with the Wii Remote with Wii MotionPlus and PlayStation Move motion control systems for the Wii and PlayStation 3 home consoles, respectively.

Weeks before the Kinect was officially released, the hacking community was hard at work digging through this revolutionary hardware in order to test the true limits of its capabilities. There was even a bounty of $3,000 offered by development company “Adafruit” to obtain an open-source driver. A mere two days after the bounty was announced, that goal had already been reached — this according to an email Adafruit’s Phillip Torrone sent Gizmodo. Drivers have been available for Mac and Linux for a couple of weeks, but there are now working drivers for Windows for which we have successfully tested here at SCANable. Our early assessment has indicated that this inexpensive device is actually capable of  much more than just a game controller. To our amazement, we discovered that it continuously captures 3d point cloud data of everything in your living room/game room. By tapping into the Kinect with a PC (Mac, Linux or Windows), we were able to gain full access to this multi-purpose 4-dimensional data with the ability to freely move around the feed in real-time. Using the OpenKinect drivers and basic viewing software, we were even able to set cut-planes which gave us the ability to isolate the moving object in the scene and view this data as colored depth ranges or true RGB color generated by the units embedded camera.

Drivers:
Kinect drivers for Windows can be found here.
Drivers for Mac and Linux can be found here.

The possibilities of this technology are tremendous. We see a near future where we can navigate through a point cloud dataset or virtual 3D model using simple hand gestures (see Evoluce’s example below). Imagine being able to digitally record “true” 3D video and having the ability to easily remove data at certain depths instead of by color eliminating typical green screen procedures. Even better, what if you strapped one of these bad boys onto a robotic vacuum and used it to remotely capture 3D data of interior spaces. Think we are crazy? Keep reading…

How does it work?
Wired has a great article about!

Canesta-Howitworks1

Examples:

We have compiled several of the best videos of the Kinect in-use. Check them out and be sure to post comments below. We all are masters of manipulating point cloud data, let’s pull together our resources and expertise and come up with some great applications for this affordable technology!

Evoluce, one of the leading manufacturers of high-quality multi-touch and gesture computing displays, demonstrates the future of how we interact with our computers.

MIT early experiments with a Microsoft Kinect depth camera on a mobile robot base. Say hello to KinectBot. Is this the indoor mobile mapping solution we have been waiting for?

Kinect-style device used to map the interior of a building:

For the launch of Xbox Kinect in Germany, seeper created an interactive projection mapping. Set at the highly visible Stachus in central Munich, this project attracted hoards of participants. Immersed in the experience, users took part in epic particle ball games, sending fluids shooting three stories high. Together with guests, including Sylvie van der Vaart, we explored the limits of controller free gaming!

Kinect used for real-time lightsaber:

What are your thoughts about this revolutionary device? Be sure to leave your comments and feedback below. Also be sure to check back here over the coming weeks for new updates!

leica law enforcement

Leica Geosystems launches a dedicated forensics program for law enforcement

/0 Comments/in , , , /by

Leica Geosystems launches a dedicated forensics program for law enforcement at this year’s worldwide 3D laser scanning conference.

As part of its eighth annual Worldwide User Conference devoted to 3D laser scanning in San  Ramon, California, USA (near San Francisco), Leica Geosystems successfully launched a program devoted specifically to the law enforcement and public safety community.  The event drew law enforcement agencies and forensic professionals from around the United States and the world over a four day period October 24-27, 2010.

Of special interest was the seven-hour “live fire” shooting reconstruction workshop titled “3D Laser Scanning of Shooting Scenes and Trajectories” taught by Mike Haag of the Albuquerque Police Department’s Major Crime Scene Team.   Mr. Haag has used the Leica ScanStation on dozens of cases for shooting reconstruction and he is a Distinguished Member of the Association of Firearms and Tool Mark Examiners.   Over 30 law enforcement professionals attended this class on a very rainy and wet Sunday at the Contra Costa County Sheriff’s Department who provided their facility.  The weather didn’t inhibit the operation of the Leica ScanStation C10 or the enthusiasm of the class which learned the fundamentals and best practices of shooting incident reconstruction and trajectory measurement using 3D laser scanning.

The Leica Geosystems ScanStation C10 is an easy-to-use, compact and portable 3D laser scanner that measure 3.5 million points at a scene in less than two minutes in any lighting conditions.  The system does not require any special eye protection when used, is robust and captures the leveled survey-quality data required for accurate crime scene reconstruction and analysis.

In recent years  many public safety agencies across a broad spectrum of law enforcement—County Sheriff’s departments, metropolitan police agencies and state investigative agencies—have acquired Leica ScanStations and now deploy them regularly for a wide range of tasks, including crime scene investigation,  officer involved shootings and threat assessments of buildings and other infrastructure.  Increasingly, criminal prosecutors are relying on compelling images and animations created with the system to present evidence to juries and to effectively counter the so-called “CSI effect.”

Dr. John DeHaan, of California-based Fire-Ex Forensics, Inc. an internationally recognized expert in his field and the author of Kirk’s Fire Investigation was the first speaker in the general session with a presentation titled “Documenting Fire and Explosion Scenes with Leica ScanStation Technology.” After guiding the audience through multiple cases including a home destroyed by a gas leak and an ambulance (VBIED) rigged with an explosive device as a test exercise Dr. DeHaan itemized 11 significant benefits and advantages of Leica’s ScanStation technology over other methods.

“Based on the recent, extremely rapid uptake of HDS for forensics and homeland security applications,” explained Tony Grissim, Leica Geosystems Public Safety and Forensic Accounts Manager, “the launch of a dedicated law enforcement track at this year’s conference demonstrates how seriously Leica Geosystems is committed to serving the needs of the law enforcement community.”  Grissim added that portions of the program were recorded and will be available on Leica’s forensic web site at www.leica-geosystems.com/us/forensic

Leica Geosystems—when it has to be right.

With close to 200 years of pioneering solutions to measure the world, Leica Geosystems is trusted by professionals worldwide to help them capture, analyze and present spatial information. The company is best known for its broad array of products that accurately capture, model quickly, analyze easily, visualize and present spatial information. Based in Heerbrugg, Switzerland, Leica Geosystems is a global company with tens of thousands of customers supported by more than 3,500 employees in 28 countries and hundreds of partners located in more than 120 countries. Leica Geosystems is part of the Hexagon Group, Sweden.

To view this release on the web please click here

http://www.leica-geosystems.us/forensic/press_18.html

For further information regarding the use of HDS for Accident Investigation contact:

Frank J. Hahnel, III
Accident Investigation Account Manager
Leica Geosystems Inc.
407.421.0873 phone
frank.hahnel@lgshds.com
www.lgshds.com
www.leica-geosystems.us/forensic

Leica HDS worldwide user conference

Leica Geosystems 2010 HDS Worldwide User Conference – Day 1

/0 Comments/in , , , , , /by

The conference kicked off this morning with some great presentations including a live preview of Cyclone 7.2 and its new pcE high speed visualization engine.

Some of the more interesting presentations today also included:

– Explosion Dynamics Research/Forensic Investigations using HDS, presented bu Dr. John DeHaan, FireEx Forensics
– Ken Smerz, Kovach Construction/Precision 3D Scanning, gave an excellent presentation on the benefits of laser scanning for the precise fabrication of complex wall systems.
– Alan Barrow, ABA Surveying, showed how he is using 3 HDS6000’s, a LandINS IMU and Javad GNSS mounted on the back of a van for near survey-grade mobile scanning.
– Luncheon keynote updating us on the status of the Mt. Rushmore CyArk project was given by Liz Lee and Doug Pritchard. They showed some remarkable images of the project.
– Zebra Imaging is displaying their latest high-resolution, full-color holographic prints in their booth. They have some great examples of full-color point clouds and detailed Building Information Models.

The day ended with a great social evening of food and bocce at Campo di Bocce Ristorante & Bar.

We are looking forward to more great presentations over the next couple of days. Be sure to follow us at www.twitter.com/scanable for live updates throughout the event.

Exploring Point-Based Rendering in Pixar’s RenderMan [Point Clouds]

/0 Comments/in , , /by

Creating animations of large point cloud datasets generated from terrestrial laser scanners and LiDAR has been an issue for a number of years. While it has been possible using tools such as Leica Geosystems Cyclone or Pointools, just to name a couple, it is still a very cumbersome task. It is exciting to see the CGI industry beginning to adopt the use of this data and developing applications that make it easier to visualize.

Over the last few years, a brand new technology has emerged for creating CGI effects that has already made a big impact on feature film production. It is called point-based rendering, and this powerful technique makes creating global illumination effects for feature film far more practical and efficient than before. In fact, this year the Academy of Motion Picture Art and Sciences awarded the creators of this innovation, Per Christensen, Michael Bunnell and Christophe Hery, with a Scientific and Engineering Academy award.

In this great article written by Nils O Sandys at CGSociety, we will look into the development of this important new technology, how point-based rendering works, and what this all means to the future of feature film production as we know it. Read the full article here.