I have always believed that brining 3D to consumers could only work without the need for dedicated depth sensors. This pure-software approach is already being embraced for Augmented Reality with Apple’s upcoming ARKit and Google’s ARCore which was announced last week. Both can give modern smartphones AR-capabilities by just using the regular camera(s), instead of using dedicated sensors like Tango.

But those efforts mainly focus on viewing 3D content. What about capturing reality in 3D? Microsoft showed an impressive 3D Capture demo last year but it’s unclear when that cross-platform app will ever see the daylight.

But yesterday, at IFA Berlin, Sony announced its latest smartphone, the XZ1. Which has all the bells and whistles you expect from a flagship Android phone but also an app called 3D Creator. It basically does exactly what Microsoft showed last year, but is actually available — albeit exclusive for the XZ1.

It focuses on scanning faces for now, which is becoming increasingly popular for use as personalized avatars in games and VR/AR applications. Scanning looks like this:

So it’s actually Mobile Photogrammetry technology, accelerated by real-time feature tracking and progress guidance — both very needed to introduce newcomers to 3D scanning. This is not a new approach since it’s present in the TRNIO 3D scanning App for iOS and a tech demo from Seene which was acquired by the developer of SnapChat last year.

But it’s the first time this technology is really made available to consumers, complete with a dedicated product page about 3D capture instead of the strict AR-focus we’ve seen with other brands and devices — I like.

Keep in mind though that the “High-Resolution 3D Images” promised on that website relate to the textures shot with the XZ1’s 19MBP Motion Eye camera, which are overlayed over low-poly geometry. I found this example on Sketchfab which shows the result in non-marketing-video circumstances. It’s apparently captured with Sony’s lower-end XA1 phone, which could mean 3D Creator will be available on more devices.

 You can put the embed above in MatCap render mode (by using the gear icon) to see the geometry. As you can see it’s pretty basic but that doesn’t really matter. Actually, for purposed like 3D avatars low-poly geometry increases compatibility with mobile 3D games and mobile VR/AR applications.

Personally though, I was hoping for a little bit more geometric detail, which would have made the 3D models usable for more purposes.

Courtesy of Sony

On the bright side, when Sony designs consumer solutions they always look good and are easy to use which is a lot more important than scan quality for brining 3D capture to the masses.

Sony does promote the option to be able to order full color standstone 3D prints from your scans. This is fun as you can see below it can also be a bit creepy:

Courtesy of Sony

But luckily the app also allows users to directly share their scans on social media and Sketchfab, the service I use to show all 3D content on this website. As you can see below, Sketchfab’s CEO is very happy with this feature:

 The Sony Xperia XZ1 will be available in the US on September 19th and the XZ1 Compact on October 4th. I’ve reached out to Sony for a review model of the XZ1 and hope to be able to review it for you when I’m back from a well-deserved holiday in Greece.

Resource: 3D Scan Expert


Leave a reply

About The Author

Christiana Polycarpou

Communicatios Officer

Upcoming Events

all-day 5th Hyperheritage International ... @ University of Constantine 3
5th Hyperheritage International ... @ University of Constantine 3
May 13 – May 15 all-day
5th Hyperheritage International Symposium : Heritage and experience design in the digital age Find out more details here
all-day International Museum Day
International Museum Day
May 18 all-day
International Museum Day 2018 The worldwide community of museums will celebrate International Museum Day on and around 18 May 2018. The theme chosen for 2018 is “Hyperconnected museums: New approaches, new publics“. The objective of[...]
all-day The 31st Conference In Computer ... @ Beijing
The 31st Conference In Computer ... @ Beijing
May 21 – May 23 all-day
The 31st Conference In Computer Animation and Social Agents-CASA2018 @ Beijing
About CASA 2018 The 31th International Conference on Computer Animation and Social Agents (CASA 2018) will be held on May 21-23, 2018 in Beijing, China. Beijing is the metropolitan capital of China, a modern and fashionable[...]
all-day TIME-BASED MEDIA ART CONSERVATIO... @ Institute of Fine Arts,
May 21 – May 22 all-day
TIME-BASED MEDIA ART CONSERVATION Symposium @ Institute of Fine Arts,
Time-Based Media (TBM) art conservation has been identified as a priority by many leading professional organizations worldwide due to rapidly growing TBM collections and the urgent need to preserve them. Aiming to solve the ever-increasing[...]
all-day 16th KUI Conference “Culture and... @ Berlin, Schloss Köpenick
16th KUI Conference “Culture and... @ Berlin, Schloss Köpenick
May 24 – May 25 all-day
The 16th edition of the ”Culture and Computer Science“ conference series brings into focus best practice examples, challenges and future trends in the fields of hybrid systems, augmented, mixed and virtual reality, 3D technology, data[...]
all-day VRTCH’18 – 1st International Con...
VRTCH’18 – 1st International Con...
May 29 – May 30 all-day
VRTCH’18 – 1st International Conference on VR Technologies in Cultural Heritage
The scope of the VRTCH’18 is to: Disseminate the findings of new research Train participants in various fields related to preserving cultural heritage through VR technologies Offer an environment in which participants interact and exchange[...]
all-day ISPRS Technical Symposium 2018 @ Riva del Garda
ISPRS Technical Symposium 2018 @ Riva del Garda
Jun 4 – Jun 7 all-day
ISPRS Technical Symposium 2018 @ Riva del Garda
ABOUT ISPRS Technical commission II “Photogrammetry” focuses, at various scales, on geometric, radiometric and multi-temporal aspects of image- and range-based 3D surveying and modeling. Specifically Commission II deals with image orientation, point cloud generation and[...]
all-day ‘Computer Graphics International...
‘Computer Graphics International...
Jun 11 – Jun 14 all-day
'Computer Graphics International'  - CGI2018
CGI’18 Computer Graphics International (CGI) is one of the oldest annual international conferences on computer graphics in the world. It is organized by the Computer Graphics Society (CGS). Researchers across the whole world are invited[...]
all-day Centre for Digital Heritage Annu... @ Lund University
Centre for Digital Heritage Annu... @ Lund University
Jun 18 – Jun 20 all-day
The Institute of Archaeology and Ancient History and the Digital Archaeology Laboratory (DARKLab) at the Joint Faculties of Humanities and Theology, Lund University will host the 2018 annual meeting of the Centre for Digital Heritage[...]