SONY 3D CREATOR BRINGS SENSOR-LESS 3D SCANNING TO CONSUMERS

SONY 3D CREATOR BRINGS SENSOR-LESS 3D SCANNING TO CONSUMERS

I have always believed that brining 3D to consumers could only work without the need for dedicated depth sensors. This pure-software approach is already being embraced for Augmented Reality with Apple’s upcoming ARKit and Google’s ARCore which was announced last week. Both can give modern smartphones AR-capabilities by just using the regular camera(s), instead of using dedicated sensors like Tango.

But those efforts mainly focus on viewing 3D content. What about capturing reality in 3D? Microsoft showed an impressive 3D Capture demo last year but it’s unclear when that cross-platform app will ever see the daylight.

But yesterday, at IFA Berlin, Sony announced its latest smartphone, the XZ1. Which has all the bells and whistles you expect from a flagship Android phone but also an app called 3D Creator. It basically does exactly what Microsoft showed last year, but is actually available — albeit exclusive for the XZ1.

It focuses on scanning faces for now, which is becoming increasingly popular for use as personalized avatars in games and VR/AR applications. Scanning looks like this:

So it’s actually Mobile Photogrammetry technology, accelerated by real-time feature tracking and progress guidance — both very needed to introduce newcomers to 3D scanning. This is not a new approach since it’s present in the TRNIO 3D scanning App for iOS and a tech demo from Seene which was acquired by the developer of SnapChat last year.

But it’s the first time this technology is really made available to consumers, complete with a dedicated product page about 3D capture instead of the strict AR-focus we’ve seen with other brands and devices — I like.

Keep in mind though that the “High-Resolution 3D Images” promised on that website relate to the textures shot with the XZ1’s 19MBP Motion Eye camera, which are overlayed over low-poly geometry. I found this example on Sketchfab which shows the result in non-marketing-video circumstances. It’s apparently captured with Sony’s lower-end XA1 phone, which could mean 3D Creator will be available on more devices.

 You can put the embed above in MatCap render mode (by using the gear icon) to see the geometry. As you can see it’s pretty basic but that doesn’t really matter. Actually, for purposed like 3D avatars low-poly geometry increases compatibility with mobile 3D games and mobile VR/AR applications.

Personally though, I was hoping for a little bit more geometric detail, which would have made the 3D models usable for more purposes.

Courtesy of Sony

On the bright side, when Sony designs consumer solutions they always look good and are easy to use which is a lot more important than scan quality for brining 3D capture to the masses.

Sony does promote the option to be able to order full color standstone 3D prints from your scans. This is fun as you can see below it can also be a bit creepy:

Courtesy of Sony

But luckily the app also allows users to directly share their scans on social media and Sketchfab, the service I use to show all 3D content on this website. As you can see below, Sketchfab’s CEO is very happy with this feature:

 The Sony Xperia XZ1 will be available in the US on September 19th and the XZ1 Compact on October 4th. I’ve reached out to Sony for a review model of the XZ1 and hope to be able to review it for you when I’m back from a well-deserved holiday in Greece.

Resource: 3D Scan Expert

 

Leave a reply

About The Author

Christiana Polycarpou

Communication Associate

Upcoming Events

Mar
26
Tue
all-day Industry meets IT – VR/AR applic... @ CINIQ / Smart Data Forum Fraunhofer HHI
Industry meets IT – VR/AR applic... @ CINIQ / Smart Data Forum Fraunhofer HHI
Mar 26 all-day
Roadshow “Industry meets IT” We cordially invite you to the third stop of our roadshow “Industry meets IT – VR/AR applications for industry” on 26.03.2019. Venue is the CINIQ Center/Smart Data Forum at the Fraunhofer[...]
all-day Industry meets IT – VR/AR Applic... @ CINIQ / Smart Data Forum Fraunhofer HHI
Industry meets IT – VR/AR Applic... @ CINIQ / Smart Data Forum Fraunhofer HHI
Mar 26 all-day
We cordially invite you to the third stop of our roadshow “Industry meets IT – VR/AR applications for industry” on 26.03.2019. Venue is the CINIQ Center/Smart Data Forum at the Fraunhofer Heinrich Hertz Institute. With the[...]
Apr
2
Tue
all-day MW19 Conference News for Businesses
MW19 Conference News for Businesses
Apr 2 – Apr 6 all-day
Want new clients and fresh leads in 2019? From April 2-6, 2019, hundreds of cultural-sector leaders will gather in Boston, USA, for MW19. How will you and your business stand out? Here are some channels[...]
Apr
6
Sat
all-day Coding Da Vinci Süd 2019 – Kick ... @ Münchner Stadtbibliothek Am Gasteig
Coding Da Vinci Süd 2019 – Kick ... @ Münchner Stadtbibliothek Am Gasteig
Apr 6 – Apr 7 all-day
What is Coding da Vinci? At Coding da Vinci, you develop a project using at least one data set from Coding da Vinci’s data-giving cultural institutions in a team that is formed locally or expanded[...]
Apr
10
Wed
15:00 VRX Conference & Expo @ Novotel Amsterdam City
VRX Conference & Expo @ Novotel Amsterdam City
Apr 10 @ 15:00 – Apr 11 @ 16:00
 
May
8
Wed
all-day 2+3D Photography – Practice and ... @ Rijksmuseum
2+3D Photography – Practice and ... @ Rijksmuseum
May 8 – May 10 all-day
2+3D Photography – Practice and Prophecies - 2019 @ Rijksmuseum
The Rijksmuseum and the Association for Historical and Fine Art Photography (AHFAP) present the third 2and3D Photography conference, 8-10 May 2019. The second edition of the 2and3D Photography conference in 2017 demonstrated how important it[...]
May
14
Tue
all-day Archiving 2019 – Digitization, P... @ Arquivo Nacional da Torre do Tombo
Archiving 2019 – Digitization, P... @ Arquivo Nacional da Torre do Tombo
May 14 – May 17 all-day
Archiving 2019 Keynote speakers: Jean-Yves Le Meur, CERN, Digital Memory project leader (Switzerland): CERN’s Digital Memory: When Patrimony Data Meets Scientific Data David Taubman, UNSW Sydney, School of Electrical Engineering and Telecommunications, Deputy Head of School (Research),[...]

Privacy Policy
REGISTER NOW!