An AR app returns stolen Gardner paintings to their frames

An AR app returns stolen Gardner paintings to their frames
Hacking the Heist’ superimposes the paintings using Apple’s ARKit
Cuseum

In the early hours of March 18th, 1990, two men dressed as police officers pulled up to a side entrance of the Isabella Stewart Gardner Museum in Boston. They claimed that they were responding to a report of a disturbance. A guard let them in, and 81 minutes later, the two thieves had absconded with thirteen works of art valued at over $500 million, cutting priceless paintings out of their frames.

The “Gardner heist,” as it’s come to be known, is one of the most famous art thefts in history. It’s also the biggest one that remains unsolved. Decades later, it still captures the public’s attention every time it’s in the news. Multiple books have been written about the case over the years; a true crime podcast called “Empty Frames” launched in February that aims to take a fresh look at all the evidence and perhaps eventually solve the case.

The empty frames still hang on the walls of the Gardner Museum, a potent and haunting reminder of what was lost in this theft. But now, a firm called Cuseum is using AR to restore these priceless pieces of art to the walls of the Gardner Museum — at least, digitally.

Cuseum works to make museums and other cultural institutions more accessible through the use of cutting-edge technology. One example is the ability to digitally guide visitors through spaces without a language barrier. “Imagine if museums could clone their best guide or docent, have them available 24/7, and with the ability to speak multiple languages,” Brendan Ciecko, the founder of Cuseum, explained to Engadget. “Our platform empowers museums to do that.”

Ciecko’s team had long been fascinated by the Gardner heist. “Recently, after testing some new prototypes at a local museum and showing my team the results, one of my colleagues suggested the idea of putting the stolen art back in the frames at the Gardner,” Ciecko said. “I was psyched to explore this concept further — the opportunity to explore something new, the technological challenge, and the idea of returning something to its rightful home. Additionally, Isabella Stewart Gardner was a true innovator of her time, and what better way to celebrate her pioneering spirit, and return her beloved collection back to its original state, even if only through a digital lens.”

“Hacking the Heist” is an independent passion project for the team at Cuseum. It wasn’t paid for by and is not affiliated with the Gardner Museum. The app that was developed using Apple’s ARKit. “Once Apple’s ARKit was released it marked a new chapter for app developers,” Ciecko explained. “Compared to other frameworks, the quality and stability was incredibly promising right from the start. With the latest release, ARKit 1.5, Apple introduced vertical surface detection and on-device image recognition, which were key components needed to make this project possible.”

The app isn’t publicly available yet — the Cuseum team is waiting for iOS 11.3, which supports this type of AR, to be released. Once it is, though, visitors to the museum with iOS devices will be able to download the app. Once they’ve pulled it up, they can aim their smartphone or tablet at the empty frames where these priceless paintings once hung. Through an imaginative use of AR, the app will fill in the blanks — quite literally. People will be able to see what the missing paintings looked like hanging on the walls of the Isabella Stewart Gardner Museum.

The app currently only covers two of the most popular missing paintings: “A Lady and Gentleman in Black” and “Christ in the Storm on the Sea of Galilee,” which were both painted by Rembrandt. The latter is his only known seascape. However, the team at Cuseum hopes to add more of the missing art in the future.

“Hacking the Heist” isn’t the only augmented reality project that Cuseum is working on, either. The company is developing more AR tools with multiple museums across North America to enhance visitor experiences. At the Perez Art Museum in Miami, the team at Cuseum recently helped launch both the first instance of ARKit in a museum, as well as the “world’s first fully AR-powered museum exhibition.” It features the works of Miami-based artist Felice Grodin and contains four digital works that examine the relationship between the mental and the physical.

It’s clear that augmented reality can affect and enhance the way we interact with museums and cultural institutions. With the Gardner Museum in particular, AR can educate visitors about the theft and help complete their experiences by “filling in” the paintings that are missing. “We hope people feel a deeper connection with the works that would have otherwise been hanging in the empty frames,” Ciecko concluded. “Many visitors are either unaware of the heist and its magnitude, or don’t know what the stolen masterpieces even looked like. We also hope this inspires people to think about the ways in which technology can show us things that no longer exist and transform the experience we have at those moments.”

https://www.engadget.com/2018/03/26/gardner-heist-stolen-paintings-arkit/

 

Comments are not currently available for this post.

About The Author

Eleni Kirioti

Eleni Kyrioti is an archaeologist and art historian and worked in field archaeology and galleries in Greece. She is also a Certified Creative and Cultural Sector projects' Specialist in Cultural Heritage. The Master Studies in Education of children with Special educational needs offered her the opportunity to observe how in museums and archaeological places these children can develop cognitive, social and creative skills. Her research interest also focus in Incluseum ( how museums can be more inclusive for all children) and technology applications in Culture and Education. Previously, she worked at the project «Digitization and Configuration Services for the Internet "of the Act" Enrichment of Digital Collections of Mobile Monuments of the Ministry of Culture and Sport in Greece and Development of a New Information System of the National Monument Archives». Additional, she was teaching Ancient and Modern Greek plus Latin for many years and was also collaborating with Educational Technology Companies as an educator – writer.

Upcoming Events

Oct
23
Tue
11:00 12th International Conference on... @ Panos Solomonides Cultural Centre
12th International Conference on... @ Panos Solomonides Cultural Centre
Oct 23 @ 11:00 – Oct 26 @ 17:15
12th International Conference on Metadata and Semantics Research @ Panos Solomonides Cultural Centre
The H2020 ViMM Project is actively involved with a paper presentation in the 12th MTSR Conference. The conference will take place from 23-26 October in Limassol, Cyprus.  For more information regarding the conference visit the[...]
Oct
24
Wed
all-day VR DAYS EUROPE 2018 @ DeLaMar Theatre (24 Oct), Kromhouthal (25-26 Oct)
VR DAYS EUROPE 2018 @ DeLaMar Theatre (24 Oct), Kromhouthal (25-26 Oct)
Oct 24 – Oct 26 all-day
VR Days Europe is a three-day conference and exhibition focussed on Virtual, Augmented and Mixed Reality (XR) content, creativity and innovation. At this year’s festival attendees can expect a compelling range of keynotes, sessions, workshops and seminars with[...]
Oct
29
Mon
all-day Culture Youth Forum @ Tamna Culture Square,
Culture Youth Forum @ Tamna Culture Square,
Oct 29 – Nov 4 all-day
Culture Youth Forum @ Tamna Culture Square,
Talented, self-reliant and dynamic local artists from Jeju (Republic of Korea) as well as international artists and architects who have interest in public space and work in any art media (photography, installations, drawing, ceramics, video,[...]
all-day 6th International Conference on ... @ Filoxenia Conference Centre
6th International Conference on ... @ Filoxenia Conference Centre
Oct 29 – Nov 3 all-day
6th International Conference on Cultural Heritage-EUROMED 2018 @ Filoxenia Conference Centre | Cyprus
The International Conference on Cultural Heritage (CH) brings together researchers, policy makers, professionals and practitioners to explore some of the more pressing issues concerning cultural heritage today. In particular, the main goal of the conference[...]
all-day H2020 ViMM Project Workshop co-o... @ Filoxenia International Conference Centre
H2020 ViMM Project Workshop co-o... @ Filoxenia International Conference Centre
Oct 29 – Oct 30 all-day
H2020 ViMM Project Workshop co-organised with the European Commission and the EU Parliament @ Filoxenia International Conference Centre
H2020 ViMM Project Workshop on how digital technologies can contribute to the preservation and restoration of Europe’s most important and endangered cultural heritage sites. The European Commission and the European Parliament are joining our event[...]
Oct
31
Wed
all-day 3rd Huangshan Dialogue on UNESCO... @ Huangshan International Hotel
3rd Huangshan Dialogue on UNESCO... @ Huangshan International Hotel
Oct 31 – Nov 3 all-day
In collaboration with UNESCO World Heritage Centre, MAB Secretariat and UNESCO Global Geopark Program Secretariat,HIST is going to organize the 3rd Huangshan Dialogue on UNESCO Sites and Sustainable Development. For detail, please look at the[...]
all-day Transcribathon Cyprus – ΜΑΡΑΘΩΝ... @ Filoxenia Conference Center
Transcribathon Cyprus – ΜΑΡΑΘΩΝ... @ Filoxenia Conference Center
Oct 31 – Nov 2 all-day
Transcribathon Cyprus -  ΜΑΡΑΘΩΝΙΟΣ ΜΕΤΑΓΡΑΦΗΣ @ Filoxenia Conference Center
From Wednesday 31st October to Friday 2nd November 2018, an exciting transcription marathon will take place during the EUROMED 2018 Conference in Nicosia, Cyprus. At the  Transcribathon Cyprus, participants will compete in teams of three[...]
Nov
1
Thu
9:00 Workshop: Investing in the futur... @ Filoxenia International Conference Centre
Workshop: Investing in the futur... @ Filoxenia International Conference Centre
Nov 1 @ 9:00 – 13:00
Workshop: Investing in the future of our Digital Cultural Heritage: The EU Horizon 2020 CSA ViMM Roadmap @ Filoxenia International Conference Centre
A Joint Event with the UNESCO Chair on Digital Heritage, the European Parliament and the European Commission This special workshop is fully sponsored by the EU Horizon 2020 CSA Virtual Multimodal Museum (ViMM) Project This open half-day[...]
Nov
7
Wed
9:00 Virtual Models and Scientific Va... @ Technische Universität Berlin, Hauptgebäude, H2036
Virtual Models and Scientific Va... @ Technische Universität Berlin, Hauptgebäude, H2036
Nov 7 @ 9:00 – Nov 8 @ 13:00
3D-Models, virtual reconstructions and interpreted point clouds are since some time omni-present in Architectural History and Building Archeology. Usually the underlying complexelaboration processes are not apparent in the result. Backed by the London Charter forthe computer-based[...]
Nov
12
Mon
all-day “Conference on Cultural Heritage... @ City Hall
“Conference on Cultural Heritage... @ City Hall
Nov 12 – Nov 15 all-day
"Conference on Cultural Heritage  and New Technologies"- CHNT 2018 @ City Hall
Congress Visual Heritage Digitize: Research – Record – Reactivate – Reconstruct The next edition of CHNT (Cultural Heritage and New Technologies) will be organized in cooperation with the EG GCH (Eurographics Symposium and Graphics Cultural[...]
REGISTER NOW!