Testing sound and splitscreen

Elements from my ever-growing catalogue of objects from dreams tested in compositions, with real footage, sound, movements and text.

The music is too dramatic for the sequence and doesn’t work with the voice, but I like the clicking sound, space and the tension the music adds. It has to be composed together. The music is made to another project by the composer Carsten Skov.

I’m not sure about the text yet; how it should be animated, which font, and the meaning of the sentence. I want it to be simple.

The use of real footage expands the expression. It will be interesting to investigate more in this field.

I’m checking AR apps

I realised that my only experience with AR on a smartphone was Pokemon Go. I find the game funny and see it as an inspiration for any kind of content.
My first goal is to try my 2d characters and animation in AR; I want to see if it works with flat elements if I need a fixed position for camera and objects, can I work with animation?
I tried Dinosaurs, an app which show different spices as 3d animated models. Ther are some features, one I like is the information layer; a describing text of the dino in focus.

Ikea Place is another App helping you to buy the right furniture to any places you point out with the camera. There is no animation but control of where to place the 3d objects.

Can I use this technique for art making? I manually made a quick test.
I like the idea of having text/poem as a part. Sound and movement also have to be tested.

Intense atmosphere with VR and Video installation

Last week I had a workshop at DMJX with my second-year students and seven sound design students from Sonic College. The overall theme was the inspiration from the sense of smell – transformed into an audiovisual work. The students worked in teams. One team decided to make a video installation. A VR installation they saw at Copenhagen Contemporary had inspired them. It was Paul McCarthy, C.S.S.C. Coach Stage Stage Coach VR experiment Mary and Eve, 2017. Link to a short sequence: Mary and Eve
Unfortunately, I had not seen it myself, but seeing the link, I got the idea.

My students got the idea of making project mapping and sound in a little room, to achive the same claustrophobic experience as in the VR installation.

I can imagine that it is an intense experience when people/avatars talk directly to you while wearing VR headset, but I do like that you don’t have to use a headset, that more than one can look at the same time. It is not a for or against it is just about how to make an intense atmosphere.

Mixed Reality gallery

Terence Quinn, who organized the VR, AR and MR workshop at Low Residency, just emailed me a sequence he had done afterwards, in order illustrates the potential of Mixed Reality.  Terrence got files from some of us and made a kind of Mixed Reality gallery by using the Microsoft Hololens.

Nice to see the recording of Terence’s MR experience with this test. It gives me a little more impression of how it works.

Augmented reality, research

Maybe AR could be a part of my final show?
Fast research shows me that AR can be many things and its scale of complexity is diverse.
Before taking any decisions, I have to think about questions like:
· What is my fundamental artistic idea using AR (don’t use it just because it is a possibility)?
· Think about the audience, how they will get experience while watching? (do they need smartphones or should they wear glasses/Hololens)
· Can I do it myself? If not, who can help me?

I met Nikolaj Staussbøl, one of my former student, who is currently working at the digital bureau Molamil, situated in Copenhagen.
Nikolaj is a curious and innovative person; he is openminded and interested in networking and dealing technology and ideas. A few years ago Virtual Reality took his attention; now he is into AR, and he knows a lot about it.
I briefly presented my project to Nikolaj. He asked me about the role of the audience, their access to material and interactions possibilities an also about my expectations to the solution and the work process.
Nikolaj warned me not making things too complicated: hard to get the app, unclear navigation, too expensive equipment, etc.
He likes when the idea is clear, readable for many of people (not only at location), etc.
He thinks that wearing glasses, whenever it is Hololense or Google glasses it narrows the target audience too much.
Furthermore, it is hard to produce / design to the “glasses”. In the working process, you have to take them on and of to check adjustments. You get headache, and you get tired.
Nikolaj showed me a project he made at Molamil; it was a nonprofit project experiment, a Christmas greeting for their clients “The Augmented Wine Box”.
This is Augmented Reality running in your browser. No downloads or apps. All with the magic of Three.js and AR.js
The only requirement is that you have the provided wine box with our marker on and a modern Android or ios11 with Safari (a computer with a webcam should also do).

I like the idea of having a physical object (the winebox) where AR objects can act (Chrismasthree). WebAR allows ongoing editing.

We talked about more simple methods, but as Nikolaj said: You have to consider the situation: Let people download apps? Free apps? Wearing glasses? To think about advantages and limitations.

I’m sure that I have to try some of the easiest apps, before asking anyone to help me, I have to know more about the technology.

Links:
https://www.vuforia.com/
https://www.aurasma.com/
https://web.blippar.com/
http://www.zappar.com/