Last week Gizmodo spotted that Google has filed a patent entitled “Claiming Real Estate in Panoramic or 3D Mapping Environments for Advertising,” which in short allows them to paste media (adverts) onto the images.
Its interesting how the mouse in Street View follows the 3D space, we assume to allow any data to be tagged to buildings etc.
With data of course comes the ability to provide click throughs and advertising. We dont think it will limited to simple images however as video can also be embedded into panoramas as one of our previous examples shows.
Currently the sketch can be controlled via keyboard and mouse along with rough support for SMS control on laptops, iPhone control via OSCemote and oscP5, joystick control via proCONTROLL and midi controller support via proMIDI.
It’s available as Mac, Windows and Linux download.
Robert Hodgin aka flight404 posted this video of an app he’s working on for the Decode event at London’s V&A. He’s reworking his older Solar piece so that it’s audio responsive in real-time.
This is unbelievably good. Visually and sonically.
I have been working on a real-time version of the Solar piece from a couple years ago. Since it is going to be responding to people’s voices and ambient noise instead of music, I started listening to podcasts while I was developing it. I made this video to commemorate my new found love for WNYC’s RadioLab podcast. Thanks to Branden Hall and Bill Lindmeier for introducing me to it.
Sony Music has created a film in which footballers use their ball skills – instead of small plastic replica guitars – to control a specially created Guitar Hero style game. Why? To promote Kasabian’s single, Underdog…
Dom wrote this feature for the 1st anniversary of the rebranded Revolution magazine. This is a copy+paste of the expanded version posted on his blog.
It gives you a glimpse into a some of the projects I’ve worked on at glue, and the technologies we’re looking into at the moment.
–
Little did I know it at the time, but a project for Mars’ sponsorship of Euro 2006 was the catalyst for a new approach to personalised video content here at glue.
What we did was crude and simple: we allowed people to create a fan by choosing a head, body and hands. These individual assets existed as PNGs on the server and depending on what was chosen, a JPEG was created using ImageMagik. Thinking not too much more about it, we moved on to the next project.
A year later our Get The Message recruitment campaign for the Royal Navy was born:
We quickly realised that the audience likely to want to recruit weren’t exclusively those behind PC’s all day. In fact the bulk of them weren’t. For this audience the only real channel available at scale was mobile.
The problem was we’d become experts in interactive video using Flash, but Flash wasn’t (and broadly still isn’t) compatible with many handsets. The file format of choice was / is MPEG video so we needed to replicate the browser experience using it.
We scratched our heads and fairly quickly came round to the idea that if we can create individual JPEGs on the fly, stitching them together would create video. So that’s exactly what we did – this time combining ImageMagik with FFMPEG.
The video message is delivered as an SMS. The recipient downloads and watches the video, and also has the ability to respond direct on handset:
At the time this was a first and we all felt pretty happy and gave ourselves a slap on the back like only the ad industry can. But almost naively, and for a second time, we’d stumbled on the door to a much bigger opportunity:
Replicating the flash experience had fulfilled the requirements of this project, but we soon recognised that by automating motion graphics or 3D packages it’s immediately possible to generate video without creative limits.
Enter DYNAMIC VIDEO (a phrase we’ve banded about the agency for a few years now that REALLY needs a better name…)
Whilst traditional video is shot with a camera and broadcast, dynamic video allows for content to be generated specific to the person watching it, at the moment of viewing.
To help understand this complex concept, think about the gaming world where a game is produced but each game-play is unique to the actions of the game player. With dynamic video the same is now true for brand experiences.
Here’s one such example we created in 2008 for Bacardi using their existing endorsement of UK beatboxing champion Beardyman.
The project was initiated by the simple thought, ‘wouldn’t it be great if everyone could beatbox as well as Beardyman.’ And from there a project was born.
It’s a simple upload your face mechanic, using Kofi Annan here for the purposes of demo:
There’s all sorts of complex things going on under the bonnet.
There’s proprietary image recognition software interpreting the uploaded photo, identifying facial elements and stripping it out from its background (no need for manual intervention).
Then using 3DMax the video is generated by mapping the face texture onto existing wireframe animations.
This technique has 2 immediate benefits:
1. Visually pretty much anything is possible (at least anything that’s possible within motion graphics or 3d applications)
2. The generated file is the ubiquitous MPEG – enabling distribution across channels without the need to re-engineer
However the technique is fairly processor intensive – taking around 20 seconds per person to generate. This gives a through-put of 4,320 videos per processor per server per day. Whilst this is ok on a smallish campaign, the only real thing you can do for larger ones is throw more hardware at it which can be costly and only becomes viable once a client really values what is creatively being achieved.
The emergence of cloud computing farms and the rendering capacity these offer to an extent solves this issue, but it’s early days. These cloud farms not only offer scalable rendering capabilities, but with the proliferation of smaller devices in all our pockets, enable richer experiences to be created remotely and be viewed on device.
Another sector dabbling in using cloud farms in this way is the few virtual rendering games companies that have recently emerged, which negate the need for a console by rendering content virtually and bringing it into home via your broadband. (can our broadband really cope with realtime 1080p video content? Or is this partly the reason these services haven’t yet taken off). Definitely one to keep an eye on.
As is the recent emergence of open source video specific rendering farms like PandaStream.
Or potentially the answer is in not saving the generated video to file, but rather to dynamically construct the video within stream as done here:
It’s a neat solution, but the SDK means the production process is alien to existing skill sets in the short term.
So generally speaking it would be fair to say there’s lots of trial and error needed. And I can’t help but notice the aforementioned gaming industry is set on collision course with the digital industry – both attacking a similar problem but from different angles. This is a most exciting prospect. (Here’s the closest example of the two together I’ve seen to date).
In the mean time it would be great to think that the Adobes’ of this world, or maybe more likely the hardware guys of the world like nVidia or AMD move into this space and create a tool to ease the production process, but until they do these experiences will be built by ingenuity in combining niche technologies together to the needs of the project.
It therefore becomes apparent that to stay ahead of competitors R&D can’t be undervalued. The same goes for having the time and freedom to explore, trial and learn new technologies and techniques on paid for work. As we’ve testified here, bits of work that at the time may not seem like much, may in the future prove to be invaluable by re-emerging as a wholly different entity.
So collectively we (the industry) have come to a juncture where new creative opportunities exist. With this brings the need for internal re-education both on how we approach briefs conceptually, but also in how we approach capturing the assets in a new way that enables them to be manipulated with these techniques.
And with an eye on the future: glue recently ventured into the world of TV. I for one am really excited at the prospect of the day that the archaic TV broadcasting infrastructure is modernised and we can apply our digital know how onto the currently stagnant format. It defies belief that everything is still run from BetaMax. Admittedly I don’t know the setup intimately, but I’d have thought all it needs is for systems to be driven by an internet enabled computer – which happens on occasion, but not enough.
Here’s another more dynamic example that the clever boys and girls at MiniVegas were able to negotiate for a special short term deal for S4C a few years ago:
Move over voice and motion recognition. The new kid on the block is eye gesture recognition. Not with a camera either but an ear bud that detects nerve signals.
Errrrrr, amazing… You might look a bit mad on public transport though.
Hand From Above is an interactive installation by Chris O’Shea. He was commissioned by Abandon Normal Devices and Liverpool City Council for BBC Big Screen Liverpool and the Live Sites Network to create something for the BBC Big Screen. Hand From Above interacts with unsuspecting pedestrians, it can tickle, stretch, flick or remove entirely them on the big screen.
Audi A4 Car Configurator by Neue Digitale / Razorfish in collaboration with Realtime Technology AG.
Simple gestures allow the user to alter virtually anything on the A4, with instant results. Microsoft Surface doesn’t provide the appropriate hardware, so the application is connected to a dedicated render-server via network. The speed is quite good for a high-quality rendering and it can be easily improved by switching to a more powerful server.
Sportpong is a mobile game which can be installed in locations of various dimensions both indoors and outdoors as the playing area is project on the ground.
As the development and distribution of interactive tables is still in its early days, they see the Fontplore Table as some kind of customer attraction for the bigger design agencies, where clients and designers get together and share the experience of selecting a suitable typeface for the project.
