I’m at Facebook’s F8 today and one of the two big announcements from the first day keynote is this Camera Effects Platform, which is Facebook’s first big push into AR. That’s a good thing, because Facebook has so far made its big bet on its narrower cousin, VR, through Oculus. AR has the potential to be much bigger, and Facebook getting into this space will only accelerate adoption and awareness. Sensibly, though, I don’t think any of this will be described as AR in most user-facing settings – it’ll have more user friendly names like Camera Effects, Frames, and so on. But building a platform for AR experiences including some pretty sophisticated ones means Facebook is finally serious about AR both from a first-party and developer perspective, which is a good thing. The stuff shown off on stage today looked much cleverer than what Snapchat launched this morning, and although it won’t all be available right away I suspect Facebook is actually going to be ahead here, especially when it comes to the rear-facing camera. In fact, there’s a possible scenario in which Snapchat continues to do AR better for the selfie camera, while Facebook provides better AR experiences for the outside world. More broadly, this means Facebook will now be a serious player in a field which includes not just itself an Snapchat but also Microsoft, and will soon include Magic Leap, Apple, and many others too. There are therefore big questions to ask about who will be able to attract developers and help them get a return on their investment with good monetization. I would expect to see some similar stuff from Apple at WWDC in June and possibly even more in September with new iPhone hardware too.
Microsoft’s cheaper mixed reality experience is similar to HoloLens, but there are limitations – Mashable (Apr 7, 2017)
When Microsoft held its Surface event back in October last year, one of the quick announcements it made towards the end was that OEMs would be producing VR headsets starting at $299. At the time, I said “Microsoft’s promotion of VR headsets from its OEM partners today is the first sign we’ve seen that Microsoft might be rethinking its focus on augmented rather than virtual reality. Given that HoloLens is likely to continue to struggle to achieve mainstream appeal, supporting a more consumer-friendly VR push by laptop makers is a smart move, although $299 PC-based VR solutions may struggle against smartphone-based versions at $100-200 which are more portable.” I still feel pretty much the same way about this, and it’s interesting that – despite the Windows Mixed Reality branding – these are basically VR rather than AR headsets. That’s a concession that VR is where the action is today, is the space at least some consumers already understand, and is frankly where all the content is today too. These new devices also reinforce the obvious compromises made when bringing price points down: the lower PC standards and cheaper hardware will make these VR headsets less powerful than either HoloLens or Oculus or HTC Vive hardware. There’s therefore an important question about whether this in-between space will gain any traction versus the cheap and basic mobile VR experiences provided by Gear VR and Daydream VR at one end and the high-end stuff being produced by HTC, Oculus, and Playstation.
Apple GPU Supplier Imagination Tech Says Apple Plans to Build its Own GPU in 1-2 Years (Apr 3, 2017)
This already feels likely to be one of the biggest news items of the week (incidentally, you can now use the Like button below to vote for this post if you agree – the posts that get the most votes are more likely to be included in my News Roundup Podcast at the end of the week). There have been ongoing reports that Apple would like to build more of its own in-house technology, and GPUs have seemed at least a candidate given that Apple was said for a while to be mulling an acquisition of the company, and has been bringing Imagination Tech employees on board since the deal didn’t go ahead. The GPU obviously has a number of existing applications, but GPU technology has increasingly been used for AI and machine learning, so that’s an obvious future direction, along with Apple’s reported investment in AR. Apple’s ownership of its A-series chips (and increasingly other chips like its M and W series) is a key source of competitive advantage, and the deeper it gets into other chip categories, the more it’s likely to extend that advantage in these areas. This is, of course, also a unique example of Apple making a direct statement about a future strategy (albeit via a third party): as Apple is IMG’s largest customer, it had to disclose the guidance from Apple because it’s so material to its future prospects – the company’s share price has dropped 62% as of when I’m writing this.
There’s not a ton here that’s new about Apple and Facebook’s efforts, but the article does share some new details about Magic Leap, which is said to be getting ready to launch this year at a price point north of $1000. As I’ve said before, for all the complaints from Magic Leap that people are underestimating its technology, until it actually shows more than a few hand-picked people, those complaints are unreasonable. This is a company that has massively hyped its own product (including releasing rendered rather than actual footage) while refusing to share any actual details about its product. There certainly are people (some of them investors) who appear to be very impressed by it, but not until it launches will mainstream tech reporters and others know whether the product lives up to the hype. In the meantime, other companies like Apple and Facebook are ramping up their efforts, and even though Magic Leap may well beat them to market, it’s a small company with no brand recognition, and it will have to blow people away en masse if it’s to take a meaningful lead in the market when it launches.
Apple’s Next Big Thing: Augmented Reality – Bloomberg (Mar 20, 2017)
Yet more evidence that Apple sees a far more promising future in augmented than virtual reality, something Tim Cook has already affirmed several times. There’s little concrete in this article – lots of discussion on the people Apple has leading and working on its AR project, the kinds of technologies they’re working on, and some features they’re experimenting with, but really nothing about what Apple is actually likely to launch. I’ve often said that Apple tends to build up to new technologies slowly, and often subtly, incorporating the necessary hardware in devices like the iPhone long before it actually takes advantage of them, and I think the dual cameras in the iPhone 7 Plus are an example of that. The same technology that powers Portrait Mode and 2x optical zoom could easily be incorporated into some kind of AR technology on the iPhone, and I think it’s likely this fall’s iPhones will start to show some of what they’re capable of using these and other components. But Apple will probably also use the iPhone to build up to something separate over time, like glasses, something this article seems to confirm. For now, VR definitely has far more public attention than AR, and it’ll take someone like Apple getting into the business to change perceptions and raise awareness of the latter.
Microsoft has apparently renamed its Windows Holographic platform as Windows Mixed Reality, which seems to be a reflection of the broadening of the platform from its original narrow AR focus to something broader, including the release of a number of VR headsets that was announced a couple of months ago. At the time, I saw that as a concession that Microsoft’s original vision wasn’t coming to fruition fast enough or at big enough scale, and that it needed to broaden its scope to encompass the areas that are hotter in the short term, notably VR. That was particularly important for its OEM partners, most of whom were never going to build a HoloLens like headset but who likely wanted to build more accessible VR gear. This name change reinforces my sense that Microsoft is realizing that it needs to think more broadly if it wants to play a serious role here in the near term, and that probably also means building more first party VR gear for Xbox among other things.
Tim Cook Enthuses Over Augmented Reality – The Independent (Feb 10, 2017)
This is probably the meatiest commentary we’ve had on augmented reality from Tim Cook yet, though he’s spoken enthusiastically about it in the past. Read the last two paragraphs from this interview for the full take, but it’s worth pulling out several points: Tim Cook likes AR over VR because it keeps you in the world rather than taking you out of it; it’s for everyone rather than a niche (by implication, unlike VR, which is most exciting at present for hardcore gamers); it’s as big a deal as the smartphone, and yet not a product but a feature or capability – he likens it to the silicon in the iPhone; and it’s going to take a while before it’s ready for the mainstream (which you can take as meaning it isn’t coming to the iPhone or Apple products just yet, or that it’ll be a niche technology even when it does – the former seems more likely, but who knows.) Lots to chew on here, but for me the silicon comparison is the most interesting – that strongly implies we’ll see this in an iPhone rather than a headset from Apple in the near term.
via The Independent (UK)
Magic Leap engineers scramble to finish prototype ahead of February board meeting – Business Insider (Feb 8, 2017)
This and the earlier reporting from the Information and others on Magic Leap have been so powerful precisely because the company combines secrecy and slightly outlandish claims about its future products, which just begs reporters to investigate and dig up this kind of dirt. Magic Leap has almost zero control over its narrative because it refuses to provide any concrete evidence to the broader world about the progress it’s making on its product, while evidence is mounting on the other side that the product is nowhere near ready. The same phenomenon can affect established companies too in areas where there’s widespread reporting about future business the company itself hasn’t commented on – see Apple’s car-centric Project Titan. In the case of Magic Leap, there are quite a few people who say they’ve seen a live demo which was impressive, but one of the key questions continues to be whether the company can deliver that experience in the form factor it claims to be working on, and this story casts some doubt on that idea. I’m not sure there’s any way for Magic Leap to turn the narrative around here unless it starts opening up significantly, something it seems unlikely to do.
via Business Insider
Snap Is Working on Smarter Lenses (AR) — The Information (Feb 1, 2017)
AR has seemed an obvious area for Snap to invest in, given its focus on cameras and camera-centric experiences, and its existing Lenses product. So it’s not that surprising to hear that the company is working on AR-style lenses for something other than mere selfies, using the rear-facing camera. It sounds fairly basic for now, and very much in keeping with the idea of superimposing objects onto the real world for taking and sharing pictures. But of course once the technology is there it could theoretically be repurposed for other things too, including a potential future version of Spectacles with AR capability which would overlay virtual content onto the real world seen through its glasses. Lots of potential here, and as ever it’s still very early days in AR (and in the broader AR/VR battle).
via The Information
Apple iPhone 8 rumors: Features may include facial recognition, laser sensor – Business Insider (Jan 18, 2017)
Cowen doesn’t have the same track record in predicting future iPhones as KGI, which has by far the best, so we should take all this with a pinch of salt. But it’s in keeping with the broad sense that Apple is very interested in augmented reality, and would need to put more sensors and other technology into its products to enable AR functions. I’m still intrigued by the idea of further splitting the iPhone line – there are already three sizes, and this research note posits a fourth, larger one, with exclusive access to an OLED screen and embedded fingerprint sensor. There’s some logic to that, because all the supply chain chatter suggests Apple would have a very hard time finding enough OLED technology to power all of the next generation of iPhones, so making it exclusive to the highest end device would limit demand to a smaller number. Even so, that device is likely to be in high demand, as was the 7 Plus with Jet Black finish, another phone with supply constraints.
Robert Scoble is an odd source – not strictly a reporter, and one with a very mixed track record when it comes to this kind of thing. So take it with a pinch of salt, but this is an interesting report given that Apple does seem to be very interested in AR. The timing is interesting here too – Scoble says the glasses might launch this year, which would be a big new product for Apple when it could really use one to reassure the faithful.
Qualcomm’s new chip may finally get you to try VR – CNET (Jan 3, 2017)
Qualcomm’s new high-end mobile chip moves its product forward across a number of different categories, but it seems to be emphasizing the AR and VR aspects at its CES presentation. I’m looking forward to getting some more detail on this chip in a briefing later this week, but it looks like extending Qualcomm’s lead in this space at the high end.
On Creativity and Imagination –Magic Leap (Jan 3, 2017)
This blog post from the founder and CEO of Magic Leap is a clear attempt to reclaim and reshape the narrative surrounding the company since reports began to surface a few weeks back. There has been lots of skepticism – and some “next Theranos” hyperbole – about the company, and it clearly feels the need to fight back. ML definitely invited criticism with its misleading concept videos and and the hype it has deliberately created about a product few have yet seen. Those who have seen it think it’s amazing, so I’m inclined to cut them something of a break, but it’s a useful reminder that hyping yourself too much can easily backfire.
via Magic Leap
Magic Leap has been in the news a lot because it continues to be incredibly secretive about what it’s actually building, its demo videos have turned out to be entirely CGI, and it’s seen some recent executive departures. But this announcement is a sign that as far as the company is concerned, it’s full steam ahead. Magic Leap continues to be one of the biggest (potential) names in AR, while much of the attention is on VR, while Apple also appears to be leaning towards AR, so it’s an important test of whether that bet turns out to be a good one.
Report: Snapchat acquires Israeli AR firm Cimagine Media (Dec 26, 2016)
This is a fascinating story in the context of what Snap has done recently with Spectacles. Future Spectacles hardware could bring AR capabilities, but of course AR could also be baked into the Snapchat app in new ways (arguably today’s filters are already a form of AR). Lots of potential here.