6 Best Augmented Reality SDKs and AR Frameworks

Unlikely there is a person who has never heard of augmented and virtual reality hypes driving the tech world insane now. Though building a quality augmented reality app is easier said than done. Here we cast an eye on augmented reality frameworks for iOS or for Android, making a tiny comparison and helping you choose best augmented reality frameworks for mobile app development.


Content

  1. Move and Explore
  2. Plan Your Dream House
  3. Try Before You Buy

The future is here at our fingertips, but we need the right tools to build it.

Expanding on the topic raised in our previous article “5 Tips On How to Use Augmented Reality App For Your Business”, the power of augmented reality apps is not the one to be denied - as tech-savvy “freaks” of the century like Meron Gribetz (CEO and Founder at Meta, a company producing glasses for augmented reality) have their minds reeling with the possibilities of what we can do with the help of these technologies.

All of those minds have already come up with a few applications that have significantly changed the way plenty of things have worked for us. No monkey business - as you will be looking at a few examples-slogans presented below and showing how tightly those augmented perks have now intertwined with our reality.

1) Move and Explore.

This is the biggest breakthrough Google’s augmented reality game Ingress has done; according to Alan Henry, who has recently given an interview to LifeHacker, regarding the impact Ingress had on his life - Alan actually claimed Ingress has gotten him “out of the shell he used to live in”. Truly tho, Wiki mentions that even Niantic used the crowdsourced data from Ingress to populate the locations for PokéStops and gyms within Pokémon Go, as Ingress is a “a story-driven, real-world augmented reality game—which is short for “you install a game on your phone, and the game takes place in the real world so you have to get out of the house to play.” [Source: LifeHacker]

The main game’s feature is that it opens series of “portals” for the playing user, which are mainly located in the public “creativity” areas - museums, exhibitions, parks, etc. This not only lets user move around the town, but also allows players to explore the zones they would never visit otherwise. This video provides a full info on Ingress’ mission:

2) Plan Your Dream House.

Or your room, or just a furniture shift within your house. The application Amikasa, allows you do it all - according to their official webpage, Amikasa is a “3D room designer tool that allows you to build, decorate and restyle rooms using furniture, flooring and wall colors from real brands.” Imagine what efforts would refurbishing your home require only a few years ago - and feel blessed to have Amikasa taking the stress out of the building works.

3) Try Before You Buy.

This feature was first introduced last year by the L’Oréal’s Make Up Genius - a 3D-model of your face where you can test any makeup combinations you’ve ever craved for. The app lets you apply every Loreal’s product and see how they look in real life - all of these without having to leave your apartment. Another successful implementation of the 3D face-recognition system is a newly-released Sephora Visual Artist , where the number of features is pretty much like in Make Up Genius - just the products’ you can apply are of a different brand.

Sephora Visual Artist

Image taken from Sephora Visual Artist app on the App Store

The list of the life-improving apps doesn’t end here, as these technologies are rapidly changing the way they and world function; however, there are a few primary categories all types of augmented-reality apps and AR frameworks could be classified on. Let’s cast a quick eye on them.

Types of Augmented Reality Apps.

  • Location-based AR apps.
    Ingress, Pokemon GO, Wikitude and many more fall into this category. This type unites 3 parametres - your GPS location, compass and accelerometer in order to give you the accurate data on what you see on the screen. Creating a location-based app is a great solution.

  • Projection based apps.
    Amikasa and IKEA Catalog could be divided into this group. This type, as it seems obvious from its name, “projects” objects or images in digital space. It helps you to visualize if a costy sofa you are willing to buy is a good fit in terms of in-house capacity and atmosphere.
    Read more about How to Make an App Like IKEA Place

  • Face-recognition AR apps.
    Make Up Genius by L'oreal and freshly-launched Sephora Visual Artist (back in the time this article was written) are based on face-recognition technology. The basic principle it stands on, is well-described by iGreet company - “the AR app detects and recognizes something called AR marker.

Once it recognizes the marker, it replaces it with a corresponding object.” In the case of previously mentioned apps, your face, each and every part of it is a “marker” app uses to apply various ready-to-wear make up combinations.

Another great example of face recognition augmented reality app is roaring-around-the-world Face App, which by using your face as the “marker” allows you to look younger, discover your “older self” or even change gender - quite a transformation to make!

There also is a subcategory called digit recognition apps - the ones where you scan the symbols (including nested symbols) in real time and let the app recognize it. The new Google Translate app (although it is not a “pure ar project”) has one potentially handy for translation feature - it can translate any text on the photo you take in real time. It already has more than 20 languages that it can easily recognize, and their number is only growing with every forthcoming update.

All of the mentioned above products were built with various augmented reality SDKs and ar frameworks, as each library lets you create a measured number of features but there are a few we have dutifully investigated; and made a brief report on each of them.

Number one - Kudan. AR SDK.

Kudan AR SDK

Overview: One of the handiest augmented reality development tools, that works quite fast and allows you to use object-based recognition with posters/ stickers; a plain example of this would happen once you level your device on a poster - there might appear an inbound link, an order confirmation, a payment verification etc.

Kudan recognizes objects by initializing their coordinates and adding a layer up on top of them, although this augmented reality SDK doesn’t offer much for face detection - this augmented reality software does not include the physics needed for face transformations. Applications like Virtual Mustang for Ford and DHL Formula E Xperience were build with Kudan. Another feature Kudan is capable of processing is 2D&3D recognition, with the models created in 3D Max beforehand.

Who is it suitable for: as long as it is free for non-commercial “indie-projects”, Kudan could be much of service for the crowdfunding and startups focused on major augmented reality development kit. Also, Kudan has commercial Business and Enterprise licenses with extra functionality.

Production License AR Indie AR Business AR Enterprise
Price Free £1,000 /year Custom
Revenue Capacity Less than 1 million GBP e.g. SME, Non-profit, Educational Institute Less than 1 million GBP e.g. SME, Non-profit, Educational Institute More than 1 million GBP e.g. For Enterprise
AR SDK License With Watermark Without Watermark Without Watermark
Platforms iOS, Android and Unity iOS, Android and Unity iOS, Android and Unity
Validity 1 Year No one time fee 1 Year No one time fee Options available
Volume licenses Non Applicable Custom Options available
Support Free Forum Access
Paid support: 300 GBP/ticket
Free Forum Access
Paid support: 300 GBP/ticket
Free Forum Access
Paid support: Options included

Go to Kudan website

Number Two - Simple CV.

Simple CV

Overview: It is a widely-used open source augmented reality sdk, that enables a particular feature of computer vision.

Simple CV offers 3 types of computer vision to choose: threshold function, edges method and keypoints finding feature. Another advantage of this (one of the best AR SDKs insofar) is that it is not connected to any specific platform and supports Java, C++ and even Python.

Who is it suitable for: augmented reality development team, who have been looking for an easy tool to implement computer vision for images or videos coming from webcams, Kinects, FireWire and IP cameras, or mobile phones.

Go to Simple CV website

Number Three - Vuforia, Augmented Reality SDK.

Vuforia SDK

Overview:Same as Simple CV SDK, Wikipedia states that Vuforia uses computer vision to recognize and track planar images (Image Targets) and simple 3D objects, such as boxes, in real-time. You also get to grips with some additional features,
Including:

  • virtual buttons;

  • Background effects;

  • Occlusion management, which lets Vuforia find even partially hidden objects;

World-famous apps like BMW Individual 7, MANGO MNG and Nikola Tesla are Vuforia-based.

BMW Individual 7 - AR App

Image taken from BMW Individual 7 app on the App Store

Who is it suitable for: Again, with this augmented reality library it is suitable for developers worldwide who are interested in computer vision in-app integration.

Vuforia is available for free, but also has commerce versions which give the user access to advanced features:

Product Classic Cloud Pro
Price $499 one-time $99 / month Сustom
License Eligibility Apps built for companies with revenue under $10 Million/year Apps built for companies with revenue under $10 Million/year No revenue restriction
Content placement On Surfaces
On Objects from Images
On Objects from VuMarks 100 100 Custom via API
On Objects from 3D Scans - -
On Objects from 3D Models - -
Advanced Camera - -
Cloud Database Max Size (of images) - 100000 Custom
Max Usage (Reco/mo) - 10000 Custom
Support Software Updates -
Direct Support - -

Go to Vuforia website

Number 4 - Wikitude SDK.

Wikitude SDK

Overview: According to the info on their site, Wikitude is an all-in-one included augmented reality framework for Android, as well as for iOS, which enables developers to use GEO data, create 3D object and implement image recognition. Apps like Time Magazine Special, ROOMLE and Wikitude Navigation were developed with Wikitude library. An average pack with all those features mentioned above costs 2990€, but it’s well-worth it’s price, with the scope of features it has included. Additionally, there are different commerce licenses on Wikitude for each type of user.

Products SDK Startup SDK Pro SDK Pro 3D Cloud Enterprise
Price Free 2490 € / year 2990 € / year 4490 € / year custom
Features
Geo
2D Image Recognition
2D Image Recognition
3D Engine
Instant Tracking (SLAM) -
Object Recognition -
Scene Recognition -
Cloud Recognition - - -
Enterprise Apps - - - -
Smart Glasses - - - -
Service Extensions
Multiple Apps - - - -
1 iOS + 1 Android + 1 Windows App
Studio Offline Export
Studio Hosting -
Enterprise API/Script - - - -
Self Hosting - - - -
Support SDK Updates -
Forum
Email - - - -
Priority Tickets - - - -
Phone - - - -
Custom SLA - - - -
Developer Training - - - -

Who is it suitable for: somebody who is willing to invest into the development of the augmented reality application with a dime and dozen features that are not present in the open source libraries. It might seem a pricy option to have, but judging out of experience we have - turn-key solutions have proved to be time-saving and money-saving in a long run.

Wikitude was updated September 12, because of iOS 12 and Android 9 incoming. Wikitude SDK 8.1 has a number of new features like Instant and Extended Object tracking, better recognition for Object Targets, Increasing of tracking stability.

Go to Wikitude website

Also - ARToolKit.

ARToolKit - open source AR framework

Another popular framework that pretty commonly-used worldwide is ARToolKit - a well-known open source augmented reality framework that has compiled SDKs for iOS, Android, Windows, Mac OS and Linux platforms. It is widely used for various purposes as it “Includes OpenGL ES2.x support, integration with GPS and compass, and automatic camera calibration utilities”. Source: ARToolKit.

The famous Magic Book, 3D Live and ARCO have ARToolKit included into their source codes. However, before integrating it to your project you should become aware of the licensing policy ARToolKit gives an access to on their website - or on GitHub.

And finally – ARKit 2

There is a dessert of this list. Apple has released their AR technology platform in WWDC 2017. It is a framework, that allows developers to create all the above-listed types AR applications. This new cutting-edge platform was designed to proved Augmented Reality development for Apple devices specifically. This technology is a novelty because it is able to take the corner illumination into account for correct integration of virtual objects in real life.

ARKit 2 for iOS

And last year, 2018, Apple introduced ARKit 2.0 that promises to be a revolution in the augmented reality field. There are some features that would be available in ARKit 2.

  • Teamwork

You are don’t need to use your iOS device for only single usage of AR experience. Now you are able to simultaneously view AR models and play multiplayer games.

ARKIT demo

  • Persistent experience

Now you can save your progress in AR projecting, pursue other things, and then continue your projecting without losing your progress. This can help you to do AR puzzles for example.

  • Detection & Tracking

ARKit 1.5 added support for 2D image detection, letting you trigger an AR experience based on 2D images like posters, artwork, or signs. ARKit 2 extends this support to offer full 2D image tracking, so you can incorporate movable objects like product boxes or magazines into your AR experiences. ARKit 2 also adds the ability to detect known 3D objects like sculptures, toys, or furniture.
[Apple Developer]

Still Got Miles to Go.

We can conclude by comparing all these AR Platforms to understand the difference between them.

Product Kudan Simple CV Vuforia Wikitude ARToolKit ARKit
Product License Free, commercial Free Free, Commercial Commercal Free Free
2D recognition
3D recognition -
Geo-Location - - - -
Cloud recognition - - -
Unity support
Smart Glasses support -
SLAM - - -

As you can see, Wikitude and ARKit lead the list of functionality. Vuforia takes the 3rd place. But you should notice, Vuforia is more multiplatform than ARKit, and this is also available for free in contrast with Wikitude.

As of 2018, Vuforia is the most popular Google request in compare with another AR platforms, according to Google Trends. ARKit runs a close second because it is a fresh platform, that allows developers to add the number of new features to the AR applications.

AR framework trends

When it comes to future of the augmented reality - the best prediction is to not give any predictions at all. The only ever-lasting practices that could be applied here is to monitor the frameworks, libraries and tools which present your future application’s direction. You don’t need to move blindly in the AR technology field, so contact us and ask a question to get an answer from qualified experts.

Written by Dmitry Hapich and Elina Bessarabova