MobiDev：2022年增強現實(AR)技術開發指

南(pdf版)

MobiDev是一家軟件開發公司，致力于增強現實(AR)、

人工智能與機器學習以及物聯網等創新技術領域。近日

MobiDev發布了《2022年增強現實(AR)技術開發指南》。報

告探討了AR技術與移動AR的發展現狀，分析了該技術在

2022年進一步發展將面臨的障礙并給出了對應策略。

AR技術概述

AR的受眾正在增長。研究機構ARtillery

Intelligence報告稱，美國成年人對AR功能的移動使用量增加

了29%o這主要是受在iPhone和Android設備的原生ARKit

和ARCore架構上運行的專用AR應用程序所推動。

ARtilleryIntelligence還報告稱，與完全基于增強現實的應用程

序相比，應用程序中包含的AR功能的參與度要高得多。

游戲、社交和視覺搜索是AR最受歡迎的消費者使用案

例。PokemonGo在2020年帶來了19.2億美元的收入，且正

在試驗Microsoft

Hololens,其最終目標是為更多的觀眾帶來可穿戴游戲體驗。

AR技術并不局限于普通消費者，制造商和智能城市是其

瞄準的另一個重要領域。通過使用增強現實技術，可以進行實

時遠程協助。智慧城市解決方案還包括導航和城市規劃等

AR技術。

移動AR技術

移動設備協同處理能力、硬件攝像頭和互聯網連接，在

設備顯示屏上為用戶提供增強現實體驗。這種方法可以讓公司

接觸到大多數用戶，因為很多人已經擁有具有增強現實功能的

智能手機。事實上，據AR

Insider稱，29%的美國成年人已經體驗過移動AR。許多品牌

都利用AR體驗來提高客戶參與度。2021年，Facebook的AR

功能有2.33億活躍用戶。

開發具有增強現實功能的移動應用程序需要了解適用于

Android和iOS的ARCore和ARKit開發工具。這兩個開發平

臺支持幾乎所有基于移動應用的AR體驗。2020年，ARKit擁

有1.47億用戶，而ARCore擁有1.22億用戶;到2021年，這兩

個數字分別增至1.92億和1.82億用戶。

2022年增強現實技術發展重點

克服硬件和軟件的限制是增強現實開發的主要挑戰之一。

盡管AR技術將在2022年飛速發展，但仍有一些重要的障礙

需要考慮，如移動設備的硬件限制和操作系統版本。其中一個

主要挑戰便是Android設備的多樣性以及開發者必須面對的獨

特規格。理解這些問題是找到解決方案的關鍵。

writtenby

AndrewMakarov

HeadofMobileDevelopmentatMobiDev

TopMachineLearningBestAgency

maglevDevelopmentCompanyinUkraine

SOFTWAREDEVELOPMENT

FORVISIONARIESWHO

CREATEPRODUCTS

AlANDMACHINEIOT&HARDWARE

LEARNINGINTEGRATION

ForStartupsForEmergingcompaniesForEnterprises

。

J一

口

一

GuaranteeddeliveryYoucanadapttoevolvingTopUS-levelquality

ontimeandonbudgetbusinessneedsandincreaseROIfor1/3thepricetobring

Nosurpriseswithourflexible,provenprocesses3xfeaturestoyourproduct

g2八八4Englishspeaking

450+?100%:Zo；rDUU■professionals

Findmoreat

白info@S/p>

UNITEDSTATESOFFICEUNITEDKINGDOMOFFICEENGINEERINGOFFICESINUKRAINE

Atlanta,GeorgiaSheffieldKharkiv,Chernivtsi,Mykolaiv

TableofContents

AugmentedRealityTechnologiesOverview

MobileAugmentedRealityTechnologies

ARDevelopmentforiOSDevices:ARKil5

LocationAnchors

DepthAPI

RaycastiagAPI

AdvancedFaceTracking

ARDevelopmentforAndroidDevices:ARCore

CloudAnchors

ARFaces

ARImages

RecordingandPlaybackAPIs

ARKi【vsARCorefeaturescomparison

AugmenledRealityDevelopmentForWearables

MicrosoftHoloLens

AugmentedRealityDeveloDmentforSmartGlasses

Web-BasedAugmentedRealityTechnologies

ExampleofWebAR:DellImmersivePortals

LimitationsofWebAR

Where」oStaHDevelopinganARApplication

AugmentedRealityTechnologiesin2022:MainTakeaways

Withtheaugmentedrealitymarketvaluingat$9.5billionUSDandgrowing,this

isanincrediblyimportantsegmenttotakeadvantageoftoremaincompetitive

inARtechnologies-drivenapplicationsforanaudienceof810millionactiveAR

usersonmobile.ThisAugmentedRealityDevelopmentGuidewilltakeyou

throughthemaintechnologies,devicesandplatformsforARappdevelopment

in2022.

1

AugmentedRealityStatisticsin2021

Source:

MOBILEARMARKETSIZE2021

9.5bnUSD

NUMBEROFMOBILEARACTIVEUSERS2021

810m

ARCLASSESUNITSALES2021

410k

mobidev

AugmentedRealityTechnologiesOverview

TheaudienceforARisgrowing.ARtilleryIntelligencereportsthatthemobile

usageofARfeaturesisup29%foradultsintheUnitedStates.Thisismostlydue

todedicatedARappsrunningonthenativeARKitandARCorearchitecturesfor

iPhoneandAndroiddevices.ARtilleryIntelligencealsoreportsthatthereismuch

moreengagementwithARfeaturesthatareincludedwithinappsratherthan

appsbasedentirelyaroundaugmentedreality.

Gaming,social,andvisualsearcharethemostpopularconsumerusecasesfor

AR.It'snosurprisethenthatPokemonGobroughtin$1.92billionUSDin2020

andisexperimentingwithMicrosoftHololenswiththeeventualaimofbringing

wearablegamingexperiencestoalargeraudience.

2

Thetechnologydoesn'tstopwithgeneralconsumers.Manufacturersandsmart

citiesareanotherimportantsegment.ByusingARtechnologies,remote

assistancecanbeperformedinrealtime.Thisallowsforbetterinspectionand

maintenance,aswellastechnicalsupport.SmartcitysolutionsalsoincludeAR

technologieslikenavigationandurbanplanning.

Letstalkmoreaboutthesegroundbreakingandadvancingtechnologiesinour

2022augmentedrealitytechnologyguide.

Augmentedrealityencompassesmanyfacetsofdifferentindustries.Oneofthe

mostusefulwaysofdifferentiatingaugmentedrealitytechnologiesisviathe

hardwarethatisusedastheplatform.Generallyspeaking,thesearemobile

devices,smartglasses,head-mounteddisplays,andwebbasedARfordesktop

andmobiledevices.

AugmentedRealityHardware

MobileSmartImmersiveHeadWeb

DevicesClassesMountedDisplaysBasedAR

SmartphonesGoogleGlassMicrosoftDesktop

TabletsEnterpriseEditionHoloLensMobile

motiidev

Augmentedrealitydevelopmentisveryaccessibleandsimpleapplicationsare

veryeasytogetinto.Togetstarted,abasicunderstandingofgeometryand3D

graphicsisallthat'sneeded.However,morecomplexprojectscanrequiremuch

moreexpertise.MachinelearningandDataSciencecanalsoplayamajorrolein

thedevelopmentofmoreadvancedAR.

3

MobileAugmentedRealityTechnologies

Mobiledevicessynergizetheprocessingpower,hardwarecamera,andInternet

connectiontodeliveraugmentedrealityexperiencesforusersonthedevice's

display.Thismethodallowscompaniestoreachthemostusersbecauseso

manypeoplealreadyownARcapablesmartphones.Infact,accordingtoAR

Insider,29%ofU.S.adultshavealreadytriedmobileAR.Manybrandstake

advantageofARexperiencestodrivecustomerengagement.In2021,Facebook

saw233millionactiveusersofitsARfeatures.

MobileAR2020-2021:ARKit?ARCore

Developingaugmentedreality-capableappsformobilerequiresan

understandingofARCoreandARKitdevelopmenttoolsforAndroidandiOS.

Thesetwodevelopmentplatformspowernearlyallapp-basedARexperiences

onmobile.In2020,ARKithad147millionuserscomparedtoARCore^122

million,andin2021thesenumberswere192millionusersand182million

users,respectively.

ARCore'slargerdiversityofAndroiddevicesnecessitatesthatitbemoreflexible

fordifferentsmartphones.LastyearwesawGooglebegintocrowdsource

GoogleMapsStreetViewphotossolongastheymetcertainguidelines.ARCore

softwaremadeitpossibleforuserstotakephotoswiththequalityGooglewas

lookingfortoenhancetheirStreetViewexperience.

4

ARKitseemstooutpaceARCorebyasignificantmargin,butbothhavegrownat

asignificantpacesincetheirinitialintroduction.From2017to2018,13million

downloadsontheAppleAppStorewereAR-kitonlyapps.

ArepositorysearchonGithubshownbelowsuggeststhatdeveloperspreferto

buildappswithARKitoverARCore.

DateARKitrepositoryresultsARCorerepositoryresults

May20203,9671r483

May20214,5041,874

January20224,7702,062

ARDevelopmentforiOSDevices:ARKit5

Letstalkaboutafewnewfeaturesthatcanbeinvaluableforthesuccessofthe

developmentofyourARKitapp.

LOCATIONANCHORS

ARKit4introducedlocationanchors,acrucialfeaturethatallowsdevelopersto

affixvirtualobjectsintherealworldbyusinggeographiccoordinates.Thisallows

forfurtherimmersionthroughvisuallocalization.Withlatitude,longitude,and

elevation,virtualobjectscanbeplacedintotheworldwithevenmoreaccuracy

thanbeforewithgeographicinformation.InARKit5locationanchorshaveseen

someimprovements.

Forexample,locationanchorscoulddisplayathreedimensionaliconortextin

spacenexttoaniconicbuilding.Supportforthisfeaturehasbeenexpandedto

LondonandothercitiesintheUnitedStatesinARKit5.

Oneofthemostgroundbreakingelementsoflocationanchorsishowlocationis

approximated.GPSissimplynotpreciseenoughtoprovidelocationanchorson

auser'sscreen.Toassist,developerscanlookaroundwiththeircameratoallow

thedevicetoscanforfeaturesonbuildingsaroundthem.Byusingthese

architecturalfeaturesinconjunctionwithAppleMapsLookArounddata,ausers

locationcanbebetterapproximatedforlocationanchors.

5

SincelocationanchorsaredependentonAppleMapsdata,thismeansthatifthe

cityisnotsupportedbyAppleMaps,functionalityforlocationanchorsmaybe

limited.

DEPTHAPI

DepthAPIisanothervaluablefeatureofARKit4whichcontinuestoplayan

importantroleinARKit5.Itutilizesoneofthemostpowerfulhardwarefeatures

forARonamobiledevice,theLiDARscannerontheiPadProandPhone12Pro,

12ProMax,13Pro,and13ProMaxsmartphones.Thisenablesmuchbetter

analysisofscenesandallowsforrealworldobjectstooccludevirtualobjects

withmuchbetteraccuracy.

RAYCASTINGAPI

Apple'sRaycastingAPIenablesenhancedobjectplacementinconjunctionwith

depthdata.Thisallowsmuchmoreaccurateplacementofvirtualobjectsona

varietyofsurfaceswhiletakingintoaccounttheircurvatureandangle.For

example,it/spossibletousethistoplaceanobjectonthesideofawalloralong

thecurvesofasofaratherthansimplyflatonthefloor.TheLiDARsensorallows

forthescanningofsurfacestotakeplacemuchmorequicklycomparedto

traditionalmethods.

ADVANCEDFACETRACKING

Duetomorepowerfulsoftware,facetrackingtechnologythatwasoncelimited

toTrueDepthcamerascannowbeusedwithiPhoneswithanA12Bionic

processororgreater.Thisallowsfortoolssuchasfaceanchorstobe

incorporatedintoappfeatures.AlsofacetrackingisnowsupportedbytheUltra

WidecamerainthelatestiPadPro(5thgeneration).Thisfeatureallowsfor

trackingofuptothreefacesatonce.

ThevideobelowshowshowiPhoneemploysAR-basedgaze-trackingtechnology

thatcreatesusecasesfordevicecontrolperformedwitheyes,usedforserving

userswithlimitedabilitiestoallowforahands-freeexperienceandmonitoring.

Combinedwithcomputervision,face-basedARopensupfurtheropportunities

forfacialrecognitionapps.

6

ARDevelopmentforAndroidDevices:ARCore

Inanefforttoremaincompetitive,GooglehaspushedARCorefartoremainone

ofthemostversatileARdevelopmentplatformsintheworld.Letsexploresome

ofthefeaturesthatareusedbydevelopers.

CLOUDANCHORS

Thistoolallowsuserstoplacevirtualobjectsinphysicalspacethatcanbe

viewedbyotherusersontheirowndevices.GooglehasmadesurethatCloud

AnchorscanbeseenbyusersoniOSdevicesaswell.

ThefollowingMobiDevdemodemonstrateshowARCoreobjectdetection

featuresforavirtualusermanual.

AugmentedRealityUserManualSfliObidEvo4

WatchlaterShare

VirtualManualviaAugmentedReality

info@

WatchonQYouTube

ARFACES

ARCoreenablesdeveloperstoworkwithhigh-qualityfacialrenderingsby

generatinga468-point3Dmodel.Masksandfilterscanbeappliedafterthe

user'sfaceisidentified.ThisisoneofthemostpopularusecasesforARapp

features.

ARIMAGES

Virtualbusinesscardsandadvertisingpostersarejustafewoftheapplications

thatarepossiblewithaugmentedrealityimages.2Dmarkerscanbeusedto

implementthesefeaturesaswellasmoreadvancedsolutionslikeARindoor

navigation.

LearnhowanARCore-basedindoornavigationapplicationworksbywatching

thisMobiDevdemo.

AugmentedRealityIndoorNavigationDemo-ARCorebased.口￡JIjiL?"

Ll一224、xIWal金■旭?Share

AugmentedReality

arindoornavigation

WatchonOYouTubeinfo@

RECORDINGANDPLAYBACKAPIS

Lastyear,GoogleintroducedanewfeatureforARCorecalledrecordingand

playbackAPIs.ThisallowsdeveloperstorecordvideoswithARmetadata.Using

theIMU'sdepthandmotionsensordata,developerscanrecreatethesame

environmentasinthevideoanduseitforfurthertesting.

UserscanalsobenefitfromrecordingandplaybackAPIs.Forexample,usingthis

feature,userscanapplyAReffectsonpreviouslyrecordedvideos,sincethe

videocancontainmetadataabouttheenvironment.

8

ARKitvsARCorefeaturescomparison

AppleandGooglehavebothpositionedtheirrespectiveARplatforms

competitivelyagainsteachother.Thismeansthatbothwilllikelybecomparable

incapabilityfortheforeseeablefuture.ApplehaspositionedARKitwithaslight

advantagegiventhebettercontroloverthesoftwareandhardwareoftheir

devices.TheLiDARsensorisoneofthemostadvanceddepthsensing

technologiesonamobiledevicecurrentlyavailable.However,itwon'tbelong

beforeAndroiddevelopersstarttopickupthepace.

GoogleandApplearebattlingoverplatforms,installedusers,andmoney.

Apple'slifestylebrandimagehasattractedagreatdealofdeveloperattention

sinceitisperceivedasabettersourceofrevenueforstartupsneedingfunding.

AlthoughdevelopersfavorARKit,Google'sARCore'smarketsizeismuchlarger

andgrowing.

ComparisonofARKitandARCorefeaturesin2022

FMtur*ARKHARCor*

WorWTracking??

imageXtacking??

faceTracking??

CsoTracking??

BodyTracking??

PtenceDetection??

Sc?n?Depth??

ObjectDetection??

SharedAR??

MMhing(UOAR).?

■th*IwtureHp,eMnte<lonthaplMlormandK?ff?ctive'th?toMurei*I?Mornot?v?4abletotdcvttofMre

?tb?fMtur*i?notpm?nt?donth*piMform

Sincetheyaimtoprovidecompetitivefunctionality,bothplatformsoffersimilar

featuresandperformancesuchasmotionsensors,understanding

environments,andinspectingchangesinlightingconditions.

Inthefollowingdemovideo,wedemonstratehowARKitandARCoreperformin

recognizingandaugmentingimages.

9

WatchonOYouTube

ByputtingtheMonaLisapaintingintothecameraframe,theappisableto

animatethesubjectbymakingitblinkhereyes.Thevideodemonstratesthe

differencesinperformancebetweenARKitandARCoreinexecutingthistask.

Despitetheirdifferences,thewaythatARscenesarecalculatedinARCoreand

ARKitarenearlyidentical.However,it'smostlikelythatthereasonwhyARKit

outpacesARCoreinperformanceisbecauseApplehasmuchmorecontrolover

thehardwareandsoftwareoftheirdevices.SincetheydevelopbothiPhones,

iPads,aswellasiOS,ApplecanbetteroptimizethemforARexperiences.

It'scrucialtoensurethatadevelopmentteamisusingthelatesttools,technologies

andapproachesontheproject.Usingoldertoolsposesagreatriskasthere'salways

thechancethattheywillbecomeoutdatedandunsupportedinthenot-too-distant

future.There'salsotheriskthatoutdatedsoftwarewillaffecttheimplementationof

newfeatureslaterdowntheroad.Whileitmayworkperfectlynow,youmustthinkof

thefuture.

RomanMarkov

//

Android/iOSExpert

10

AugmentedRealityDevelopmentFor

Wearables

Whenwetalkaboutwearabletechnologyforaugmentedreality,wetypicallyare

referringtodisplaytechnologystrappedtoone'sheadorapairofglasses.

Althoughtheshapeandformfactorofthistechnologycanvary,themost

popularformsaregearlikeMicrosoftHoloLensandmoreportableand

comfortableglasseslikeGoogleGlass.

Thereisabigdifferencebetweenthesetwotypesofdevices,notonlyinpurpose

butinpotential.Largerhead-mounteddisplayslikeHoloLensarecapableof

muchhigherprocessingpower.Thisenablesthemtoprovideexperiences

otherwisecurrentlyimpossibleformorecompactdeviceslikeGoogleGlass.

Becauseofthesmallerformfactorandreducedprocessingpower,ARglasses

aremorefocusedonprovidingtwodimensionalexperiencessimilartothatof

yoursmartphone.Forexample,displayingnotifications,text,directions,photos,

inyourfieldofvisionaresolutionsthatARglassescanreasonablyprovide.

Voice-basedInternetsearchandcontrolarealsofeasible.GoogleGlassandthe

nowdiscontinuedFocalsbyNorthonlyprojectthisinformationintooneeyein

twodimensions.Futureglassesmaybeabletoprojectthisinformationintoboth

eyes.

Hearablesarealsoenteringrelevancy.Technologieslikespatialaudioare

alreadymakingtheirwayontoearbudsliketheAirPodsPro,andmore

office-centrichearableslikeMicrosoft'sSurfaceEarbuds.

Glassesandlargerhead-mounteddisplayshavetwodifferentrolesinthe

marketatthemomentwithspecificusecases.Let'stalkaboutbothofthemin

moredetail.

MICROSOFTHOLOLENS

HoloLenswasfirstannouncedin2015,howeveritsinitialversionwas

discontinued.CurrentlyMicrosoftisofferingHoloLens2tobusinessconsumers

only.Itisbatterypoweredanddoesnotrequireacabledconnectiontoanother

device.AlthoughHoloLens2hasshownenoughpromisetobeacquiredbythe

11

militaryina$22billiondollardeal,thelimitationsandcostoftheproductare

largebarrierspreventingitfrombeingadoptedmorewidely.

Organizationsfacesignificantchallengeswhenadoptingtechnologieslike

HoloLensatscale.Incorporatingnewtechnologiescanbedifficultforbusinesses

becausetheyneedtimeandefforttoadjustandlearntousethem.HoloLens

requiresanentirelynewwayofworkingwithothersandinformation.Thiscalls

intoquestionwhattheimpactwillbenotonlyonthebusinessitselfbutonthe

qualityofitscustomerservice.

MagicLeap,anARheadsetpositionedasapotentialcompetitortoHoloLens,

wasdiscontinuedin2020.

AUGMENTEDREALITYDEVELOPMENTFORSMART

GLASSES

SmartglasseshavegreatpotentialtobecomewhattheiPhonewasfor

consumersintheaugmentedrealityspace.Beingabletohaveacomfortableto

wearandfashionableplatformforaugmentedrealityexperiencesthatcouldbe

massproducedandaffordableforconsumerswouldbegamechangingfor

manyindustries,especiallyretail.

ARexperiencesonsmartphonesareusefulandhelpful.However,viewingvirtual

objectsthroughasmartphoneasaportalcanbeinconvenient.Itsmuchmore

comfortableandrealistictoseevirtualobjectsthroughyournaturalfieldof

visionviasmartglasses.Thiscouldfundamentallychangemanyindustries,

especiallyretail.

However,therearemanychallengeswhenattemptingtomaketechnologythis

sleekandthispowerful.FashionableARglasseswon'tbeabletodonearlythe

samekindsofgraphicallychallengingtasksthatlargerheadsetscan.

FocalsbyNorthwereanotableARGlassesstartuprecentlyacquiredbyGoogle.

Theywereambitiousbutlimited,andhavesincebeendiscontinued.This

suggeststhatGooglemaybeinterestedinbringingbacksmartglassesintothe

mainstream.DreamGlass4Kisanothersmartglassesprojectthatcanbepaired

withasmartphone.

12

Web-BasedAugmentedRealityTechnologies

Althoughthemajorityofusersareexperiencingaugmentedrealitythrough

mobileapps,thisisnottheonlywaytoexperiencethetechnology.Web-based

ARisamoreaccessibleavenueofdevelopmentthatdoesnotrequireusersto

downloadapps.Instead,theARexperiencesareloadedthroughawebbrowser

onadevice.

AR-compatibleDevicesandActiveUsers2020-2021

mobibev

Thisiscrucialduetoappretention.Apptentivereportsthatafterjustonemonth,

anappmayloseonaverageabout35%ofitsusers.Ifusersdon*thaveto

downloadanapptoexperienceARcontent,theywillbemuchmoredriven

towardengagingwithit.

EXAMPLEOFWEBAR:DELLIMMERSIVEPORTALS

DelPsWebARImmersivePortalsareagreatexampleofwebAR.Whenstepping

throughthesevirtual4portals#placedinphysicalspace,userscouldimmerse

themselvesinanewdestinationelsewhereintheworld.AR3Dbusinesscards

areanotherusefulapplicationcreatedbyAircards.Theseexperiencesare

startedbyscanningaQRcodeonthebackofthebusinesscard.Whenviewed

throughadevice,thebusinesscardbecomesfullyanimatedin3Dspace.

ThisMobiDevdemoshowshowAR3Dbusinesscardswork.Youcanalsolearn

moreaboutithere.

13

LIMITATIONSOFWEBAR

SinceWebARapplicationsareextremelylimitedbythewebbrowsersthattheyrunin,WebAR

isnotagreatsolutionforcomplexprojects.WebARmaybesufficientforsimpleprojectssuch

asvirtualbusinesscards,simplefacetrackingandothersolutions.However,formore

complexoperations,mobileARismuchmorecapablesinceitcanunlockthefullpotentialof

themobiledevicethatitsrunningon.Hopefullyinthefuturetechnologywillimproveto

make]AfebARmorecapabletoallowformoreaccessibleARexperiences.

ThekeyforsuccessofWeb-basedARwillbeagreaternumberofdevicestosupportitand

morewebsitestohaveitenabled.Althoughthesestandardshaveyettobeestablished,the

implementationofARinbrowsersisalsoperformedbymeansofeitherportingexisting

libraries(e.g.AR.js)ordevelopingnewones(e.g,A-Frame,React360).

YuriyLuchaninov

JavaScriptGroupLeader

14

WheretoStartDevelopinganARApplication

Onceyou'vedecidedtodevelopanARapp,ther