OpenStack與Kubernetes社區中異構計算相關項目介紹

我們進入了域專有架構的全新時代NPUNeuralnetworkprocessorsformachinelearningGPUGPUsforgraphics,virtualreality,MLFPGAProgrammablenetworkswitchesandhardware但在云計算中如何管理這些異構計算設備？OpenStackCyborg項目——項目總覽PublicCloud加速硬件管理框架PrivateCloudHybridCloudNFVEdge/IoTHPCAIGPU

FPGANVMeOverFabricSSDAIASIC加速硬件管理APICyborg項目完成情況1、Cyborg項目自2017年9月成為OpenStack社區官方項目后，生態進展迅速，已成長為加速設備管理的事實標準，服務于NFV、HPC、邊緣計算、AI/DL等多個場景2、Cyborg項目已引入多個主要加速設備（GPU、FPGA、AI芯片），吸引Intel、聯想、ARM、Redhat等8+廠商加入，發展科大訊飛、中移動、銀聯等用戶OpenStackCyborg項目——項目架構cyborg-apicyborg-conductorcyborg-agentSPDK

driverFPGAdriverGPUdriverNVMeSSDGPUdeviceFPGAdevicecyborg-dbControllerNodeComputeNodeClientAICHIPdriverAICHIPdriverOpenStackCyborg項目——抽象設備模型OpenStackCyborg項目——設備發現OpenStackCyborg項目——Nova-Cyborg集成PlacementNova-apiCyborgagentCyborgdriverNPUDeviceDBRestAPIComputenodeCyborg-apiControllernode#vim/etc/cyborg/cyborg.conf[agent]enabled_drivers=huawei_ascend_driver1.Operatorcanenableordisabledrivers{"name":“ascend-aichip","groups":[{"resources:ACCELERATOR_ASCEND":"1","trait:AICHIP_ASCEND":"required“}]}2.Operatordefinesdeviceprofiles(acceleratorflavor)$openstackflavorset--property\“accel:device_profile_name=ascend-aichip”\ascend-flavor3.OperatorsetsdeviceprofilesincomputeflavorOpenStackCyborg項目——Nova-Cyborg工作流Kubernetes社區——現有異構計算支持Kubernetes社區——kube-acc項目設計Kubernetes社區——kube-acc項目設計思路CreateaCRDbasedframework(kube-acc)forout-of-bandgeneralmanagementforacceleratorsinadditiontoDPImechanism.Coordinatewithanyschedulerimplementationthatsupportstopology-awareandotheracceleratorfriendlyschedulingmechanismCapableofbeingintegratedwithvariousIaaSimplementations(baremetal,OpenStackbased,propetieryclouds,etc)PerformlifecyclemanagementforvarioustypesofacceleratorswiththehelpofDPIpluginsorIaaSlayerfunctionalities.Resourcemanagementoperationsincludebutnotlimitedtothefollowing:AttachDetachDiscoveryProgramming(FPGA,NP,...)Power...Standardizedresourcerepresentation/datamode