XiaogangTIAN3軟件需求分析軟件驗證需求挖掘確認系統需求分析系統架構設計系統驗證系統集成與集成驗證軟件需求分析軟件驗證需求挖掘確認系統需求分析系統架構設計系統驗證系統集成與集成驗證軟件架構設計軟件詳細設計與單元構建軟件組件驗證與集成驗證軟件單元驗證硬件需求分析硬件設計硬件需求驗證硬件設計驗證項目管理風險管理度量過程改進重用產品管理機器學習需求分析機器學習架構機器學習訓練機器學習模型測試供應商監控機器學習數據管理機器學習數據管理質量保證配置管理問題解決管理變更請求管理產品發布45MLmodel.csNote2:ThedetailsoftheMLmodelmaydifferbetweentheMLmodelusedduringtrainingMLmodel.cs67MLE.2.BP2:確定超參數范圍和初始值。確定并記錄超參數范圍和初始值，以作為訓練的基礎。8MLE.2.BP4:定義ML架構要素的接口。確定和記錄每個ML架構要素的內部和外部接口，包括其與相關MLE.2.BP5:定義ML架構要素的資源消耗目標。確定并記錄所有相關ML架構要素在訓練和部署過程中9MLE.2.BP6:建立雙向可追溯性并確MLE.2.BP7:溝通約定的ML架構。MLEProcessResearch-6thSYSconferenceChinainShanghai,2ndNovember2023[1]AttentionIsAllYou[1]AttentionIsAllYouNeedTobeselectedmodel:Transformer,Recurrent,Convolution[2]ON[2]ONTHERELATIONSHIPBETWEENSELF-ATTENTIONANDCONVOLUTIONALLAYERSBP3EvaluateMLADBP3EvaluateMLADelementsBP7communicateBP1DevelopMLArchitectureBP2DetermineHyperparameterBP4DefineinterfacesBP6Consistency&TraceabilityBP5ResourceConsumptionMLEProcessResearch-6thSYSconferenceChinainShanghai,2ndNovember2023Embedding…………………BP3EvaluateMLADelementsBP5BP3EvaluateMLADelementsBP5ResourceConsumptionBP7communicate1000…00100…00010…00001…0……0000…00000……BP1DevelopBP1DevelopMLArchitectureBP2DetermineHyperparameterBP4DefineinterfacesBP6Consistency&TraceabilityMLEProcessResearch-6thSYSconferenceChinainShanghai,2ndNovember2023 [3]BERT:Pre- [3]BERT:Pre-trainingofDeep BidirectionalTransformersfor-LanguageUnderstanding TransformerwithContinuousDynamicalModel BP5ResourceConsumptionBP7communicateBP4BP5ResourceConsumptionBP7communicateBP4DefineinterfacesBP1DevelopMLArchitectureBP3EvaluateMLADelementsBP2DetermineHyperparameterMLEProcessResearch-6thSYSconferenceChinainShanghai,2ndNovember2023 https://jalammar https://jalammar.github.io/illustrated-transformer/?BP1DevelopMLArchitectureBP1DevelopMLArchitectureBP2DetermineHyperparameterBP3EvaluateMLADelementsBP4DefineinterfacesBP5ResourceConsumptionBP6Consistency&TraceabilityBP7communicateMLEProcessResearch-6thSYSconferenceChinainShanghai,2ndNovember2023https/docs/stable/generated/torch.nn.LayerNorm.htmlBP6Consistency&TraceabilityBP7communicateBP1BP6Consistency&TraceabilityBP7communicateBP1DevelopMLArchitectureBP2DetermineHyperparameterBP3EvaluateMLADelementsBP4DefineinterfacesBP5ResourceConsumptionmethods.dependingontheMLrequirements.