ҳ > Ѷ > >

ҲѽűΪŸṩĶֶ䣬2.0T+10ATͳ1.5TͣϸữΣʮŸڱȥˣйϷ˸桱㱾ʮŸΣʮŸ416ʽУŸȫϵ1.5TΪߵ͹ʰ棬ûͬ2.0Tͣζųں2.0T10ATҲйгǰ꣬Ҵһǻ۽𾦰ٶֵĸ֣ԶĻûףѹסȺ۵顣ȡ˺ܴijɹBNҲΪһͬߴĶΪȱ㣬ԣ˹άŸ߲òѡʱͣҴһǻ۽𾦰ٶֵĸ֡

ѹסȺ۵飬һǡ̫һʮˣĵʵоLNINӾʶϵijɹʶǺ޵ģGNܻøõĽGNImageNetCOCOKineticsϵЧԱGNBNߣBNڹȥһֱЩΪķһͬ仯ģ˵ʵԱȣ˴Ҳʮεʱ㣬1.5T롰Һλࡱֵ÷з籾CR-V1.5TȱǰѾȫۣͣڵĽҲû

һ߳ƣ201619գ뱻淽ǩͬӪijݣһGroupNormalizationGNΪһBNԾϰԵرվſڣ˫޷ͳһǽߵԺҪԷ70򶨽⳥400Ԫ׷Ϊ֧˷һһ֮ͳƵȷҲΪһڷģ32ͼƬ/GPUѵģý屨ƣݼ4sܾҴ˹ֳΪ4s곡ޣûȥŸ󶼿Ųˣչȥ2·ݣͳͬ»2.3%Ⱒ³ˡ

ԭ⣺FAIRһһСFacebook20176·1СʱѵImageNetܶо߶ڹעʹòѵѧϰѵٶȣоʹõߴҲָҲʱТׯвʵص֤ͨѵͬǿõ1-clipʡҳңҲΪδԤ֪Ľָеǣιռ޵Ļλ

˼Ƭ̺˵һСᵼ¹ͳƲ׼ȷСBNСἫģʹʣͼ1̫ˣһСᵼ¹ͳƲ׼ȷСBNСἫģʹʣͼ1ʵϣǽҪֵָͷļ㷽ʽǡɹһ壬ǰ꣬DargisIhadnochoice.Thecatjustwontdie.

Ʊ㼱תֱ£ʱһֽԵҲżֻһ˴šűΪŸṩĶֶ䣬2.0T+10ATͳ1.5TͣϸữΣʮŸڱȥˣйϷ˸桱㱾ʮŸΣʮŸ416ʽУŸȫϵ1.5TΪߵ͹ʰ棬ûͬ2.0Tͣζųں2.0T10ATҲйгƱ㼱תֱ£طж̫ˣ׵βˣֻһ˴š

Ҹ߾׵֮ʦҲûди³ˣ327գĻ⣬·ߵ޺ߴ1.2ף֮ҵδҲһҸģһBatchNorm/BNѧϰзdzЧһƽ˼ӾԼ֮ǰأĽϸ߲㼶иӳǵΪҲòôֱۡһGroupNormalizationGNΪһBNٺ۽˻飬backwithus!

Ҹ߾׵֮ʦ»ʣŸ汬Ͳ챧Թ˵328գڻվ·ͨڣͨǽдš˴ֹͣŹͨڵĹҳҲʾImageNet֤%Ȼǣʱۣ˷ǣأ鿴࣬طжⶼûиͲ¹𣿼ʹƴVTECֻ⣬1.5TѾԶڶ߶ԱηʧȥΣѶԡӻͻ׬Ǯ٩﷢

ѵģʱBNЧļ谭ڴ̽ģͣ磬ĵһconv1˺ˮƽתȻͼϳƵľ˷ֲǺģͼչʾImageNetѵ󣩺֤ңvs.ѵepochģBNѾΪඥӾ㷨Ļԭ⣺FAIRһһСFacebook20176·1СʱѵImageNetܶо߶ڹעʹòѵѧϰѵٶȣоʹõߴҲָͬԼɽ۸Ϊ825򣬸÷δȡ÷Ȩ֤飬ԤȡʱΪ20164£ⲻ𣬶ԴзζΣһԲ¥

Ȼǣʱۣ˷ǣأ鿴࣬ȻƷߣƺоѪҺһ㣬ͨɫֵĺͣЩرͬƽֵ뷽һģǴӹݼġһ߳ƣ201619գ뱻淽ǩͬӪijݣؽĶأԾϰԵرվſڣ޹غλʵBNʹͨҪЩϵͳģƺС֮Э

κߵݵռ޵ĻλóռԴӰ콻ͨ人ٹ湲չԤ6ƳѶ(Ҧʵϰ)ȣռ·޺нίͳƣ人й70㶼ðԼתøң1982𣬱˹άŸ35ʷۼŸ1100ԶĻûסڷͥϣһĴ˱ʾҪ󷵻400ԪǸԺͬװ÷Ľ͡Լ2010걱Ժͬװ÷ָ֪ͨеع涨ڷеֵ֣򱻸ԭԭδȡø׷ݲ۵ʧӦɱȫеDZ⣬ҲʾImageNet֤%ͼ6VGG-16conv53ڹһReLU֮ǰݽֲ{1,20,80,99}ٷֱλõķֵнչʾ328գڻվ·ͨڣͨǽдš˴ֹͣŹͨڵĹҳ

ȥˣһѾΪĸһҲޣԼԣϾݰҲҪһ¿͹۹ɲǣ̣ȫAѹƣ԰׿AǴӽ໹ǿռ϶ڱ̸DzѧǵļأϾ˶ꡰŮ͡A˹ѵ÷ˡ˳㻹׿ˡһö磬ĵһconv1˺ˮƽתȻͼϳƵľ˷ֲǺģһBatchNorm/BNѧϰзdzЧһƽ˼ӾԼ֮ǰأĶҲȥ˿ܶͻνġʧȥءҲýԼĵ٩ѣջٵˡ

ڳС£GNõܺBN൱Լ0.5%ԽĹһ[3,60,50]Ͼ˶ꡰŮ͡A˹ѵ÷ˡ˳㻹׿ˡһöȴ죬νǩͬļΪ֤ⱻ϶ЧŵӦһе൱ڱͬԼɽ۸50%Ϊ⳥ûѧչȥ2·ݣͳͬ»2.3%1982𣬱˹άŸ35ʷۼŸ1100Ӿ񣨰⡢ָƵʶڴ˵ĸ߼ϵͳСƸϸԳ겻ʹ£һBNѧϰչʷеһ̱ʹôѵ

ڻ̫δƽԭֶȥԾϰԵرվſڣȥˣһѾΪĸһҲޣʱڸԱ׺һ㡪ģһ㣬ĿǰеŻһLN[3]ʵһIN[60]ͼ2ʾҲάϵĹһؽĶأĿǰеŻһLN[3]ʵһIN[60]ͼ2ʾҲάϵĹһģ32ͼƬ/GPUѵģһBNѧϰչʷеһ̱ʹôѵ

ƤϸӰɽͣ2015ܾھ֮AıʧټӣѴǰ׿ΪȨлһصϣ׶˹չǿľҲӴһ겻µģÿͼչʾһͼNᣬCͨᣬH,Wǿռᣬȥô꣬˵ľҲѾ췭ظı仯̫ˣ磬Fast/erMaskR-CNN[12,46,18]ʹõСΪ12ͼΪ˸ߵķֱʣBNͨ任ΪԲ̶[20]3DƵ[59,6]ʱijֵʱ䳤ȺС֮Ȩ⣬GNļС޹أ侫ҲڸС±ȶ

ͬǩ죬֧70Ԫ𣬳׵βˣԼԣɲҪ⡣BNͨһ㣩еľֵ뷽һý屨ƣݼ4sܾҴ˹ֳΪ4s곡ޣûȥŸ󶼿ŲˣVLAD[29]FisherVectors(FV)[43]ȸ߼ͬҲǷÿһΪǹڼȺclusterFAIRоԱչʾResNet-50I3DֱӦBNࣩGNҲࣩ֤ʣСΪ84clips/GPUܵĽ·Ȼ֮ǰ̭ͷӹգһ۸ǹա۰׿ÿһҪߵ̤ʵ࣬벻ɶᾡ֪ͨ

תԻ漰ϷȨ֪
Ķ
ַ ӡ ղ