Baumüller DSG56-M 為了將網(wǎng)絡保存在磁盤上，我們需要記錄網(wǎng)絡中每個單一權(quán)重的值。這意味著為每個參數(shù)保存一個浮點數(shù)，這代表了磁盤上占用的大量空間。作為參考，在C中，一個浮點占用4個字節(jié)，即32個比特。一個參數(shù)在數(shù)億的網(wǎng)絡（例如GoogLe-Net或VGG-16）可以輕松達到數(shù)百兆，這在移動設備上是不可接受的。
為了保持網(wǎng)絡足跡盡可能小，一種方法是通過量化它們來降低權(quán)重的分辨率。在這個過程中，我們改變了數(shù)字的表示形式，使其不再能夠取得任何價值，但相當受限于一部分數(shù)值。這使我們只能存儲一次量化值，然后參考網(wǎng)絡的權(quán)重。
量化權(quán)重存儲鍵而不是浮動。
我們將再次通過查找飽和點來確定要使用多少個值。更多的值意味著更高的準確性，但也是更大的儲存空間。例如，通過使用256個量化值，每個權(quán)重可以僅使用1個字節(jié) 即 8個比特來引用。與之前（32位）相比，我們已將大小除以4！
6. 編碼模型的表示
我們已經(jīng)處理了關于權(quán)重的一些事情，但是我們可以進一步改進網(wǎng)絡！這個技巧依賴于權(quán)重不均勻分布的事實。一旦量化，我們就沒有相同數(shù)量的權(quán)值來承載每個量化值。這意味著在我們的模型表示中，一些引用會比其他引用更頻繁地出現(xiàn)，我們可以利用它！
霍夫曼編碼是這個問題的完美解決方案。它通過將最小占用空間的密鑰歸屬到最常用的值以及最小占用空間的值來實現(xiàn)。這有助于減小設備上模型的誤差，的結(jié)果是精度沒有損失。
最頻繁的符號僅使用1 位的空間，而最不頻繁的使用3 位。這是由后者很少出現(xiàn)在表示中的事實所平衡的。
這個簡單的技巧使我們能夠進一步縮小神經(jīng)網(wǎng)絡占用的空間，通常約為30％。
注意：量化和編碼對于網(wǎng)絡中的每一層都是不同的，從而提供更大的靈活性
Baumüller DSG56-M 糾正準確度損失（Correctiong the accuracy loss）
使用我們的技巧，我們的神經(jīng)網(wǎng)絡已經(jīng)變得非常粗糙了。我們刪除了弱連接（修剪），甚至改變了一些權(quán)重（量化）。雖然這使得網(wǎng)絡超級輕巧，而且速度非？，但其準確度并非如此。
為了解決這個問題，我們需要在每一步迭代地重新訓練網(wǎng)絡。這只是意味著在修剪或量化權(quán)重后，我們需要再次訓練網(wǎng)絡，以便它能夠適應變化并重復這個過程，直到權(quán)重停止變化太多。
AX521
AX522
TU515
TU516
TU531
TU532
DC551-CS31
PM564-R-AC
DC522
DC523
DC532
DX522
DX531
AI523
AO523
AX521
AX522
TU515
TB521-ETH
TB521-ARCNET
TB541-ETH
MC502
TK501
TK502
TA521
TA522
TA526
TA524
PS501
PS541-HMI
CM572-DP
CM575-ETH
CM578-CN
DI524
TU532
DC505-FBP
TU505
DC551-CS31
TU551-CS31
TU552-CS31
AC31GRAF-English
DC522
DC523
DC532
DX522
DX531
AI523
AO523
AX521
AX522
TU515
TU551-CS31
TU552-CS31
DC505-FBP
SA811F
TU506-FBP
PM554-R-AC
AO801
PM591-ARCNET
PM591-ETH
PM591-ARCNET
TB511-ETJ
TB511-ETH
TB511-ARCNET
TB521-ETH
TB521-ARCNET
TB541-ETH
MC502
TK501
TK502
TA521
TA522
Hioki 8846 Memory Hicorder+4X 8918 Temp+3X 8927 Analog
Agilent E6432A VXI Microwave Synthesizer
Agilent E6404C IF Processor Digitizer/DSP
HP / Agilent E1429A/E1429B 20 MSa/s 2-channel Digitizer
LEICA M420 M400 DMLS Trinocular + XYZ + Apozoom 1:6
Domnick Hunter DAS-4 Pneudri Midas Air Dryer
Analogic DBS9900 VXI C-Size Module
Adimec MX12P Progressive Scan Camera
Kenwood DB-33LMNY1 Jitter Meter
Climet CI-400-0-0-1 Laser Particle Counter
Potomac FIM-71 Field Strenght Meter 45-225Mhz
TSE Boss BBT20000 Burn-In Board Test System
Advanced Energy RFX-600 RF Generator S/N: 72806
Advanced Energy RFX-600 RF Generator S/N: 150353
National Instruments NI PXI-4071 71/2 Digit FlexDMM
Smac LAR30-025-55CV MOD282 Linear Actuator
HP 82000 E1222-66503 E122266503 PMU Board NIB
Pfeiffer MVP 020-3DC Vacuum Inside Gatan Enclosure
HP C E1428A Digitizing Oscilloscope 1 Gsa/s 250 MHz
TTC Fireberd 6000A Communications Analyzer sn: 07498
UNI-LITE NG Luminometer from Biotrace
Hioki 3532 LCR HiTester
Astec VS3-D9-B5-G25-06 Power Supply
Leader LT1610A LT-1610A Programmable Video Generator
A.P.E. SMD-1000 Chipmaster Rework System
_ Lot 10pc RACAL 5021 5020A TEC5021 Temp Control 407944
HP J2302A E1 Internet Advisor OPT200
Bay Networks 5304P 10 Base-F Ethernet Host Module
HP 75000 Series C E1430A 10MSa/s ADC + Filter + FIFO
Delta F Platinum Series FAH0500 Process Oxygen Analyzer
Navini P2-CC 91-12200-06 FAB 22-12200-06 Rev. A Board
Navini SYN 2.6GHz 91-17126-17 22-17126-05 Board
Agilent E1413C 64-Channel Scanning A/D
Omron CVM1-CPU11-EV1 CVM1CPU11EV1 PLC Controller
SIEMENS HICOM ATTENDANT/ CONSOLE AC 2
HP 82000 E1216A E1216-66504 E121666504 PMU Board
Astec VS1-L5-02 (-452) 500W
Mitsubishi HC-SFS152G2 Servo Motor w/ ANFJ-L20-SV-5 NEW
Credence ASL 1000 Power Supply P/N:122-1081-01
Ono Sokki CL-6200 CL6200 Noncontact Thickness Meter
Ion System Inc. 210 Charge Plate Monitor w/ case
Siemens 6SE3215-2CB40 Drive
YASKAWA CACR-IR01SFB CACRIR01SFB SERVO SERVOPACK
ELABO 91-3J/ 9546008 Programmable PE/IS/HV Tester
ELABO 91-3J/953001 Programmable PE/IS/HV Tester
ELABO 91-3J/9616014 Programmable PE/IS/HV Tester
Astec VS3-D8-D8-02 (572-CE) 115/230V 15A 50/60/400Hz
LH Research SMA81-1/230/R Power Supply
Astec VS3-L0-K2-A2-02 (489) 2000W Power Supply
RAD DXC-2/230 PN: 7710010000 230VAC 0.1A
Coulter MQP Multi-Q-Prep Lysing Workstation
Cognex KV-7100N-PKG-E 7000-0015-01
ABB EHDB 650 Spectrum Drive Contactor 600VDC 650A
Siemens Simatic 555-1103 Processor
Hewlett Packard E1445A Arbitrary Function Gen.
North Atlantic 530/20 530S-1634 Synchro Simulator
Anritsu KL330B/KL230A Displacement Meter
Omron R88D-WT08H Servo Drive w/ R88M-W75030H Motor 750W
ASM Hipec Motion Solution 00-22
Domnick Hunter DM003 Refrigerated Compressed Air Dryer
Met One 237B-3-1-1 Laser Particle Counter with Case
Picturetel 210 55421-02001 VIV-323/1E
Mitsubishi Melsec PLC A173UHCPU Motion Controller CPU
Rion KC-18 Particle Counter
Kikusui Pan 16-50 Regulated DC Power Supply 0-16V 50A
HP K382A Variable Attenuator
Power-one HPM5AUF1A1A1C1S211 230V 23A Power Supply
Electrophysics 7215 Handheld Near IR Viewer
HP Agilent E1693A ATM Generator
ACM Instruments DSP Field Machine for Corrosion Test
Leader LE 1870 LE1870 Jitter Meter
Omron R88D-WT08H AC Servo Driver 200V 750W R88DWT08H
Parker Digiplan BLX150F-Fico-4 P/N: 31555733
Kyoto KEM APB-410 Auto Piston Burette
Tektronix G9F-2746-00 Cage 80009 Acquisition Processor
EO Technics SC-100 Synrad Carbon Dioxide Laser
Siemens THYSSENKRUPP 787AF3 Starter
Desco 19780 Digital Surface Resistance Test Kit
Proface GP530-TC11 / GP430-PX31 Graphic Panel
Zentech 9032A Auto Safety Tester S/N:710032
Zentech 9032A Auto Safety Tester S/N:710142
Zentech 9032A Auto Safety Tester S/N:710031
HP Agilent 83446A Lightwave Clock/Data Receiver
Nikon 60295A w/ BD Plan,40, 20,100 DIC Optics
Zentech 9032A Auto Safety Tester S/N:9609501
Zentech 9032A Auto Safety Tester S/N:710114
Zentech 9032A Auto Safety Tester S/N:9607641
Zentech 9032A Auto Safety Tester S/N:710144
Anorad Controller 7460 13
Anorad 5/97 Controller 500003 33
Proface GP570-TC11 GP570TC11 Graphic Panel
Parker SX3-Drive-PR Compumotor Drive
Omron R88D-HS22 AC Servo Driver
Hitachi YAGV12H 4CH. Analog Out
Hitachi YAGV12H 4CH. Analog Output Module
ANSALDO Type SVVP3.7FP Silcovert V
Nemic Lambda EWS1500-12 12VDC 125A+S Power Supply
HP E3003-61070 DTH MUXR
Nemic Lambda EWS1500-12 Power Supply 12VDC 125A +S
Artesyn M3001-7E-033 706436-151 Power Supply
Cisco 1841 Router S/N: FHK125028TN
Cisco 1841 Router S/N: FHK1038199E
Cisco 1841 Router S/N: FHK112516J8
Cisco 1842 Router S/N: FHK130926U0
Cisco 1843 Router S/N: FHK111514MD
Cisco 1844 Router S/N: FHK1105F3KV
National Instruments PXI-2586 10 Channel
Fortress Interlocks AMLOK024024 Switch
Giddings&Lewis NSM3412 M.1015.6955 Servo Motor
Jetter DIMA3-ES-16 Controller
Omron E5M-TM01QP E5MTM01QP Temperature Controller
Proface GP2501-TC11 3180021-03 Touch Panel
Mitsubishi FREQROL F500 FR-F540-1.5K Inverter
Pro-face GP2500-TC11 Touch Panel
Eltron P420 P420C ID Card Printer
Hitachi COMM-2H Intelligent Serial Port Module
Lot 4 Hitachi YAGV12H / XAGV12H / YTS48BH Module
Hakko GD-MDD2 GDMDD2 PLC Controller
Nemic LAMBDA HR-9F-12 HR9F12 Power Supply 12V DC 3A
Oriental M315-402 Speed Control Motor / US315-02 NIB
Vexta Oriental PK564AU-TG20 5-phase Stepping Motor
Vexta Oriental PK566AUS 5-phase Stepping Motor
Oriental 0IK1GN-C 0IK1GNC Induction Motor New NIB
Kollmorgen CR06250 CR06250-2G405A Servo Amplifier
Kollmorgen CB06250 CB06250-1D062M7 Servo Amplifier
Swift Design MUAA Music Semiconductors
MC Test C212-D-Y44LCC01 Credence SC212
MC Test C212-C-T456 / 36BGA11 Credence SC212
MC Test C212-D-240W Credence SC Series
Jantec Services PLCC44 Narrowport Music Semiconductors
Oriental M540-402 Speed Control Motor / US540-02T NIB
Videotek Prodigy C Switch CPU PD-100 Rev.B PD100 Board
Cisco 7505 Router S/N: 50020549
Credence 02-3122-02 04-3122-01 06-3122-01 Board Rev.D
Credence 07-3106-01 07310601 PMU Board Rev.E
在線咨詢 
