1、常用英語詞匯 -andrew Ngintensity強度Regression 回 歸Loss function損失函數non-convex 非凸函數neural network神經網supervised learning監察學習課程average firing rate均勻激活率average sum-of-squares error均方backpropagation后向流傳basis 基basis feature vectors特點基向量batch gradient ascent批量梯度上漲法Bayesian regularization method貝葉斯規則化方法regression p

2、roblem回歸問題辦理的是連續的問題classification problem分類問題discreet value失散值support vector machines支持向量機learning theory學 習 理 論 learning algorithms學習算法unsupervised learning無監察學gradient descent梯度降落linear regression線性回Neural Network神經網絡gradient descent梯度降落normal equationslinear algebra線性代數superscript上 標exponentiatio

3、n指數training set訓練會合training example訓練樣hypothesis 假定，用來表示學習算法的輸出LMS algorithm “least mean squares最小二乘法算法batch gradient descent批量梯度降落constantly gradient descent隨機梯度降iterative algorithm迭代算法partial derivative偏導數contour等高線quadratic function二元函數locally weighted regression局部加權回歸underfitting 欠擬合overfitting過

4、擬合non-parametric learning algorithms無參數學習算法parametric learning algorithm參數學習算法activation 激活值activation function激活函additive noise加性噪聲autoencoder自編碼器Autoencoders自編碼算法Bernoulli random variable伯努利隨機變量bias term偏置項binary classfication二元分class labels種類標記concatenation級聯conjugate gradient共軛梯度contiguous group

5、s聯通地區convex optimization software凸優化軟件convolution卷積cost function代價函數covariance matrix協方差矩DC component直流重量decorrelation去有關degeneracy退化demensionality reduction降維derivative導函數diagonal對角線diffusion of gradients梯度的彌散eigenvalue特點值eigenvector特點向error term殘差feature matrix特點矩陣feature standardization特點標準化feedf

6、orward architectures前饋構造算法feedforward neural network前饋神經網feedforward pass前饋傳導fine-tuned微調first-order feature一階特forward pass前 向 傳 導 forward propagation前向流Gaussian prior高斯先驗概率generative model生成模型gradient descent梯度降落Greedy layer-wise training逐層貪心訓練方法grouping matrix分組矩陣Hadamard product阿達馬乘積Hessian matri

7、x Hessian矩hidden layer隱含層hidden units隱 蔽 神 經 元 Hierarchical grouping層次型分組higher-order features更高階特點highly non-convex optimization 高度非凸的優化問題histogram直方圖hyperbolic tangent雙曲正切函數hypothesis估值，假定identity activation function恒等激勵函數IID 獨立同散布illumination照inactive克制independent component analysis獨立成份剖析input do

8、mains輸入input layer輸入層intensity亮度灰度intercept term截距KL divergence相對KL divergence KL分別度k-Means K- 均 值learning rate學習速率least squares最小二乘法linear correspondence線性響應linear superposition線性疊加line-search algorithm線搜尋算local mean subtraction局部均值消減local optima局部最優解logistic regression邏輯回loss function損失函數low-pass

9、filtering低通濾波magnitude幅值MAP 極大后驗預計maximum likelihood estimation極大似然預計mean 均勻值MFCC Mel 倒頻系數multi-class classification多元分類neural networks神經網絡neuron 神經元Newton s method 牛頓法non-convex function非凸函數non-linear feature非線性特norm范 式norm bounded有界范數norm constrained范數拘束normalization歸一化numerical roundoff errors數值舍

10、入偏numerically checking數值查驗numerically reliable數值計算上穩固object detection物體檢測objective function目標函off-by-one error缺位錯誤orthogonalization正交化output layer輸出層overall cost function整體代價函數over-complete basis超齊備基over-fitting過擬合parts of objects目標的零件part-whole decomposti整體分解PCA 主元剖析penalty term處罰因子per-example mean

11、 subtraction逐樣本均值消減pooling池化pretrain預訓練principal components analysis主成份剖析quadratic constraints二次拘束RBMs 受限 Boltzman機reconstruction based models鑒于重構的模reconstruction cost重 修 代 價 reconstruction term重構項redundant冗余reflection matrix反射矩陣regularization正則化regularization term正則化rescaling縮放robust 魯棒性run 行程secon

12、d-order feature二階特點sigmoid activation function S型激勵函數significant digits有效數singular value奇怪值singular vector奇怪向量smoothed L1 penalty光滑的 L1范數處罰Smoothed topographic L1 sparsity penalty光滑地形 L1 稀少處罰函數smoothing光滑Softmax Regresson Softmax回歸sorted in decreasing order降序擺列source features源 特 點 sparse autoencoder

13、消減歸一Sparsity稀少性sparsity parameter稀少性參sparsity penalty稀少處罰square function平方函數方差stationary安穩性（不變性）stationary stochastic process安穩隨機過程step-size步長值supervised learning監察學習symmetric positive semi-definite matrix對稱半正定矩陣symmetry breaking對稱無效tanh function雙曲正切函數the average activation均勻活躍度the derivative checki

14、ng method梯度考證方法the empirical distribution經驗散布函數the energy function能量函數the Lagrange dual拉格朗日對偶函數the log likelihood對數似然函數the pixel intensity value像素灰度the rate of convergence收斂速度topographic cost term拓撲代價項topographic ordered拓撲次序transformation變換translation invariant平移不變性trivial answer平庸解under-complete ba

15、sis不齊備基unrolling組合擴展unsupervised learning無監察學習variance 方差vecotrized implementation向量化實現vectorization矢量化visual cortex視覺皮weight decay權重衰減weighted average加權均勻值whitening白化zero-mean均值為零Accumulated error backpropagation積累偏差逆傳播Activation Function激活函數Adaptive Resonance Theory/ART自適應諧振理論Addictive model加性學習Ad

16、versarial Networks抗衡網絡Affine Layer仿射層Affinity matrix親和矩Agent 代理 / 智能體Algorithm算 法Alpha- beta pruning 剪Anomaly 異樣檢測Approximation近似Area Under ROC Curve AUC Roc 曲線下邊積Artificial General Intelligence/AGI通用人工智能Artificial Intelligence/AI人工智Association analysis關系剖析Attention mechanism注意力體制Attribute condition

17、al independence assumption屬性條件獨立性假定Attributespace屬性空間Attributevalue屬性值Autoencoder自編碼器Automatic speech recognition自動語音辨別Automatic summarization自動綱Average gradient均勻梯度Average-Pooling均勻池化Backpropagation Through Time經過時間的反向流Backpropagation/BP反向流傳Base learner基學習器Base learning algorithm基學習算Batch Normaliza

18、tion/BN批量歸一化Bayes decision rule貝葉斯判斷準則Bayes Model Averaging BMA 貝葉斯模型均Bayes optimal classifier貝葉斯最優分類器Bayesian decision theory貝葉斯決議論Bayesian network貝葉斯網絡Between-class scatter matrix類間散度矩陣Bias 偏置/偏差Bias-variance decomposition偏差方差分Bias-Variance Dilemma偏差 方差窘境Bi-directional Long-Short Term Memory/Bi-LS

19、TM雙向長短期記憶Binary classification二分類Binomial test二項查驗Bi-partition二分法Boltzmann machine玻爾茲曼機Bootstrap sampling自助采樣法可重復采樣Bootstrapping自助法Break-Event Point BEP 均衡點Calibration校準Cascade-Correlation級聯有關Categorical attribute失散屬性Class-conditional probability類條件概率Classification and regression tree/CART回歸樹Classif

20、ier分類器Class-imbalance類型不均衡Closed -form閉式Cluster簇 / 類 / 集 群 Cluster analysis聚類剖Clustering聚類Clustering ensemble聚類集成Co-adapting共適應Coding matrix編碼矩COLT 國際學習理論會議Committee-based learning鑒于委員會的學習Competitive learning競爭型學習Component learner組件學習器Comprehensibility可 解 說 性 Computation Cost計 算 成 本 Computational Li

21、nguistics計算語言Computer vision計算機視覺Concept drift觀點漂移Concept Learning System /CLS觀點學習系統Conditional entropy條件熵Conditional mutual information條件互信息Conditional Probability Table CPT 條件概率Conditional random field/CRF條件隨機場Conditional risk條件風險Confidence置 信 度 Confusion matrix混雜矩陣Connection weight連結權Connectionis

22、m 連結主義Consistency一致性相合Contingency table列聯表Continuous attribute連續屬性Convergence收斂Conversational agen會話智能體Convex quadratic programming凸二次規劃Convexity凸性Convolutional neural network/CNN卷積神經網絡Co-occurrence同現Correlation coefficient有關系Cosine similarity余 弦 相 像 度 Cost curve成本曲線Cost Function成本函數Cost matrix成本矩陣C

23、ost-sensitive成本敏Cross entropy交錯熵Cross validation交錯考證Crowdsourcing眾包Curse of dimensionality維數災害Cut point截斷點Cutting plane algorithm割平面法Data mining數據發掘Data set數據集Decision Boundary決議界限Decision stump決議樹樁Decision tree決議樹判斷Deduction演繹Deep Belief Network深度信念網絡DeepConvolutionalGenerativeAdversarial NetworkDC

24、GAN深度卷積生成抗衡網絡Deep learning 深度學習Deep neural network/DNN 深度神經網絡Deep Q-Learning 深度Q 學習Deep Q-Network 深度Q 網絡Density estimation Density-based clustering密度聚類Differentiable neural computer可微分神經計算Dimensionality reduction algorithm降維算法Directed edge有向邊Disagreement measure Discriminative model Discriminator 鑒

25、別 器Distance measure 距 離 胸 懷Distance metric learning距離胸懷學習Distribution散布Divergence散度Diversity measure多樣性胸懷差別性胸懷Domain adaption領域自適應Downsampling下采樣D-separation（ Directed separation ） 有向分別Dual problem對偶問題Dummy node 啞結點Dynamic Fusion 動向交融General Problem Generalizatio泛化通用問題求解Dynamic programming動向規劃Genera

26、lization error泛化偏差Eigenvalue Embedding 嵌 入Generalization error bound Generalized Lagrange function泛化偏差上界廣義拉格朗日函數Emotional analysis情緒剖析Generalized linear model廣義線性模型Empirical conditional entropy經驗條件熵Generalized Rayleigh quotient廣義瑞利商Empiricalentropy經驗熵GenerativeAdversarial Networks/GAN生成抗衡網Empiricale

27、rror經驗偏差絡Empiricalrisk經驗風險GenerativeModel生成模型End-to-End 端到端Energy-based model鑒于能量的模Ensemble learning集成學習Ensemble pruning集成修剪Error Correcting Output Codes ECOC 糾錯輸出碼Error rate錯誤率Error-ambiguity decomposition偏差 分歧分Euclidean distance歐氏距離Evolutionary computation演化計算Expectation-Maximization希望最大Expected l

28、oss希望損失Exploding Gradient Problem梯度爆炸問題Exponential loss function指數損失函數Extreme Learning Machine/ELM超限學習Factorization因子分解False negative假負類False positive假正類False Positive Rate/FPR假正例Feature engineering特點工程Feature selection特點選擇Feature vector特點向量Featured Learning特點學習Feedforward Neural Networks/FNN前饋神經網Fi

29、ne-tuning微調Flipping output翻轉法Fluctuation震蕩Forward stagewise algorithm前向分步算法Frequentist頻次主義學派Full-rank matrix滿秩矩陣Functional neuron功能神經Gain ratio增益率Game theory博弈論Gaussian kernel function高斯核函數Gaussian Mixture Model高斯混雜模型Generator生成器Genetic Algorithm/GA遺傳算Gibbs sampling吉 布 斯 采 樣 Gini index基尼指數Global min

30、imum全局最小Global Optimization全局優Gradient boosting梯度提高Gradient Descent梯度降落Graph theory圖論Ground-truth實情真切Hard margin硬間隔Hard voting硬投票Harmonic mean 調解均Hesse matrix海塞矩Hidden dynamic model隱動向模型Hidden layer隱蔽層Hidden Markov Model/HMM隱馬爾可夫模Hierarchical clustering層次聚類Hilbert space希爾伯特空間Hinge loss function合頁損失函

31、數Hold-out 留出法Homogeneous同質Hybrid computing混雜計Hyperparameter超參數Hypothesis假 定 Hypothesis test假定考證ICML 國際機器學習會議Improved iterative scaling/IIS改良的迭代尺度法Incremental learning增量學習Independent and identically distributed/獨立同散布Independent Component Analysis/ICA獨立成分剖析Indicator function指示函數Individual learner個體學習器

32、Induction歸納Inductive bias歸納偏好Inductive learning歸納學習Inductive Logic Programming ILP 歸納邏輯程序設計Information entropy信息熵Information gain信息增益Input layer輸入層Insensitive loss不敏感損Inter-cluster similarity簇 間 相 像 度 InternationalConferenceforMachine Learning/ICML國際機器學習大會Intra-cluster similarity簇內相像度Intrinsic value

33、固有值Isometric Mapping/Isomap等胸懷映Isotonic regression平分回歸Iterative Dichotomiser迭代二分器Kernel method核方法Kernel trick核技巧Kernelized Linear Discriminant Analysis核線性鑒別剖析K-fold cross validation k折交錯考證k 倍交錯考證K-Means Clustering K 均值聚類K-Nearest Neighbours Algorithm/KNN K近鄰算法Knowledge base 知識庫Knowledge Representati

34、on知識表征Label space標記空間Lagrange duality拉格朗日對偶性Lagrange multiplier拉格朗日乘子Laplace smoothing拉普拉斯光滑Laplacian correction拉普拉斯修Latent Dirichlet Allocation隱狄利克雷散Latent semantic analysis潛伏語義剖析Latent variable隱變量Lazy learning懶散學習Learner學習器Learning by analogy類比學習Learning rate學習率Learning Vector Quantization/LVQ學習向量

35、量Least squares regression tree最小二乘回歸樹Leave-One-Out/LOO留一法linear chain conditional random field線性鏈條件隨機場Linear Discriminant AnalysisLDA線性鑒別剖析Linear model線性模型Linear Regression線性回歸Link function聯系函數Local Markov property局部馬爾可夫性Local minimum局部最小Log likelihood對數似然Log odds logit 對數幾Logistic Regression Logist

36、ic回歸Log-likelihood對數似然Log-linear regression對數線性回歸Long-Short Term Memory/LSTM長短期記Loss function損失函數Machine translation/MT機器翻譯Macron-P宏查準率Macron-R宏查全率Majority voting絕對多半投票法Manifold assumption流形假定Manifold learning流形學習Margin theory間 隔 理 論 Marginal distribution邊沿散Marginal independence邊沿獨立性Marginalization邊

37、沿化Markov Chain Monte Carlo/MCMC馬爾可夫鏈蒙特卡羅方法Markov Random Field馬爾可夫隨機場Maximal clique最大團Maximum Likelihood Estimation/MLE極大似然預計極大似然法Maximum margin最大間隔Maximum weighted spanning treeMax-Pooling 最大池化Mean squared error均方偏差Meta-learner元學習器Metric learning胸懷學習Micro-P微查準率Micro-R微查全率Minimal Description Length/M

38、DL最小描繪長度Minimax game極小極大博弈Misclassification cost誤分類成Mixture of experts混雜專家Momentum動量Moral graph道德圖正直圖Multi-class classification多分類Multi-document summarization 多 文 檔 綱 要Multi-layer feedforward neural networks多層前饋神經網絡Multilayer Perceptron/MLP 多 層 感 知 器Multimodal learning 多模態學習Multiple Dimensional Scal

39、ing 多 維 縮 放Multiple linear regression 多元線性回歸Multi-response Linear Regression 多響應線性回歸Mutual information互信息Naive bayes 樸實貝葉斯Naive Bayes Classifier樸實貝葉斯分類Named entity recognition命名實體辨別Nash equilibrium納什均衡Natural language generation/NLG自然語言生成Natural language processing自然語言辦理Negative class負類Negative corr

40、elation負有關法Negative Log Likelihood負對數似Neighbourhood Component Analysis/NCA近鄰成分剖析Neural Machine Translation神經機器翻譯Neural Turing Machine神經圖靈機Newton method牛頓法NIPS 國際神經信息辦理系統會議No Free Lunch Theorem NFL沒有免費的午飯定Noise-contrastive estimation噪音對照預計Nominal attribute列名屬性Non-convex optimization非凸優化Nonlinear mode

41、l非線性模型Non-metric distance非胸懷距離Non-negative matrix factorization非負矩陣分解Non-ordinal attribute Non-Saturating Game 非飽和博弈Norm 范 數Normalization 歸 一 化Nuclear norm核 范 數 Numerical attribute數值屬Letter OObjective function目標函數Oblique decision tree斜決議Occam s razor奧卡姆剃刀Odds 幾 率Off-Policy 策略One shot learning一次性學習On

42、e-Dependent Estimator ODE 獨依靠預計On-Policy在策略Ordinal attribute有序屬性Out-of-bag estimate包外預Output layer輸出層Output smearing輸出調制Overfitting過擬合過配Oversampling 過采樣Paired t-test成對 t 查驗Pairwise 成對型Pairwise Markov property成對馬爾可夫性Parameter參數Parameter estimation參數預計Parameter tuning調參Parse tree分析樹Particle Swarm Opti

43、mization/PSO粒子群優化算法Part-of-speech tagging詞性標明Perceptron感知機Performance measure性能胸懷Plug and Play Generative Network即插即用生成網絡Plurality voting相對多半投票法Polarity detection極性檢測Polynomial kernel function多項式核函數Pooling池化Positive class正類Positive definite matrix正定矩陣Post-hoc test后續查驗Post-pruning后剪枝potential functio

44、n勢函Precision查準率正確率Prepruning 預剪枝Principal component analysis/PCA 主 成 分 剖 析Principle of multiple explanations Prior 先驗Probability Graphical Model概率圖模型Proximal Gradient Descent/PGD近端梯度降Pruning剪枝Pseudo-label偽標記Quantized Neural 量子化神經網Quantum computer量子計算機Quantum Computing量子計算Quasi Newton method擬牛頓法Radia

45、l Basis Function RBF 徑向基函Random Forest Algorithm隨機叢林算法Random walk隨機閑步Recall 查全率召回率Receiver Operating Characteristic/ROC受試者工作特點Rectified Linear Unit/ReLU線性修正單元RecurrentNeuralNetwork循環神經網絡Recursiveneuralnetwork遞歸神經網絡Reference model 參照模Regression回歸Regularization正則化Reinforcement learning/RL加強學習Represent

46、ation learning表征學習Representer theorem表示定理reproducing kernel Hilbert space/RKHS重生核希爾伯特空間Re-sampling重采樣Rescaling再縮放Residual Mapping殘差映照Residual Network殘差網絡Restricted Boltzmann Machine/RBM受限玻爾茲曼機Restricted Isometry Property/RIP限制等距性Re-weighting重賦權法Robustness穩重性 魯棒Root node根結點Rule Engine規則引擎Rule learnin

47、g規則學Saddle point鞍點Sample space樣本空間Sampling采樣Score function評分函數Self-Driving自動駕駛Self-Organizing Map SOM 自組織映照Semi-naive Bayes classifiers半樸實貝葉斯分類器Semi-Supervised Learning半監察學習semi-Supervised Support Vector Machine半監察支持向量機Sentiment analysis感情剖析Separating hyperplane分別超平面Sigmoid function Sigmoid函數Similar

48、ity measure相像度胸懷Simulated annealing模擬退火Simultaneous localization and 同步定位與地圖建立Singular Value Decomposition奇怪值分解Slack variables廢弛變量Smoothing光滑Soft margin軟間隔Soft margin maximization軟間隔最大化Soft voting軟投票Sparse representation稀少表征Sparsity稀少性Specialization特 化 Spectral Clustering譜聚類Speech Recognition語音辨Spli

49、tting variable切分變Squashing function擠壓函Stability-plasticity dilemma可塑性 穩固性窘境Statistical learning統計學習Status feature function狀態特點函Stochastic gradient descent隨機梯度降Stratified sampling分層采樣Structural risk構造風險Structural risk minimization/SRM構造風險最小化Subspace子空間Supervised learning監察學習有導師學習supportvectorexpansio

50、n支持向量展式SupportVectorMachine/SVM支持向量機Surrogat loss代替損失Surrogate function代替函Symbolic learning符號學習Symbolism符號主義Synset 同義詞集T-Distribution Stochastic Neighbour Embedding t-SNE T 散布隨機近鄰嵌入Tensor 張 量Tensor Processing Units/TPU張量辦理單The least square method最小二乘法Threshold閾值Threshold logic unit閾值邏輯單元Threshold-mo

51、ving閾值挪Time Step時間步驟Tokenization標記化Training r練偏差Training instance訓練示例訓練例Transductive learning直推學習Transfer learning遷徙學習Treebank 樹 庫Tria-by-error True negative True positive True Positive Rate/TPR真切例率Turing Machine圖靈機Twice-learning二次學習Underfitting欠擬合欠配Undersampling欠采樣Understandability可理解Unequal cost非均

52、等代價Unit-step function單位階躍函數Univariate decision tree單變量決議樹Unsupervised learning無監察學習無導師學習Unsupervised layer-wise training無監察逐層訓Upsampling上采樣Vanishing Gradient Problem梯度消逝問題Variational inference變分推測VC Theory VC維理論Version space版本空間Viterbi algorithm維特比算法Von Neumann architecture馮 諾伊曼架構Wasserstein GAN/WGA

53、N Wasserstein生成抗衡網Weak learner弱學習器Weight權重Weight sharing權共享Weighted voting加權投票法Within-class scatter matrix類內散度矩陣Word embedding詞嵌入Word sense disambiguation詞義消歧Zero-data learning零數據學習algebra 線性代數asymptotically無癥狀appropriate 適合的bias 偏差brevity 800 broader 寬 泛briefly 簡潔的batch 批量convergence收斂，集中到一點convex

54、凸 的contours 輪 廓constraint 拘 束constant 常 理commercial complementarity增補coordinate ascentclipping 剪下物；剪報；修剪component 重量；零件continuous 連續的covariance 協方差canonical concave 非凸的corresponds 相切合；相當；通訊corollary 推 論concrete 詳細的事物，實在的東cross validation交錯考證correlation 互相關系convention 商 定cluster 一 簇centroids質心，形conve

55、rge 收 斂Zero-shot learning零次學習approximations近似值calculus 計 算機的arbitrary 任意的affine 仿射的arbitrary 任意的amino acid 氨基酸amenable axiom 公義，原則abstract 提 取architecture架構，系統構造；建筑業absolute 絕對的arsenal 軍械庫assignment derive 獲取，獲得dual 二元的duality 二元性；二象性；對偶性derivation 求導；獲取；發源denote divergence散度；發散性dimension dot小圓點distortion 變 形density 概率密度函數discrete 失散的邏指稱discriminative有辨別能力的diagonal 對 角dispersion 分別，散determinant決定要素disjoint 不訂交的encounter 碰 到ellipses 橢 圓equality 等 式extra 額外的empirical 經驗；察ennmerate 例舉，計exceed 超出，越出expectation希望effic