data mining notes.docx
- 文档编号:6695768
- 上传时间:2023-01-09
- 格式:DOCX
- 页数:13
- 大小:1.27MB
data mining notes.docx
《data mining notes.docx》由会员分享,可在线阅读,更多相关《data mining notes.docx(13页珍藏版)》请在冰豆网上搜索。
dataminingnotes
Intro
Problemscategories
Clustering
Classification
Regression
Dimensionreduction
DataVisualisationandInterpretation
Descriptivestatistics
Mean
Median
Dispersion
Statisticaldistributions
Themedianisamorerobustestimatorofthecentraltendency
ThedifferenceQ3-Q1istheinterquartilerange(orIQR)it'samorerobustdispersionmeasure
NormalDistribution
SkewedDistribution
Visualisation
Boxplot
Scatterplot
Boxplot:
Theredmarkshowsthemean
Theboxgoesfromthelowerquartiletotheupperquartile
Theboxisthuscentredonthemedian
Thewhiskersaretheminimumandmaximumvalues
Outliersvaluesareshownasbluecrosses
Outliersarevalueswhicharebeyond1.5*IQRfromthequartiles
Distances
HammingDistance
Levenshteindistance
TheLevenshteindistanceistheminimumnumberofeditsneededtotransformonestringintotheother
1insertionofacharacter
2deletionofacharacter
3substitutionofacharacter
DamerauLevenshteindistance
TheDamerauLevenshteindistanceislikethe
Levenshteindistance,withonemoreeditoperation
1insertionofacharacter
2deletionofacharacter
3substitutionofacharacter
4transpositionof2adjacentcharacters
JaroDistance
K-Means (P166)
Clusteringquality
Internal:
External:
Initialization:
random
kmeans++:
distantplots
Perceptron(P67)
Multi-LayerPerceptron(P76)
AMulti-LayerPerceptronismadeofcneurons,connectedtoanoutputneuron
_Eachinnerneuronactsasanindependenthyperplanes
_Thetopneuroncombinestheindependenthyperplanes
_Wecannowclassifydatabycombininghyperplanes
Flaws
Datanormalization
MLPwon'tworkifyoudon'tnormalizeyourdata
_TheoutputoftheMLPisinalimitedrange(say[-1;1])
_Iftheinputsareoutofrange,MLPlooseinformation
Over-fitting
Pastanumberofaneurons
_Verylittleimprovementoftheerror
_Mostlylearningnoiseofthedata
_over-fitting
Trainingerror:
errorforthetrainingpoints
Testingerror:
errorforpointsnotusedduringtraining
MaximizaionStep:
Initialization
SimpleinitializationforKcomponentsandNsamples
1RandomcreateKclustersofsamples,samesize
2Initial
forCiisthesamplemeanoftheclusteri
3Initial
forCiisthesamplestandarddeviationoftheclusteri
4InitialwforCiis1/k
Kmeansinitialization
multivariateGaussianmix
DecisionTree(p40)
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- data mining notes