wwwsources.list
sources.list 时间:2021-05-05 阅读:()
UsingOpenSourceSoftwaretoTeachMathematicalStatisticsDouglasM.
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
- wwwsources.list相关文档
- citysources.list
- Centersources.list
- Commesources.list
- ensuringsources.list
- filessources.list
- shortlysources.list
DMIT：香港国际线路vps,1.5GB内存/20GB SSD空间/4TB流量/1Gbps/KVM,$9.81/月
DMIT怎么样？DMIT是一家美国主机商，主要提供KVM VPS、独立服务器等，主要提供香港CN2、洛杉矶CN2 GIA等KVM VPS，稳定性、网络都很不错。支持中文客服，可Paypal、支付宝付款。2020年推出的香港国际线路的KVM VPS，大带宽，适合中转落地使用。现在有永久9折优惠码：July-4-Lite-10OFF，季付及以上还有折扣，非 中国路由优化;AS4134，AS4837 均...
修罗云50元/月起香港大宽带NAT VPS，香港沙田建站2核2G5M仅70元/月起
修罗云怎么样?修罗云是一家国内老牌商家，修罗云商家以销售NAT机器起家，国内的中转机相当不错，给的带宽都非常高，此前推荐的也都是国内NAT VPS机器。今天，云服务器网(www.yuntue.com)小编主要介绍一下修罗云的香港云服务器，适合建站，香港沙田cn2云服务器，2核2G，5M带宽仅70元/月起，同时香港香港大带宽NAT VPS低至50元/月起，性价比不错，可以尝试一下!点击进入：修罗云官...
PacificRack（19.9美元/年）内存1Gbps带vps1GB洛杉矶QN机房，七月特价优惠
pacificrack怎么样?pacificrack商家发布了七月最新优惠VPS云服务器计划方案，推出新款优惠便宜VPS云服务器采用的是国产魔方管理系统，也就是PR-M系列，全系基于KVM虚拟架构，这次支持Windows server 2003、2008R2、2012R2、2016、2019、Windows 7、Windows 10以及Linux等操作系统，最低配置为1核心2G内存1Gbps带宽1...
sources.list为你推荐
-
flashftpFLASHFXP怎么用有没有详细的说明??德国iphone禁售令德国买iPhone现在多少钱？ym.163.com免费企业邮箱波音737起飞爆胎为什么很少见到飞机轮胎爆胎?字节跳动回应TikTok易主每天每夜要结束了主持人问关于抄袭的问题，权志龙很认真的回答不想说的，想在以后做好的那段话的音乐叫什360公司迁至天津360公司前身是中国吗？现总裁是谁？360防火墙在哪里360防火墙泉州商标注册泉州商标注册找什么公司？开源网店国内开源网店系统哪款好无忧验证码手机登录前程无忧怎么不显示登录验证码