wwwsources.list
sources.list 时间:2021-05-05 阅读:()
UsingOpenSourceSoftwaretoTeachMathematicalStatisticsDouglasM.
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
- wwwsources.list相关文档
- citysources.list
- Centersources.list
- Commesources.list
- ensuringsources.list
- filessources.list
- shortlysources.list
美国多IP站群VPS商家选择考虑因素和可选商家推荐
如今我们很多朋友做网站都比较多的采用站群模式，但是用站群模式我们很多人都知道要拆分到不同IP段。比如我们会选择不同的服务商，不同的机房，至少和我们每个服务器的IP地址差异化。于是，我们很多朋友会选择美国多IP站群VPS商家的产品。美国站群VPS主机商和我们普通的云服务器、VPS还是有区别的，比如站群服务器的IP分布情况，配置技术难度，以及我们成本是比普通的高，商家选择要靠谱的。我们在选择美国多IP...
华为云年中聚惠618活动，新用户专区，云服务器低至88元/年，3年仅580.98元，热销抢购中，最后2天！
华为云怎么样？华为云用在线的方式将华为30多年在ICT基础设施领域的技术积累和产品解决方案开放给客户，致力于提供稳定可靠、安全可信、可持续创新的云服务，做智能世界的“黑土地”，推进实现“用得起、用得好、用得放心”的普惠AI。华为云作为底座，为华为全栈全场景AI战略提供强大的算力平台和更易用的开发平台。本次年终聚惠618活动相当给力，1核2G内存1m云耀云服务器仅88元/年起，送主机安全基础版套餐，...
企鹅小屋：垃圾服务商有跑路风险，站长注意转移备份数据！
企鹅小屋：垃圾服务商有跑路风险！企鹅不允许你二次工单的，二次提交工单直接关服务器，再严重就封号，意思是你提交工单要小心，别因为提交工单被干了账号！前段时间，就有站长说企鹅小屋要跑路了，站长不太相信，本站平台已经为企鹅小屋推荐了几千元的业绩，CPS返利达182.67CNY。然后，站长通过企鹅小屋后台申请提现，提现申请至今已经有20几天，企鹅小屋也没有转账。然后，搞笑的一幕出现了：平台账号登录不上提示...
sources.list为你推荐
-
吉安隆海锋永政采字【2020】36信用卡appleapple.com.cn苹果官方网址到底是http://store.apple.com/cn/？还是 http://www.apple.com.cn？？？？accessdenied上网时电脑上显示access denied 是怎么回事filezillaserver如何使用filezilla serverflashfxp下载怎么用flashFXP下载空间内容曲目ios三五互联科技股份有限公司厦门三五互联科技股份有限公司 怎么样？可信网站网站备案了,还要验证可信网站吗？他们有什么区别中国保健养猪网猪场基本保健包括哪些方面？