c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(3)

发布时间:2021-06-07

Abstract. A data cube is a popular organization for summary data. A cube is simply a multidimensional structure that contains in each cell an aggregate value, i.e., the result of applying an aggregate function to an underlying relation. In practical situat

LOGLINEAR-BASEDQUASICUBES257densechunksofthecorecuboidinthedatacube.Thesemodels,canbeusedtoestimatecells,withacertaindegreeofaccuracy.Wekeeptheerrorscausedbytheestimationprocessundercontrolbystoring,alongwiththemodelparameters,thosecellswhoseestimatedvaluesdifferfromtherealvaluesbymorethanapre-establishedthreshold.Thisideamaintainsa xedboundforqueriesoverthecorecuboid,providingguaranteesfortheapproximatedanswers.Moreover,theideacanbeeasilyextendedtoanyothercuboid(withouthavingtorecomputemodelsforanyofthesecuboids):bymaintainingasmallnumberofcellsineachlevelofaggregation,orcuboid,wecanhaveguaranteedboundsforapproximateanswersovertheentiredatacube.This,isanalternativetotechniquesthatdecidewhichpartsofthecubeshouldbematerializedtoobtainagoodtradeoffbetweenspaceandqueryperformance,suchastheheuristicspresentedinHarinarayanetal.(1996).Inourcase,withaverysmallinvestment(afewofthecuboids’cells)wecanprovideapproximateanswersforqueriesposedoverallthedatacube.Moreover,withcoarseraggregations(cuboidswithlessdimensions,suchasday,productinthelatticeof gure1),wecanguaranteetighterboundsfortheanswers,simplybecausetheerrorscommittedbytheestimationofindividualcellstendtocanceleachother.

WecallthestructurethatresultsfromstoringthemodelsandtheretainedcellsaQuasi-Cube.Itisimportanttoemphasizethat,inaQuasi-Cube,theerrorboundcanbekeptatadesiredlevel,independentlyofthedistributionofthedata.Whenansweringqueries,thesystemcanusethemodelsandtheretainedcellstogiveananswerwithaguaranteedmaximumerrorlevelattachedtoit.

Parametricmethodstocompressdatacubeshaveanadvantageoverothertechniques(suchastheonesdescribedinPoosalaetal.(1996)andVitterandWang(1999)):theparameterscomputeddescribethedataaccuratelyandcanserveasagoodbasistomineimportantconclusionsabouttheunderlyingdistributionofdata.Thestructureofthemodeldescribesthepatternsofinteraction(Agresti,1996).Moreover,onecanimmediatelyknowwhichdimension(orcombinationsofdimensions)exertthebiggestin uenceinthedatabylookingattherelativesizeofthemodelparameters(Agresti,1996).Bycomparison,itisdif culttodrawinformationfromahistogram(asusedinPoosalaetal.(1996))orawaveletdecomposition(asusedinVitterandWang(1999)).AlthoughtheapproachusedinShanmugasundarametal.(1999)offerssimilaradvantagestoourtechniquebyobtainingakernelthatexplainsthedistributionofthedata,itiswell-knownthatkernelestimationsareveryinef cientasthenumberofdimensionsgrow(Silverman,1994).Thisistruebecausetruncatingthetailsofthedistributionscanhaveanenormouseffectontheerrorsobtained.(Inotherwords,inmoderate-tohigh-dimensionalcases,regionsofrelativelowdensitycanstillbeveryimportantpartsofthedistribution.)Incontrast,itisknownthatanydistributioncanbeapproximatedarbitrarilyclosebyaparametricmodelbyusingenoughparameters(CherkasskyandMulier,1998).Infact,themodelwithwithtoomanyparametersisnotveryinformativetoend-users.Howtochoosetheconciseyetprecisemodelisonemotivationofourwork.Moreover,inShanmugasundarametal.(1999),theauthorsdecidetoretainonlythe“outliers”that tinamemorybuffer,makingtheaccuracyofthemethoddependonthedata,ratherthanonthemethoditself.

Itisalsoimportanttostressthattheprovidingcompressionofthewholedatacube,whileguaranteeingerrorboundsforeveryquery,regardlessoftheaggregationisnotaneasytask

c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(3).doc 将本文的Word文档下载到电脑

精彩图片

热门精选

大家正在看

× 游客快捷下载通道(下载后可以自由复制和排版)

限时特价:7 元/份 原价:20元

支付方式:

开通VIP包月会员 特价:29元/月

注:下载文档有可能“只有目录或者内容不全”等情况,请下载之前注意辨别,如果您已付费且无法下载或内容有问题,请联系我们协助你处理。
微信:fanwen365 QQ:370150219