c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(17)

发布时间:2021-06-07

Abstract. A data cube is a popular organization for summary data. A cube is simply a multidimensional structure that contains in each cell an aggregate value, i.e., the result of applying an aggregate function to an underlying relation. In practical situat

LOGLINEAR-BASEDQUASICUBES27110%,itwouldbeenoughtoretainanextra29,119values(theaggregatedcellsthatexhibiterrorsbiggerthan10%inalltheothercuboids).Noticethatthis29,119areafraction(24.6%)ofthe117,973cellscontainedinallthecuboidsotherthanthecoreone.Infact,thecompressionratefortheoverallcubewouldbe18.3%,stillaverygoodratio.Bydoingthis,wecanguaranteea xedleveloferror(10%)forqueriesintheothercuboidsofthelattice.Queriesoverthecorecuboidwouldgetaguaranteederrorof40%,butactualerrorswouldlikelybemuchlessthanthatformostqueries.Ifonewouldinsistinmakingthe10%guaranteeacrossallcuboids,includingthecore,wewouldneedtostore20,035parameters,and64,348outliers(asshownin gure3),alongwiththe29,119cellsfortheothercuboids.Thiswouldbringtheoverallcompressionratioto40%.Bycontrast,usingthealgorithmdescribedinHarinarayanetal.(1996)todecidewhichcuboidswouldbethemostef cientchoicestomaterialize,assumingwewanttomaterializeupto3cuboids,onewouldneedtostore178,194cells(thoseofthecorecuboid,andthecuboidsYASandCAS),or62%ofthedatacube.Yet,doingthis,queriesoveranyothercuboidwouldrequiretheaggregationofcellsinoneoftheYACS(core),YASorCAScuboids(whichwouldinvolvealsoadditionalI/OandCPUtime).

Finally,weillustratehowthechunkmodelsareusefulinthemselves.Letusexaminethechunkwhichinvolves7countries(Pakistan,Russia,GreatBritain,Indonesia,U.S.,IndiaandChina),alltheyears,alltheagegroups,andbothsexes.Themodelwegetisthefollowing:

CYCAYAASlijkl=logy ijkl=γ+γiC+γjY+γkA+γlS+γij+γik+γjk+γkl(5)

Thismodelincludesalltheone-factoreffects(γiC,γjY,γkA,γlS),4two-factoreffectsCYCAASCSYA(γij,γik,γjk,γkl)andnohigher-factoreffects.Itmeansthetwo-factoreffects(γil,YSγjl)andhigher-factoreffectshavetrivialin uenceonthepopulation.Inotherwords,forthischunk,thevalueintheSex(S)atrributeisindependentwiththevalueintheCountry

(C)andYear(Y)attribute.Fromthestandardvariancesofthefactors,wediscoverthatthemostimportantattributeeffectisC(country),thesecondisA(agegroup).Foragivenattribute,forinstancecountry,weknowthatthebiggestparametervalue(γC)is1.384,correspondingtoChina.(Withoutlookingatthedata,weknowthatChinaisthecountrywithhighestpopulationinthischunk.)WecanalsodiscovertherankingofpopulationbylookingattherankingofparametersγC.Also,takinganeffectsuchasγCY,weknowthatforagivencountry,thesumoftheseeffectsisequaltozero(Eq.(3)).ThatimpliesthatwewillhaveabiggestpositiveandabiggestnegativeeffectγCYforeachcountry.Thesedefectstelluswhichyearshavethebiggestin uence(positiveornegative)inpopulationforthatcountry.Insum,thereisawealthofinformationcapturedbythechunkmodel.

3.2.Syntheticdataset

Weexperimentedwithasyntheticdataset,mostlytodeterminethescalabilityofourapproach.Inthisset,thecorecuboidis4-dimensional,withthefourdimensionsdenotedbythelettersA,B,CandD,withdomains80,40,20,10respectively.Wegeneratedthreedatasetsthatcontain50,200,and500thousandnon-emptycellsinthecorecuboid.The

c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(17).doc 将本文的Word文档下载到电脑

精彩图片

热门精选

大家正在看

× 游客快捷下载通道(下载后可以自由复制和排版)

限时特价:7 元/份 原价:20元

支付方式:

开通VIP包月会员 特价:29元/月

注:下载文档有可能“只有目录或者内容不全”等情况,请下载之前注意辨别,如果您已付费且无法下载或内容有问题,请联系我们协助你处理。
微信:fanwen365 QQ:370150219