数据集成 Data Integration（PPT讲稿）成就与展望 Achievements and Perspectives

Data Integration: Achievements and Perspectives in the last ten years AiJing

Data Integration: Achievements and Perspectives in the Last Ten Years AiJing

Outline a Motivation background Best Paper: Information Manifold Building on the Foundation Data Integration Industry a Future Challenges Conclusion

Outline ◼ Motivation & Background ◼ Best Paper: Information Manifold ◼ Building on the Foundation ◼ Data Integration Industry ◼ Future Challenges ◼ Conclusion

Motivation background Data integration is a pervasive challenge faced in applications that need to query across multiple autonomous and heterogeneous data sources Data integration is crucial in large enterprises that own a multitude of data sources a For better cooperation among agencies, each with their own data sources

Motivation & Background ◼ Data integration is a pervasive challenge faced in applications that need to query across multiple autonomous and heterogeneous data sources. ◼ Data integration is crucial in large enterprises that own a multitude of data sources. ◼ For better cooperation among agencies, each with their own data sources

Kayak. com Search Results- Mozilla Firefox 回区 File Edit View Go Bookmarks Tools Help 中,中·⑧价体如 Or) Travel Center B crossing the Structur.[ Schedule a Conferen.. B Main-Scuba Dashboard Sign out John Battelle's Searc..2) Goge·skh Gsa·@ycek, AutoLink a AutoF Best fare Trend details ICN>SF0 X Asiana Airlines /1:33p 5: 40p 0(12h 07m $1423SF0>CN Multiple Airlines 5: 30p 3: 35p 1(14h 05m $850 800 90 Days Ago Today $1423 SFO ICN >c Asiana Airlines / 1: 33p 5:40p 0(12h 07m Stop ICN SF0 Multiple Airlines 5: 30 413p1(14h43m 回 nonstop國±st回2+ stops obtz:$1423 details email Airlines ICN>SFO X Asiana Airlines/1:33p 5: 40p 0(12h 07m $1423SF0>CN elect all I onstop 1 Multiple Airlines 5: 30p 525p1(15h55m) MAir France 多10486 orbitz: $1423 details emai 回 All Nippon AMerican Airlines $1423 SFO >ICN Ye Asiana Airlines /1:33p 5: 40p 0(12h 071 Cathay Pacific 2845 ICN SFO Multiple Airlines 5 30p 5: 50p 1(16h 20m) cHina Airlines 1483 obtz:$1423 details email 回 EVA Corporation M Multiple Airlines $2044 51423 $1453 SFO> ICN 回 Singapore Airlines s1796 SCN SFO S EVA Corporation 7:158 7 5p 1 (16h 40m) United s2291 s2170 airfare: $1453 US Airways s2242 $1483SF0>0N·⌒ ∧: 105a12:00p1(18h55m) 》 Done Open Notebook

Data Integration Legacy Databases Services and Applications Enterprise Databases

Outline a Motivation background a Best Paper: Information Manifold Building on the Foundation Data Integration Industry a Future Challenges Conclusion

Outline ◼ Motivation & Background ◼ Best Paper: Information Manifold ◼ Building on the Foundation ◼ Data Integration Industry ◼ Future Challenges ◼ Conclusion

Ten-Year Best paper Querying Heterogeneous Information Sources using Source Descriptions. VLDB96 Alon Halevy a principal member of technical staff at at&T Bell Laboratories. and then at at &T Laboratories Main idea: the nformation manifold led to tremendous progress on data integration and to quite a few commercial data integration products

Ten-Year Best Paper Querying Heterogeneous Information Sources using Source Descriptions. VLDB96 Alon Halevy a principal member of technical staff at AT&T Bell Laboratories, and then at AT&T Laboratories. • Main idea: the Information Manifold • led to tremendous progress on data integration and to quite a few commercial data integration products

The Information manifold An implemented data integration system Goal: provide a uniform query interface to a heterogeneous collection of Web data sources Main contribution: the way it described the contents of the data sources it knew about IM contains declarative descriptions of the contents and capabilities of the information sources. Source Description)

The Information Manifold ◼ An implemented data integration system ◼ Goal: provide a uniform query interface to a heterogeneous collection of Web data sources ◼ Main contribution: the way it described the contents of the data sources it knew about. ◼ IM contains declarative descriptions of the contents and capabilities of the information sources. (Source Description)

An example of complex query find reviews of movie directed by Woody Allen playing in my area three web sites join! 1. a movie site containing actor and director information(IMDB) 2. movie playing sources(e.g, 777film com 3. movie review sites(e.g, a newspaper)

An example of complex query find reviews of movie directed by Woody Allen playing in my area three web sites join! 1. a movie site containing actor and director information (IMDB) 2. movie playing sources(e.g.,777film.com) 3. movie review sites (e.g., a newspaper)

Design time Run time Mediated schema query reformulation Semantic mappings optimization execution wrapper wrapper wrapper wrapper wrapper

wrapper wrapper wrapper wrapper wrapper Mediated Schema Semantic mappings optimization & execution query reformulation Design time Run time

emantic mappings Mediated Schema CD: ASIN, Title, Genre Artist: ASIN, name, Informatio n sources Mapping logic Books Author Album Title ISBN ASIN ISBN FirstName Pri LastName DiscountPrice DiscountPrice Studio Edition Artists CDCategories Book Categories ASIN ASIN ISBN ArtistName Category Category Group Name

Semantic Mappings Books Title ISBN Price DiscountPrice Edition CDs Album ASIN Price DiscountPrice Studio BookCategories ISBN Category CDCategories ASIN Category Artists ASIN ArtistName GroupName Authors ISBN FirstName LastName CD: ASIN, Title, Genre,… Artist: ASIN, name, … Mediated Schema Mapping logic Informatio n sources