Web Data Management

The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers, to smartphones, to websites such as Youtube and Picasa. As a consequence, data management concepts, methods, and techniques are increasingly focused on distribution concerns. Now that information largely resides in the network, so do the tools that process this information. This book explains the foundations of XML, the Web standard for data management, with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several 'Putting into Practice' chapters describe detailed practical applications of the technologies and techniques. Striking a balance between the conceptual and the practical, the book will serve as an introduction to the new, global, information systems for Web professionals as well as for master's level courses. Cover 1 Web Data Management 2 Contents 6 Introduction 10 Part 1 Modeling Web Data 16 1 DataModel 18 1.1 Semistructured Data 18 1.2 XML 20 1.3 Web Data Management with XML 31 1.4 The XMLWorld 33 1.5 Further Reading 43 1.6 Exercises 44 2 XPathandXQuery 47 2.1 Introduction 47 2.2 Basics 47 2.3 XPath 57 2.4 FLWOR Expressions in XQuery 69 2.5 XPath Foundations 77 2.6 Further Reading 82 2.7 Exercises 84 3 Typing 87 3.1 Motivating Typing 87 3.2 Automata 90 3.3 Schema Languages for XML 95 3.4 Typing Graph Data 104 3.5 Further Reading 106 3.6 Exercises 107 4 XML Query Evaluation 110 4.1 Fragmenting XML Documents on Disk 112 4.2 XML Node Identifiers 114 4.3 XML Query Evaluation Techniques 118 4.4 Further Reading 127 4.5 Exercises 128 5 Putting into Practice: Managing an XML Database with EXIST 131 5.1 Prerequisites 131 5.2 Installing EXIST 132 5.3 Getting Started with EXIST 133 5.4 Running XPath and XQuery Queries with the Sandbox 135 5.5 Programming with EXIST 138 5.6 Projects 142 6 Putting into Practice: Tree Pattern Evaluation Using SAX 146 6.1 Tree-Pattern Dialects 146 6.2 CTP Evaluation 149 6.3 Extensions to Richer Tree Patterns 153 Part 2 Web Data Semantics and Integration 156 7 Ontologies, RDF, and OWL 158 7.1 Introduction 158 7.2 Ontologies by Example 160 7.3 RDF, RDFS, and OWL 163 7.4 Ontologies and (Description) Logics 174 7.5 Further Reading 184 7.6 Exercises 185 8 Querying Data Through Ontologies 186 8.1 Introduction 186 8.2 Querying RDF Data: Notation and Semantics 187 8.3 Querying Through RDFS Ontologies 191 8.4 Answering Queries Through DL-LITE Ontologies 194 8.5 Further Reading 209 8.6 Exercises 210 9 Data Integration 211 9.1 Introduction 211 9.2 Containment of Conjunctive Queries 214 9.3 Global-as-ViewMediation 215 9.4 Local-as-ViewMediation 219 9.5 Ontology-BasedMediators 230 9.6 Peer-to-Peer Data Management Systems 237 9.7 Further Reading 244 9.8 Exercises 244 10 Putting into Practice: Wrappers and Data Extraction with XSLT 246 10.1 Extracting Data fromWeb Pages 247 10.2 Restructuring Data 249 11 Putting into Practice: Ontologies in Practice (by Fabian M. Suchanek) 251 11.1 Exploring and Installing Yago 251 11.2 Querying Yago 252 11.3 Web Access to Ontologies 253 12 Putting into Practice: Mashups with YAHOO! PIPES and XProc 255 12.1 YAHOO! PIPES: A Graphical Mashup Editor 255 12.2 XProc: An XML Pipeline Language 256 Part 3 Building Web Scale Applications 260 13 Web Search 262 13.1 The WorldWide Web 263 13.2 Parsing theWeb 265 13.3 Web Information Retrieval 272 13.4 Web Graph Mining 287 13.5 Hot Topics inWeb Search 295 13.6 Further Reading 296 13.7 Exercises 298 14 An Introduction to Distributed Systems 302 14.1 Basics of Distributed Systems 303 14.2 Failure Management 310 14.3 Required Properties of a Distributed System 314 14.4 Particularities of P2P Networks 318 14.5 Case Study: A Distributed File System for Very Large Files 320 14.6 Further Reading 323 15 Distributed Access Structures 325 15.1 Hash-Based Structures 326 15.2 Distributed Indexing: Search Trees 340 15.3 Further Reading 351 15.4 Exercises 352 16 Distributed Computing with MAPREDUCE and PIG 354 16.1 MAPREDUCE 356 16.2 PIG 363 16.3 Further Reading 374 16.4 Exercises 376 17 Putting into Practice: Full-Text Indexing with LUCENE (by Nicolas Travers) 379 17.1 Preliminary: A LUCENE Sandbox 379 17.2 Indexing Plain Text with LUCENE – A Full Example 379 17.3 Put It into Practice! 386 17.4 LUCENE – Tuning the Scoring (Project) 387 18 Putting into Practice: Recommendation Methodologies (by Alban Galland) 389 18.1 Introduction to Recommendation Systems 389 18.2 Prerequisites 390 18.3 Data Analysis 392 18.4 Generating Some Recommendations 395 18.5 Projects 400 19 Putting into Practice: Large-Scale Data Management with HADOOP 402 19.1 Installing and Running HADOOP 403 19.2 Running MAPREDUCE Jobs 406 19.3 PIGLATIN Scripts 410 19.4 Running in Cluster Mode (Optional) 410 19.5 Exercises 412 20 Putting into Practice: COUCHDB, a JSON Semistructured Database 415 20.1 Introduction to the COUCHDB Document Database 416 20.2 Putting COUCHDB into Practice! 432 20.3 Further Reading 434 Bibliography 436 Index 446 "The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers, to smartphones, to Web sites such as YouTube and Picasa. As a consequence, data management concepts, methods, and techniques are increasingly focused on distribution concerns. That information largely resides in the network, as do the tools that process this information. This book explains the foundations of XML, the Web standard for data management, with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several "Putting into Practice" chapters describe detailed practical applications of the technologies and techniques. Striking a balance between the conceptual and the practical, the book will serve as an introduction to the new, global, information systems for Web professionals as well as for master's level courses"-- Provided by publisher Machine generated contents note: Part I. Modeling Web Data: 1. Data model; 2. XPath and Xquery; 3. Typing; 4. XML query evaluation; 5. Putting into practice: managing an XML database with EXIST; 6. Putting into practice: tree pattern evaluation using SAX; Part II. Web Data Semantics and Integration: 7. Ontologies, RDF, and OWL; 8. Querying data through ontologies; 9. Data integration; 10. Putting into practice: wrappers and data extraction with XSLT; 11. Putting into practice: ontologies in practice Fabian M. Suchanek; 12. Putting into practice: mashups with YAHOO! PIPES and XProc; Part III. Building Web Scale Applications: 13. Web search; 14. An introduction to distributed systems; 15. Distributed access structures; 16. Distributed computing with MAPREDUCE and PIG; 17. Putting into practice: full-text indexing with LUCENE Nicolas Travers; 18. Putting into practice: recommendation methodologies Alban Galland; 19. Putting into practice: large-scale management with HADOOP; 20. Putting into practice: COUCHDB, a JSON semi-structured database. The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers to smartphones and websites. As a consequence, data management concepts, methods and techniques are increasingly focused on distribution concerns. Now that information largely resides in the network, so do the tools that process this information. This book explains the foundations of XML with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several 'Putting into Practice' chapters describe detailed practical applications of the technologies and techniques. The book will serve as an introduction to the new, global, information systems for Web professionals and master's level courses.