Scaling Couchdb : replication, clustering, and administration

DocBook: The Definitive Guide is the complete and official documentation of the DocBook Document Type Definition (DTD) and many of its associated tools. DocBook is a system for writing structured documents using SGML and XML. It provides all the elements you'll need for technical documents of all kinds. A number of computer companies use DocBook for their documentation, as do several Open Source documentation groups, including the Linux Documentation Project (LDP). With the consistent use of DocBook, these groups can readily share and exchange information. With an XML-enabled browser, DocBook documents are as accessible on the Web as in print. DocBook: The Definitive Guide was written by Norman Walsh, the author of the XML implementation of the DocBook DTD; and Leonard Muellner, the manager of O'Reilly & Associates' Production Tools Group. In this book, you'll find: A brief introduction to SGML and XML A guide to creating documents with the DocBook DTD and associated stylesheets Information about using SGML and XML tools like Jade and DSSSL An guide to customizing DocBook A complete SGML and XML reference, including examples, for every DocBook element In addition, the CDROM contains: The complete source text of this book, in both SGML and HTML All the examples from the book DSSSL Stylesheets that let you convert DocBook documents to RTF, LaTeX, or HTML The DocBook DTD for SGML, version 3.1 Oasis, the organization that is the official maintainer of the DocBook DTD, has identified DocBook: the Definitive Guide as the official documentation for the DocBook DTD. Chapter 1 The Programmable Web and Its Inhabitants Kinds of Things on the Programmable Web HTTP: Documents in Envelopes Method Information Scoping Information The Competing Architectures Technologies on the Programmable Web Leftover Terminology Chapter 2 Writing Web Service Clients Web Services Are Web Sites del.icio.us: The Sample Application Making the Request: HTTP Libraries Processing the Response: XML Parsers JSON Parsers: Handling Serialized Data Clients Made Easy with WADL Chapter 3 What Makes RESTful Services Different? Introducing the Simple Storage Service Object-Oriented Design of S3 Resources HTTP Response Codes An S3 Client Request Signing and Access Control Using the S3 Client Library Clients Made Transparent with ActiveResource Parting Words Chapter 4 The Resource-Oriented Architecture Resource-Oriented What Now? What’s a Resource? URIs Addressability Statelessness Representations Links and Connectedness The Uniform Interface * That’s It! Chapter 5 Designing Read-Only Resource-Oriented Services Resource Design Turning Requirements Into Read-Only Resources Figure Out the Data Set Split the Data Set into Resources Name the Resources Design Your Representations Link the Resources to Each Other The HTTP Response Conclusion Chapter 6 Designing Read/Write Resource-Oriented Services User Accounts as Resources Custom Places A Look Back at the Map Service Chapter 7 A Service Implementation A Social Bookmarking Web Service Figuring Out the Data Set Resource Design Design the Representation(s) Accepted from the Client Design the Representation(s) Served to the Client Connect Resources to Each Other What’s Supposed to Happen? What Might Go Wrong? Controller Code Model Code What Does the Client Need to Know? Chapter 8 REST and ROA Best Practices Resource-Oriented Basics The Generic ROA Procedure Addressability State and Statelessness Connectedness The Uniform Interface This Stuff Matters Resource Design URI Design Outgoing Representations Incoming Representations Service Versioning Permanent URIs Versus Readable URIs Standard Features of HTTP Faking PUT and DELETE The Trouble with Cookies Why Should a User Trust the HTTP Client? Chapter 9 The Building Blocks of Services Representation Formats Prepackaged Control Flows Hypermedia Technologies Chapter 10 The Resource-Oriented Architecture Versus Big Web Services What Problems Are Big Web Services Trying to Solve? SOAP WSDL UDDI Security Reliable Messaging Transactions BPEL, ESB, and SOA Conclusion Chapter 11 Ajax Applications as REST Clients From AJAX to Ajax The Ajax Architecture A del.icio.us Example The Advantages of Ajax The Disadvantages of Ajax REST Goes Better Making the Request Handling the Response JSON Don’t Bogart the Benefits of REST Cross-Browser Issues and Ajax Libraries Subverting the Browser Security Model Chapter 12 Frameworks for RESTful Services Ruby on Rails Restlet Django Appendix Some Resources for REST and Some RESTful Resources Standards and Guides Services You Can Use Appendix The HTTP Response Code Top 42 Three to Seven Status Codes: The Bare Minimum 1xx: Meta 2xx: Success 3xx: Redirection 4xx: Client-Side Error 5xx: Server-Side Error Appendix The HTTP Header Top Infinity Standard Headers Nonstandard Headers Colophon 'Every developer working with the Web needs to read this book.' -- David Heinemeier Hansson, creator of the Rails framework 'RESTful Web Services finally provides a practical roadmap for constructing services that embrace the Web, instead of trying to route around it.' -- Adam Trachtenberg, PHP author and EBay Web Services Evangelist You've built web sites that can be used by humans. But can you also build web sites that are usable by machines? That's where the future lies, and that's what RESTful Web Services shows you how to do. The World Wide Web is the most popular distributed application in history, and Web services and mashups have turned it into a powerful distributed computing platform. But today's web service technologies have lost sight of the simplicity that made the Web successful. They don't work like the Web, and they're missing out on its advantages. This book puts the 'Web' back into web services. It shows how you can connect to the programmable web with the technologies you already use every day. The key is REST, the architectural style that drives the Web. This book:Emphasizes the power of basic Web technologies -- the HTTP application protocol, the URI naming standard, and the XML markup language Introduces the Resource-Oriented Architecture (ROA), a common-sense set of rules for designing RESTful web services Shows how a RESTful design is simpler, more versatile, and more scalable than a design based on Remote Procedure Calls (RPC) Includes real-world examples of RESTful web services, like Amazon's Simple Storage Service and the Atom Publishing Protocol Discusses web service clients for popular programming languages Shows how to implement RESTful services in three popular frameworks -- Ruby on Rails, Restlet (for Java), and Django (for Python) Focuses on practical issues: how to design and implement RESTful web services and clients This is the first book that applies the REST design philosophy to real web services. It sets down the best practices you need to make your design a success, and the techniques you need to turn your design into working code. You can harness the power of the Web for programmable applications: you just have to work with the Web instead of against it. This book shows you how. Three of CouchDB's creators show you how to use this document-oriented database as a standalone application framework or with high-volume, distributed applications. With its simple model for storing, processing, and accessing data, CouchDB is ideal for web applications that handle huge amounts of loosely structured data. That alone would stretch the limits of a relational database, yet CouchDB offers an open source solution that's reliable, scales easily, and responds quickly.CouchDB works with self-contained data that has loose or ad-hoc connections. It's a model that fits many real-world items, such as contacts, invoices, and receipts, but you'll discover that this database can easily handle data of any kind. With this book, you'll learn how to work with CouchDB through its RESTful web interface, and become familiar with key features such as simple document CRUD (create, read, update, delete), advanced MapReduce, deployment tuning, and more.Understand the basics of document-oriented storage and manipulationInteract with CouchDB entirely though HTTP using its RESTful interfaceModel data as self-contained JSON documentsHandle evolving data schemas naturallyQuery and aggregate data in CouchDB using MapReduce viewsReplicate data between nodesTune CouchDB for increased performance and reliability This practical guide offers a short course on scaling CouchDB to meet the capacity needs of your distributed application. Through a series of scenario-based examples, this book lets you explore several methods for creating a system that can accommodate growth and meet expected demand. In the process, you learn about several tools that can help you with replication, load balancing, clustering, and load testing and monitoring. Apply performance tips for tuning your databaseReplicate data, using Futon and CouchDB's RESTful interfaceDistribute CouchDB's workload through load balancingLearn options.;Table of Contents; Preface; Conventions Used in This Book; Using Code Examples; Safari® Books Online; How to Contact Us; Acknowledgments; Chapter 1. Defining Scaling Goals; What is Scalability?; Capacity Planning; The CAP Theorem; Consistency; Availability; Partition Tolerance; Chapter 2. Tuning and Designing for Scale; Performance Tips; Document Design; Chapter 3. Replication; Filters and Specifying Documents; Conflict Resolution; Picking the Same Revision as CouchDB; Picking a Conflicted Revision; Merging Revisions; Chapter 4. Load Balancing; CouchDB Nodes; Replication Setup. Three of CouchDB's creators show you how to use this document-oriented database as a standalone application framework or with high-volume, distributed applications. With its simple model for storing, processing, and accessing data, CouchDB is ideal for web applications that handle huge amounts of loosely structured data. That alone would stretch the limits of a relational database, yet CouchDB offers an open source solution that's reliable, scales easily, and responds quickly. CouchDB works with self-contained data that has loose or ad-hoc connections. It's a model that fits many real-world items, such as contacts, invoices, and receipts, but you'll discover that this database can easily handle data of any kind. With this book, you'll learn how to work with CouchDB through its RESTful web interface, and become familiar with key features such as simple document CRUD (create, read, update, delete), advanced MapReduce, deployment tuning, and more. This book introduces you to Apache CouchDB, a document-oriented database that offers a different way to model your data. CouchDB is a schema-free database, designed to work with applications that handle document-based information such as contacts, invoices, and receipts. In CouchDB: The Definitive Guide , three of the core developers gently explain how to work with CouchDB, using clear and practical scenarios. Each chapter showcases key features, such as simple document CRUD (create, read, updated, delete), advanced MapReduce, and deployment tuning for performance and reliability. With this book, you will: Understand the basics of document-based storage and manipulation; Model data as self-contained JSON documents; Manage basic document CRUD; Handle evolving data naturally; Query and aggregate data in CouchDB, using MapReduce views; Replicate data between nodes; Carry out deployment tuning for performance and reliability. - Publisher. Table of Contents Preface Conventions Used in This Book Using Code Examples Safari® Books Online How to Contact Us Acknowledgments Chapter 1. Defining Scaling Goals What is Scalability? Capacity Planning The CAP Theorem Consistency Availability Partition Tolerance Chapter 2. Tuning and Designing for Scale Performance Tips Document Design Chapter 3. Replication Filters and Specifying Documents Conflict Resolution Picking the Same Revision as CouchDB Picking a Conflicted Revision Merging Revisions Chapter 4. Load Balancing CouchDB Nodes Replication Setup. Proxy Server ConfigurationTesting Chapter 5. Clustering BigCouch Lounge Pillow Chapter 6. Distributed Load Testing Installing Tsung Configuring Tsung Running Tsung Monitoring Identifying Bottlenecks Test Configuration. This practical guide offers a short course on scaling CouchDB to meet the capacity needs of your distributed application. Through a series of scenario-based examples, this book lets you explore several methods for creating a system that can accommodate growth and meet expected demand. In the process, you learn about several tools that can help you with replication, load balancing, clustering, and load testing and monitoring.Apply performance tips for tuning your databaseReplicate data, using Futon and CouchDB’s RESTful interfaceDistribute CouchDB’s workload through load balancingLearn options for creating a cluster of CouchDB nodes, including BigCouch, Lounge, and PillowConduct distributed load testing with Tsung This practical guide offers a short course on scaling CouchDB to meet the capacity needs of your distributed application. Through a series of scenario-based examples, this book lets you explore several methods for creating a system that can accommodate growth and meet expected demand. In the process, you learn about several tools that can help you with replication, load balancing, clustering, and load testing and monitoring. Apply performance tips for tuning your database Replicate data, using Futon and CouchDB's RESTful interface Distribute CouchDB's workload through load balancing Learn options for creating a cluster of CouchDB nodes, including BigCouch, Lounge, and Pillow Conduct distributed load testing with Tsung Forward Preface Introduction Why CouchDB? Eventual Consistency Getting Started The Core API Developing with CouchDB Design Documents Finding Your Data with Views Validation Functions Show Functions Transforming View with List Functions Example Applications Standalone Applications Managing Design Documents Storing Documents Showing Documents in Custom Formats Viewing Lists of Blog Posts Deploying CouchDB Scaling Basics Replication Conflict Management Load Balancing Clustering Reference Change Notifications View Cookbook for SQL Jockeys Security High Performance Recipes Appendixes Installing on Unix-like Systems Installing on Mac OS X Installing on Windows Installing from Source JSON Primer The Power of B-trees Index The Programmable Web and Its Inhabitants Writing Web Service Clients What Makes RESTful Services Different? The Resource-Oriented Architecture Designing Read-Only Resource-Oriented Services Designing Read/Write Resource-Oriented Services A Service Implementation REST and ROA Best Practices The Building Blocks of Services The Resource-Oriented Architecture Versus Big Web Services Ajax Applications as REST Clients Frameworks for RESTful Services A. Some Resources for REST and Some RESTful Resources B. The HTTP Response Code Top 42 C. The HTTP Header Top Infinity This practical guide offers a short course on scaling CouchDB to meet the capacity needs of your distributed application. Through a series of scenario-based examples, this book lets you explore several methods for creating a system that can accommodate growth and meet expected demand. In the process, you learn about several tools that can help you with replication, load balancing, clusters, and load testing and monitoring. COMPUTERS / Data Modeling & Design You've built web sites that can be used by humans. But can you also build web sites that are usable by machines? That's where the future lies, and that's what this book shows you how to do. Today's web service technologies have lost sight of the simplicity that made the Web successful. This book explains how to put the Web" back into web services with REST, the architectural style that drives the Web." DocBook is a Document Type Definition (DTD) for use with XML (the Extensible Markup Language) and SGML (the Standard Generalized Markup Language). DocBook lets authors of technical groups exchange and reuse technical information. Shows how to use the REST architectural style to create web sites that can be used by computers as well as machines, providing basic rules for using REST and real-life examples of such web services.