Python programming for Arduino : develop practical Internet of things prototypes and applications with Arduino and Python

Develop practical Internet of Things prototypes and applications with Arduino and Python About This Book Transform your hardware ideas into real-world applications using Arduino and Python Design and develop hardware prototypes, interactive user interfaces, and cloud-connected applications for your projects Explore and expand examples to enrich your connected device's applications with this step-by-step guide Who This Book Is For This is the book for you if you are a student, hobbyist, developer, or designer with little or no programming and hardware prototyping experience, and you want to develop IoT applications. If you are a software developer or a hardware designer and want to create connected devices applications, then this book will help you get started. What You Will Learn Design and develop your own hardware prototypes using Arduino Interface Arduino to a computer using the Firmata protocol and Python Acquire hands-on experience in developing applications for a variety of popular sensors Develop graphical user interfaces to control your components and plots to visualize sensor data Access your Arduino prototype from the Internet Implement messaging protocols for Arduino communication Connect your hardware project to cloud-based services Create advanced Internet of Things applications through projects in the book In Detail The future belongs to applications and services that involve connected devices, requiring physical components to communicate with web-level applications. Arduino combined with the popular open source software platform Python can be used to develop the next level of advanced Internet of Things (IoT) projects with graphical user interfaces and Internet-connected applications. Starting with designing hardware prototypes using Arduino, this book will then show you everything you need to know to be able to develop complex cloud applications. You will delve into domain-specific topics with incremental complexity, ending with real-world projects. You will quickly learn to develop user interfaces, plots, remote access, messaging protocols, and cloud connectivity. Each successive topic, accompanied by plenty of examples, will help you develop your cutting-edge hardware applications.

About This Book

• A hands-on guide to web scraping with real-life problems and solutions
• Techniques to download and extract data from complex websites
• Create a number of different web scrapers to extract information

Who This Book Is For

This book is aimed at developers who want to build reliable solutions to scrape data from websites. It is assumed that the reader has prior programming experience with Python. Anyone with general knowledge of programming languages should be able to pick up the book and understand the principles involved.

What You Will Learn

• Follow links to crawl a website
• Extract data from web pages with lxml
• Build a threaded crawler to process web pages in parallel
• Cache downloads to reduce bandwidth
• Learn how to parse JavaScript-dependent websites
• Interact with forms and sessions
• Solve CAPTCHAs on protected web pages
• Reverse engineer AJAX calls
• Create high level scrapers with Scrapy

In Detail

Web scraping is becoming increasingly useful as a way to easily gather and make sense of the plethora of information available online. Using a simple language such as Python, you can scrape complex websites with little programming.

This book is the ultimate guide to using Python to scrape data from websites. It covers how to extract data from static web pages and how to use caching to manage the load on servers. Learn how to use AJAX URLs, employ the Firebug extension. Discover more scraping nitty-gritties such as using a browser renderer, managing cookies, submitting forms to extract data from complex websites protected by CAPTCHA, and so on. Finally, create high-level scrapers with Scrapy and implement what has been learned on real websites.