Perl & LWP: Fetching Web Pages, Parsing HTML, Writing Spiders & MorePerl soared to popularity as a language for creating and managing web content, but with LWP (Library for WWW in Perl), Perl is equally adept at consuming information on the Web. LWP is a suite of modules for fetching and processing web pages.The Web is a vast data source that contains everything from stock prices to movie credits, and with LWP all that data is just a few lines of code away. Anything you do on the Web, whether it's buying or selling, reading or writing, uploading or downloading, news to e-commerce, can be controlled with Perl and LWP. You can automate Web-based purchase orders as easily as you can set up a program to download MP3 files from a web site.Perl & LWP covers:
|
Contents
| 1 | |
| 15 | |
The LWP Class Model | 31 |
URLs | 48 |
Forms | 58 |
Simple HTML Processing with Regular Expressions | 85 |
HTML Processing with Tokens | 100 |
Tokenizing Walkthrough | 119 |
Cookies Authentication and Advanced Requests | 165 |
Spiders | 178 |
LWP Modules | 199 |
HTTP Status Codes | 203 |
Common MIME Types | 205 |
Language Tags | 207 |
Common Content Encodings | 209 |
ASCII Table | 211 |
HTML Processing with Trees | 132 |
Modifying HTML with Trees | 148 |
Users View of ObjectOriented Modules | 224 |
| 235 | |
Other editions - View all
Common terms and phrases
ABEBooks absolute URL ASCII attribute Authentication automate basic Book button bytes Capital Chapter Class for objects Codex Seraphinianus cookies CPAN DEBUG default diaeresis do_GET document element eMatter Edition encoding end-tag error example extract information fetch foreach form data form pair formpairs.pl function get_text gzip header line headlines host hostname href HTML::TokeParser HTML::TreeBuilder input install interface look LWP Class LWP::Simple LWP::UserAgent LWP::UserAgent->new match method MIME type module Netscape node O’Reilly O'Reilly Media object value object-oriented Octal option parameters parse parse tree password Perl Perl Journal plate Processing Psycho II query regular expression relative URL request resp response response->is_success response->status_line routine server spider start-tag status code string submit text token there’s things Title tree undef Undefined Unicode unless URI object url\n user agent User-Agent usr/bin/perl Walter Kirn what’s whitespace write
Popular passages
Page xii - Conventions Used in This Book The following typographic conventions are used in this book: • Code lines, commands, statements, variables, and any text you type or see onscreen appears in a mono typeface.
Page 6 - Files found in blib/arch: installing files in blib/lib into architecture dependent library tree Installing /Library/Perl/5.8.l/darwin-thread-multi-2level/Data/Dumper.pm Writing ///Library/Perl/5.8.1/ darwin-thread-multi-2level/auto/Data/Dumper/.packlist Appending installation info to ///System/Library/Perl/ 5.