You would like to check the existence of a web page without downloading the HTML content. This means that we need to send a get HEAD request with a browser client. According to Wikipedia, the HEAD request asks for the response identical to the one that would correspond to a GET request, but without the response body. This is useful for retrieving meta-information written in response headers, without having to transport the entire content.
Checking whether a web page exists with the HEAD request
by Dr. M. O. Faruque Sarker, Pradeeban Kathiravelu
Python Network Programming Cookbook - Second Edition
- Preface
- Sockets, IPv4, and Simple Client/Server Programming
- Introduction
- Printing your machine's name and IPv4 address
- Retrieving a remote machine's IP address
- Converting an IPv4 address to different formats
- Finding a service name, given the port and protocol
- Converting integers to and from host to network byte order
- Setting and getting the default socket timeout
- Handling socket errors gracefully
- Modifying a socket's send/receive buffer sizes
- Changing a socket to the blocking/non-blocking mode
- Reusing socket addresses
- Printing the current time from the internet time server
- Writing an SNTP client
- Writing a simple TCP echo client/server application
- Writing a simple UDP echo client/server application
- Multiplexing Socket I/O for Better Performance
- IPv6, Unix Domain Sockets, and Network Interfaces
- Introduction
- Forwarding a local port to a remote host
- Pinging hosts on the network with ICMP
- Waiting for a remote network service
- Enumerating interfaces on your machine
- Finding the IP address for a specific interface on your machine
- Finding whether an interface is up on your machine
- Detecting inactive machines on your network
- Performing a basic IPC using connected sockets (socketpair)
- Performing IPC using Unix domain sockets
- Finding out if your Python supports IPv6 sockets
- Extracting an IPv6 prefix from an IPv6 address
- Writing an IPv6 echo client/server
- Programming with HTTP for the Internet
- Introduction
- Downloading data from an HTTP server
- Serving HTTP requests from your machine
- Extracting cookie information after visiting a website
- Submitting web forms
- Sending web requests through a proxy server
- Checking whether a web page exists with the HEAD request
- Spoofing Mozilla Firefox in your client code
- Saving bandwidth in web requests with the HTTP compression
- Writing an HTTP fail-over client with resume and partial downloading
- Writing a simple HTTPS server code with Python and OpenSSL
- Building asynchronous network applications with Twisted
- Building asynchronous network applications with Tornado
- Building concurrent applications with Tornado Future
- Email Protocols, FTP, and CGI Programming
- Introduction
- Listing the files in a remote FTP server
- Uploading a local file to a remote FTP server
- Emailing your current working directory as a compressed ZIP file
- Downloading your Google email with POP3
- Checking your remote email with IMAP
- Sending an email with an attachment via Gmail SMTP server
- Writing a guestbook for your (Python-based) web server with CGI
- Finding the mail server from an email address
- Writing a simple SMTP server
- Writing a secure SMTP client using TLS
- Writing an email client with POP3
- Programming Across Machine Boundaries
- Introduction
- Executing a remote shell command using telnet
- Copying a file to a remote machine by SFTP
- Printing a remote machine's CPU information
- Installing a Python package remotely
- Running a MySQL command remotely
- Transferring files to a remote machine over SSH
- Configuring Apache remotely to host a website
- Working with Web Services – XML-RPC, SOAP, and REST
- Introduction
- Querying a local XML-RPC server
- Writing a multithreaded, multicall XML-RPC server
- Running an XML-RPC server with a basic HTTP authentication
- Collecting some photo information from Flickr using REST
- Searching for SOAP methods from an Amazon S3 web service
- Searching Amazon for books through the product search API
- Creating RESTful web applications with Flask
- Network Monitoring and Security
- Introduction
- Sniffing packets on your network
- Saving packets in the pcap format using the pcap dumper
- Adding an extra header in HTTP packets
- Scanning the ports of a remote host
- Customizing the IP address of a packet
- Replaying traffic by reading from a saved pcap file
- Scanning the broadcast of packets
- Network Modeling
- Getting Started with SDN
- Introduction
- SDN emulation with Mininet
- Developing Software-Defined Networks with OpenDaylight controller
- Developing Software-Defined Networks with ONOS controller
- Developing Software-Defined Networks with Floodlight controller
- Developing Software-Defined Networks with Ryu controller
- Developing Software-Defined Networks with POX controller
- Developing Software-Defined Networks visually with MiniEdit
- Authentication, Authorization, and Accounting (AAA)
- Open and Proprietary Networking Solutions
- NFV and Orchestration – A Larger Ecosystem
- Programming the Internet
Checking whether a web page exists with the HEAD request
-
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click here login for view all page.