Section 2: Network Scripting and Extracting Information from the Tor Network with Python
by
Mastering Python for Networking and Security - Second Edition
- Mastering Python for Networking and Security Second Edition
- Why subscribe?
- Contributors
- About the author
- About the reviewers
- Packt is searching for authors like you
- Preface
- Section 1: The Python Environment and System Programming Tools
- Chapter 1: Working with Python Scripting
- Technical requirements
- Introduction to Python scripting
- Why choose Python?
- Multi-platform capabilities and versions
- Python 3 features
- Exploring Python data structures
- Lists
- Tuples
- Python dictionaries
- Python functions, classes, and managing exceptions
- Python functions
- Python classes
- Python inheritance
- Managing exceptions
- Python modules and packages
- What is a module in Python?
- Getting information from standard modules
- Difference between a Python module and a Python package
- Python Module Index
- Managing parameters in Python
- Managing dependencies and virtual environments
- Managing dependencies in a Python project
- Generating the requirements.txt file
- Working with virtual environments
- Configuring virtualenv
- Development environments for Python scripting
- Setting up a development environment
- PyCharm
- Debugging with PyCharm
- Debugging with Python IDLE
- Summary
- Questions
- Further reading
- Chapter 2: System Programming Packages
- Technical requirements
- Introducing system modules in Python
- The system (sys) module
- The operating system (os) module
- The platform module
- The subprocess module
- Working with the filesystem in Python
- Working with files and directories
- Reading and writing files in Python
- Opening a file with a context manager
- Reading a ZIP file using Python
- Managing threads in Python
- Creating a simple thread
- Working with the threading module
- Multithreading in Python
- Limitations of classic Python threads
- Concurrency in Python with ThreadPoolExecutor
- Executing ThreadPoolExecutor with a context manager
- Working with socket.io
- Implementing a server with socket.io
- Implementing a client that connects to the server
- Summary
- Questions
- Further reading
- Section 2: Network Scripting and Extracting Information from the Tor Network with Python
- Chapter 3: Socket Programming
- Technical requirements
- Introducing sockets in Python
- Network sockets in Python
- The socket module
- Basic client with the socket module
- Implementing an HTTP server in Python
- Testing the HTTP server
- Implementing a reverse shell with sockets
- Resolving IPS domains, addresses, and managing exceptions
- Gathering information with sockets
- Using the reverse lookup command
- Managing socket exceptions
- Port scanning with sockets
- Implementing a basic port scanner
- Advanced port scanner
- Implementing a simple TCP client and TCP server
- Implementing a server and client with sockets
- Implementing the TCP server
- Implementing the TCP client
- Implementing a simple UDP client and UDP server
- Implementing the UDP server
- Implementing the UDP client
- Summary
- Questions
- Further reading
- Chapter 4: HTTP Programming
- Technical requirements
- Introducing the HTTP protocol
- Reviewing the status codes
- Building an HTTP client with http.client
- Building an HTTP client with urllib.request
- Get response and request headers
- Extracting emails from a URL with urllib.request
- Downloading files with urllib.request
- Handling exceptions with urllib.request
- Building an HTTP client with requests
- Getting images and links from a URL with requests
- Making GET requests with the REST API
- Making POST requests with the REST API
- Managing a proxy with requests
- Managing exceptions with requests
- Building an HTTP client with httpx
- Authentication mechanisms with Python
- HTTP basic authentication with a requests module
- HTTP digest authentication with the requests module
- Summary
- Questions
- Further reading
- Chapter 5: Connecting to the Tor Network and Discovering Hidden Services
- Technical requirements
- Understanding the Tor Project and hidden services
- Exploring the Tor network
- What are hidden services?
- Tools for anonymity in the Tor network
- Connecting to the Tor network
- Node types in the Tor network
- Installing the Tor service
- ExoneraTor and Nyx
- Discovering hidden services with OSINT tools
- Search engines
- Inspecting onion address with onioff
- OnionScan as a research tool for the deep web
- Docker onion-nmap
- Modules and packages in Python for connecting to the Tor network
- Connecting to the Tor network from Python
- Extracting information from the Tor network with the stem module
- Tools that allow us to search hidden services and automate the crawling process in the Tor network
- Scraping information from the Tor network with Python tools
- Summary
- Questions
- Section 3: Server Scripting and Port Scanning with Python
- Chapter 6: Gathering Information from Servers
- Technical requirements
- Extracting information from servers with Shodan
- Accessing Shodan services
- The Shodan RESTful API
- Shodan search with Python
- Using Shodan filters and the BinaryEdge search engine
- Shodan filters
- BinaryEdge search engine
- Using the socket module to obtain server information
- Extracting server banners with Python
- Getting information on DNS servers with DNSPython
- DNS protocol
- DNS servers
- The DNSPython module
- Getting vulnerable addresses in servers with fuzzing
- The fuzzing process
- Understanding and using the FuzzDB project
- Summary
- Questions
- Further reading
- Chapter 7: Interacting with FTP, SFTP, and SSH Servers
- Technical requirements
- Connecting with FTP servers
- Using the Python ftplib module
- Using ftplib to brute-force FTP user credentials
- Building an anonymous FTP scanner with Python
- Connecting with SSH servers with paramiko and pysftp
- Executing an SSH server on Debian Linux
- Introducing the paramiko module
- Establishing an SSH connection with paramiko
- Running commands with paramiko
- Using paramiko to brute-force SSH user credentials
- Establishing an SSH connection with pysftp
- Implementing SSH clients and servers with the asyncSSH and asyncio modules
- Checking the security in SSH servers with the ssh-audit tool
- Installing and executing ssh-audit
- Rebex SSH Check
- Summary
- Questions
- Further reading
- Chapter 8: Working with Nmap Scanner
- Technical requirements
- Introducing port scanning with Nmap
- Scan modes with python-nmap
- Implementing synchronous scanning
- Implementing asynchronous scanning
- Working with Nmap through the os and subprocess modules
- Discovering services and vulnerabilities with Nmap scripts
- Executing Nmap scripts to discover services
- Executing Nmap scripts to discover vulnerabilities
- Summary
- Questions
- Further reading
- Section 4: Server Vulnerabilities and Security in Python Modules
- Chapter 9: Interacting with Vulnerability Scanners
- Technical requirements
- Understanding vulnerabilities and exploits
- What is an exploit?
- Vulnerability formats
- Introducing the Nessus vulnerability scanner
- Installing and executing the Nessus vulnerability scanner
- Nessus vulnerabilities reports
- Accessing the Nessus API with Python
- Interacting with the Nessus server
- Introducing the OpenVAS vulnerability scanner
- Installing the OpenVAS vulnerability scanner
- Understanding the web interface
- Scanning a machine using OpenVAS
- Accessing OpenVAS with Python
- Summary
- Questions
- Further reading
- Chapter 10: Identifying Server Vulnerabilities in Web Applications
- Technical requirements
- Understanding vulnerabilities in web applications with OWASP
- Testing XSS
- Analyzing and discovering vulnerabilities in CMS web applications
- Using CMSMap
- Other CMS scanners
- Discovering SQL vulnerabilities with Python tools
- Introduction to SQL injection
- Identifying pages vulnerable to SQL injection
- Introducing SQLmap
- Using SQLmap to test a website for a SQL injection vulnerability
- Scanning for SQL injection vulnerabilities with the Nmap port scanner
- Testing Heartbleed and SSL/TLS vulnerabilities
- Vulnerabilities in the Secure Sockets Layer (SSL) protocol
- Finding vulnerable servers in the Censys search engine
- Analyzing and exploiting the Heartbleed vulnerability (OpenSSL CVE-2014-0160)
- Scanning for the Heartbleed vulnerability with the Nmap port scanner
- Scanning TLS/SSL configurations with SSLyze
- Summary
- Questions
- Further reading
- Chapter 11: Security and Vulnerabilities in Python Modules
- Technical requirements
- Exploring security in Python modules
- Python functions with security issues
- Input/output validation
- Eval function security
- Controlling user input in dynamic code evaluation
- Pickle module security
- Security in a subprocess module
- Using the shlex module
- Insecure temporary files
- Static code analysis for detecting vulnerabilities
- Introducing static code analysis
- Introducing Pylint and Dlint
- The Bandit static code analyzer
- Bandit test plugins
- Detecting Python modules with backdoors and malicious code
- Insecure packages in PyPi
- Backdoor detection in Python modules
- Denial-of-service vulnerability in urllib3
- Security in Python web applications with the Flask framework
- Rendering an HTML page with Flask
- Cross-site scripting (XSS) in Flask
- Disabling debug mode in the Flask app
- Security redirections with Flask
- Python security best practices
- Using packages with the __init__.py interface
- Updating your Python version
- Installing virtualenv
- Installing dependencies
- Using services to check security in Python projects
- Summary
- Questions
- Further reading
- Section 5: Python Forensics
- Chapter 12: Python Tools for Forensics Analysis
- Technical requirements
- Volatility framework for extracting data from memory and disk images
- Installing Volatility
- Identifying the image profile
- Volatility plugins
- Connecting and analyzing SQLite databases
- SQLite databases
- The sqlite3 module
- Network forensics with PcapXray
- Getting information from the Windows registry
- Introducing python-registry
- Logging in Python
- Logging levels
- Logging module components
- Summary
- Questions
- Further reading
- Chapter 13: Extracting Geolocation and Metadata from Documents, Images, and Browsers
- Technical requirements
- Extracting geolocation information
- Extracting metadata from images
- Introduction to EXIF and the PIL module
- Getting the EXIF data from an image
- Extracting metadata from PDF documents
- Identifying the technology used by a website
- Extracting metadata from web browsers
- Firefox forensics with Python
- Chrome forensics with Python
- Summary
- Questions
- Further reading
- Chapter 14: Cryptography and Steganography
- Technical requirements
- Encrypting and decrypting information with pycryptodome
- Introduction to cryptography
- Introduction to pycryptodome
- Encrypting and decrypting information with cryptography
- Introduction to the cryptography module
- Steganography techniques for hiding information in images
- Introduction to steganography
- Steganography with Stepic
- Generating keys securely with the secrets and hashlib modules
- Generating keys securely with the secrets module
- Generating keys securely with the hashlib module
- Summary
- Questions
- Further reading
- Assessments
- Chapter 1 – Working with Python Scripting
- Chapter 2 – System Programming Packages
- Chapter 3 – Socket Programming
- Chapter 4 – HTTP Programming
- Chapter 5 – Connecting to the Tor Network and Discovering Hidden Services
- Chapter 6 – Gathering Information from Servers
- Chapter 7 – Interacting with FTP, SFTP, and SSH Servers
- Chapter 8 – Working with Nmap Scanner
- Chapter 9 – Interacting with Vulnerability Scanners
- Chapter 10 – Identifying Server Vulnerabilities in Web Applications
- Chapter 11 – Security and Vulnerabilities in Python Modules
- Chapter 12 – Python Tools for Forensics Analysis
- Chapter 13 – Extracting Geolocation and Metadata from Documents, Images, and Browsers
- Chapter 14 – Cryptography and Steganography
- Other Books You May Enjoy
Section 2: Network Scripting and Extracting Information from the Tor Network with Python
In this section, the reader will learn how to use Python libraries for network scripting and developing scripts for connecting to the Tor network.
This part of the book comprises the following chapters:
-
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click here login for view all page.