This is the Linux app named apache-logs-to-mysql whose latest release can be downloaded as ProperPythonCode_NGINXformatssourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named apache-logs-to-mysql with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
apache-logs-to-mysql
DESCRIPTION
Apache Log Parser and Data Normalization Application
Python handles File Processing & MySQL handles Data Processing
ApacheLogs2MySQL consists of two Python Modules & one MySQL Schema to automate importing Access & Error files and normalizing data into database designed for reports & data analysis.
Runs on Windows, Linux and MacOS & tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 & 9.1.0.
4 LogFormats & 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python `ProcessLogs function` execution.
Database system designed to accommodate unlimited domains. Step-by-step guide for easy installation.
Web interface with Drill Down Capability and apache/echarts Log Visualization integration in development.
MySQL apache_logs schema currently has 49 Tables, 853 Columns, 168 Indexes, 66 Views, 7 Stored Procedures and 43 Functions to process Apache Access log in 4 formats & Apache Error log in 2 formats. Database normalization at work!
Features
- Creates MySQL schema - apache_logs
- Includes 2 Python modules
- Imports Apache Access Logs - common, combined and vhost_combined
- Imports Apache Error Logs
- Complete Apache Log Data Normalization
- MySQL does all Data Manipulation & Processing
- Python handles polling of log file folders
- Python executes MySQL Database LOAD DATA statements
- Python executes Stored Procedures & Functions and SQL Statements
- Requires installation of 4 Python modules - requirements.txt included
Audience
Developers, Information Technology, Management, System Administrators
User interface
Command-line, Console/Terminal
Programming Language
Python
Database Environment
Python Database API, SQL-based
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/apachelogs2mysql/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
