{"id":11705,"date":"2019-03-15T22:54:58","date_gmt":"2019-03-15T22:54:58","guid":{"rendered":"http:\/\/www.appservgrid.com\/paw92\/?p=11705"},"modified":"2019-03-15T22:54:58","modified_gmt":"2019-03-15T22:54:58","slug":"goaccess-a-real-time-apache-and-nginx-web-server-log-analyzer","status":"publish","type":"post","link":"https:\/\/www.appservgrid.com\/paw92\/index.php\/2019\/03\/15\/goaccess-a-real-time-apache-and-nginx-web-server-log-analyzer\/","title":{"rendered":"GoAccess (A Real-Time Apache and Nginx) Web Server Log Analyzer"},"content":{"rendered":"

GoAccess<\/strong>\u00a0is an interactive and real time web server log analyzer program that quickly analyze and view web server logs. It comes as an open source and runs as a command line in Unix\/Linux operating systems. It provides brief and beneficial HTTP (web server) statistics report for Linux administrators on the fly. It also take care of both the\u00a0Apache<\/strong>\u00a0and\u00a0Ngnix<\/strong>\u00a0web server log formats.<\/p>\n

GoAccess<\/strong>\u00a0parses and analyze the given web server log formats in preferred options including\u00a0CLF<\/strong>\u00a0(Common Log Format<\/strong>),\u00a0W3C<\/strong>\u00a0format (IIS<\/strong>) and Apache virtual hosts and then generate output of the data to the terminal.<\/p>\n

GoAccess Features<\/h4>\n

It has the following features.<\/p>\n

    \n
  1. General Statistics, bandwidth etc.<\/li>\n
  2. Top Visitors, Visitors Time Distribution, Referring Sites & URLs and 404 or Not Found.<\/li>\n
  3. Hosts, Reverse DNS, IP Location.<\/li>\n
  4. Operating Systems, Browsers and Spiders.<\/li>\n
  5. HTTP Status Codes<\/li>\n
  6. Geo Location \u2013 Continent\/Country\/City<\/li>\n
  7. Metrics per Virtual Host<\/li>\n
  8. Support for HTTP\/2 & IPv6<\/li>\n
  9. Ability to output JSON and CSV<\/li>\n
  10. Incremental log processing and support for large datasets + data persistence<\/li>\n
  11. Different Color Schemes<\/li>\n<\/ol>\n

    How Do I Install GoAccess?<\/h3>\n

    Presently, the most recent version of\u00a0GoAccess 0.9.7<\/strong>\u00a0is not available from default system package repositories, so to install latest stable version, you need to manually download and compile it from source code under Linux systems as shown:<\/p>\n

    Install GoAccess from Source<\/h4>\n
    # yum install ncurses-devel glib2-devel geoip-devel\r\n# cd \/usr\/src\r\n# wget http:\/\/tar.goaccess.io\/goaccess-0.9.8.tar.gz\r\n# tar zxvf goaccess-0.9.8.tar.gz\r\n# cd goaccess-0.9.8\/\r\n# .\/configure\r\n# make; make install\r\n<\/pre>\n
    Install GoAccess Using Package Manager<\/h4>\n
    The easiest and preferred way to install GoAccess on Linux using the default package manager of your respective Linux distribution.<\/p>\n
    Note:<\/strong>\u00a0As I said above, not all distributions will have the most recent version of GoAccess available in the system default repositories..<\/p>\n
    On RedHat, CentOS and Fedora<\/h5>\n
    # yum install goaccess\r\n# dnf install goaccess    [From Fedora 23+<\/strong> versions]\r\n<\/pre>\n
    On Debian and Ubuntu Systems<\/h5>\n
    GoAccess<\/strong>\u00a0utility is available since\u00a0Debian Squeeze 6<\/strong>\u00a0and\u00a0Ubuntu 11.04<\/strong>. To install just run the following command on the terminal.<\/p>\n
    # apt-get install goaccess\r\n<\/pre>\n
    Note:<\/strong>\u00a0The above command will not always provide you the most latest version. To get the latest stable version of GoAccess, add the official GoAccess Debian & Ubuntu repository as shown:<\/p>\n
    $ echo \"deb http:\/\/deb.goaccess.io\/ $(lsb_release -cs) main\" | sudo tee -a \/etc\/apt\/sources.list.d\/goaccess.list\r\n$ wget -O - http:\/\/deb.goaccess.io\/gnugpg.key | sudo apt-key add -\r\n$ sudo apt-get update\r\n$ sudo apt-get install goaccess\r\n<\/pre>\n
    How Do I Use GoAccess?<\/h3>\n
    Once,\u00a0goaccess<\/strong>\u00a0is installed, execute \u2018goaccess<\/strong>\u2018 command without any arguments will list the help menu.<\/p>\n
    # goaccess<\/pre>\n
    Sample Output<\/h5>\n
    GoAccess - 0.9.8\r\n\r\nUsage: goaccess [ options ... ] -f log_file [-c][-M][-H][-q][-d][...]\r\nThe following options can also be supplied to the command:\r\n\r\nLog & Date Format Options\r\n\r\n  --log-format=        - Specify log format. Inner quotes need to\r\n                                    be escaped, or use single quotes.\r\n  --date-format=      - Specify log date format. e.g.,\r\n                                    %d\/%b\/%Y\r\n  --time-format=      - Specify log time format. e.g.,\r\n                                    %H:%M:%S\r\n\r\nUser Interface Options\r\n\r\n  -c --config-dialog              - Prompt log\/date\/time configuration\r\n                                    window.\r\n  -i --hl-header                  - Color highlight active panel.\r\n  -m --with-mouse                 - Enable mouse support on main dashboard.\r\n  --color=<fg:bg[attrs, PANEL]>   - Specify custom colors. See manpage for\r\n                                    more details and options.\r\n  --color-scheme=<1|2>            - Color schemes: 1 => Grey, 2 => Green.\r\n  --html-report-title=     - Set HTML report page title and header.\r\n  --no-color                      - Disable colored output.\r\n  --no-column-names               - Don't write column names in term\r\n                                    output.\r\n  --no-csv-summary                - Disable summary metrics on the CSV\r\n                                    output.\r\n  --no-progress                   - Disable progress metrics.\r\n  --no-tab-scroll                 - Disable scrolling through panels on TAB.\r\n\r\nFile Options\r\n\r\n  -f --log-file=        - Path to input log file.\r\n  -l --debug-file=      - Send all debug messages to the specified\r\n                                    file.\r\n  -p --config-file=     - Custom configuration file.\r\n  --invalid-requests=   - Log invalid requests to the specified\r\n                                    file.\r\n  --no-global-config              - Don't load global configuration\r\n                                    file.\r\n.....\r\n<\/pre>\n
    The easiest way to get the any web server statistics use the flag \u2018f<\/code>\u2018 with input log file name as shown below. The below command will give you general statistics of your web server logs.<\/p>\n
    # goaccess -f \/var\/log\/httpd\/tecmint.com\r\n# goaccess -f \/var\/log\/nginx\/tecmint.com\r\n<\/pre>\n
    The above command gives you an complete overview of web server metrics by showing summaries of various reports as panels on a one scrollable view as shown.<\/p>\n
    Apache Logs Overview<\/h4>\n
    \n
    \"View<\/a><\/p>\n
    View Web Server Apache Logs<\/p>\n<\/div>\n
    Apache Logs by Operating System \u2013 Overview<\/h4>\n
    \n
    \"View<\/a><\/p>\n
    View Apache Logs By Operating System<\/p>\n<\/div>\n
    Apache Logs by Visitor Bandwidth \u2013 Overview<\/h4>\n
    \n
    \"View<\/a><\/p>\n
    View Apache Visitor Bandwidth Usage<\/p>\n<\/div>\n
    Apache Logs by Web Browser \u2013 Overview<\/h4>\n
    \n
    \"View<\/a><\/p>\n
    View Apache Usage based on Browsers<\/p>\n<\/div>\n
    How do I generate Apache HTML report?<\/h3>\n
    To generate an HTML report of your Apache webserver logs, just run it against your web log file.<\/p>\n
    # goaccess -f \/var\/log\/httpd\/access_log > reports.html\r\n<\/pre>\n
    \n
    \"Monitor<\/a><\/p>\n
    GoAccess: Monitor Apache Logs Using Web Browser<\/p>\n<\/div>\n
    For more information and usage please visit\u00a0http:\/\/goaccess.io\/<\/a>.<\/p>\n
    Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
    GoAccess\u00a0is an interactive and real time web server log analyzer program that quickly analyze and view web server logs. It comes as an open source and runs as a command line in Unix\/Linux operating systems. It provides brief and beneficial HTTP (web server) statistics report for Linux administrators on the fly. It also take care … <\/p>\n
    Continue reading “GoAccess (A Real-Time Apache and Nginx) Web Server Log Analyzer”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-11705","post","type-post","status-publish","format-standard","hentry","category-linux"],"_links":{"self":[{"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/posts\/11705","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/comments?post=11705"}],"version-history":[{"count":1,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/posts\/11705\/revisions"}],"predecessor-version":[{"id":11706,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/posts\/11705\/revisions\/11706"}],"wp:attachment":[{"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/media?parent=11705"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/categories?post=11705"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.appservgrid.com\/paw92\/index.php\/wp-json\/wp\/v2\/tags?post=11705"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}