Visualization on PIGSTY

Analyse CSVLOG Sample with the built-in PGLOG

Wed, 18 May 2022 00:00:00 +0000

PGLOG is a sample application included with Pigsty that uses the pglog.sample table in MetaDB as the data source. Simply populate this table with logs and access the corresponding Dashboard.

Pigsty provides some handy commands to fetch CSV logs and load them into the sample table. The following shortcut commands are available on the master node by default:

catlog  [node=localhost]  [date=today]   # Print CSV logs to standard output
pglog                                    # Load CSVLOG from standard input
pglog12                                  # Load CSVLOG in PG12 format
pglog13                                  # Load CSVLOG in PG13 format
pglog14                                  # Load CSVLOG in PG14 format (=pglog)

catlog | pglog                       # Analyze logs of the current node for today
catlog node-1 '2021-07-15' | pglog   # Analyze CSV logs of node-1 for 2021-07-15

Next, you can visit the following links to view sample log analysis dashboards:

NOAA ISD Station

Mon, 04 Jan 2021 00:00:00 +0000

Including 30000 meteorology station, daily, sub-hourly observation records, from 1900-2023. https://github.com/Vonng/isd

It is recommended to use with Pigsty, the battery-included PostgreSQL distribution with Grafana & echarts for visualization. It will setup everything for your with make all;

Otherwise, you’ll have to provide your own PostgreSQL instance, and setup grafana dashboards manually.

Quick Start

Clone this repo

git clone https://github.com/Vonng/isd.git; cd isd;

Prepare a PostgreSQL Instance

WHO COVID-19 Data Analysis

Tue, 18 Jan 2022 00:00:00 +0000

The on-line demo：https://demo.pigsty.cc/d/covid-overview

Installation

在管理节点上进入应用目录，执行make以完成安装。

make            # 如果本地数据可用
make all        # 完整安装，从WHO官网下载数据
makd reload     # 重新下载并加载最新数据

其他一些子任务：

make reload     # download latest data and pour it again
make ui         # install grafana dashboards
make sql        # install database schemas
make download   # download latest data
make load       # load downloaded data into database
make reload     # download latest data and pour it into database

Dashboards

Solve the 24-Point Card Game with One SQL Statement

Thu, 11 Jan 2024 00:00:00 +0000

Problem

The challenge is described in Database Programming Contest: Calculate 24 with One SQL Statement.

A cards table has an auto-incrementing id and four columns, c1 through c4; each card is a random integer from 1 to 10. One SQL statement must return a valid arithmetic expression whose result is 24, or NULL when no solution exists.

The rules allow only addition, subtraction, multiplication, division, and parentheses. Every input number must be used exactly once. Built-in database functions are allowed, but stored procedures, user-defined functions, and code blocks are not. The submitted SQL must be smaller than 10 KB and was evaluated on a 4-core, 32 GB server.

Visualization Applet

Mon, 11 Mar 2024 00:00:00 +0000

An Applet is a self-contained, data-driven mini-application that runs within the Pigsty infrastructure.

A typical Pigsty application includes at least one or all of the following components:

Graphical Interface (Grafana Dashboard definitions) located in the ui directory
Data Definitions (PostgreSQL DDL Files) located in the sql directory
Data Files (various resources that need to be downloaded) located in the data directory
Logic Scripts (scripts for executing various logic) located in the bin directory

Pigsty comes with several sample applications by default:

StackOverflow Global Developer Survey

Sun, 11 Jun 2023 00:00:00 +0000

Overview

GitHub Repository: https://github.com/Vonng/pigsty-app/tree/11fbbc03031b0a060cf4da0f87f3f12a4ec2f126/db

Online Demo: https://demo.pigsty.io/d/sf-survey

DB-Engines Database Popularity Trend Analysis

Sun, 11 Jun 2023 00:00:00 +0000

Overview

GitHub Repository: https://github.com/Vonng/pigsty-app/tree/11fbbc03031b0a060cf4da0f87f3f12a4ec2f126/db

Online Demo: https://demo.pigsty.io/d/db-engine

AWS & Aliyun Server Pricing

Mon, 11 Mar 2024 00:00:00 +0000

Overview

Historical source note: the advertised pigsty-app/cloud directory was not present in the last immutable app repository snapshot before v2.7.0; the SQL and recovered images below come from the frozen documentation repository.

Online Demo: https://demo.pigsty.io/d/ecs

Article: Analyzing Computing Costs: Has Aliyun Really Reduced Prices?

Data Source

Aliyun ECS pricing can be obtained as raw CSV data from Price Calculator - Pricing Details - Price Download.