Prometheus 安装、调试等笔记。

概览

Prometheus 通过抓取或拉取应用程序中暴露的时间序列数据来工作。时间序列数据通常由应用程序本身通过客户端库或称为 exporter（导出器）的代理来作为 HTTP 端点暴露。

特性

  • 多维数据（Dimensional data）
  • 强大的查询（Powerful queries)
  • 强大的可视化（Great visualization）
  • 高效的存储（Efficient storage）
  • 简单的运维（Simple operation）
  • 精确的告警（Precise alerting）
  • 客户端库丰富（Many client libraries）
  • 插件丰富（Many integrations）

组件

  • Prometheus server - 拉取并存储时间序列数据
  • client libraries - 检测应用程序代码
  • push gateway - 支持短期 job 或不支持拉取的应用
  • 专用 service exporter - 用于获取相应服务指标，如 HAProxy、Kafka 等
  • alertmanager - 用于处理告警
  • 各种支持工具

HTTP 基本认证

Prometheus 并不直接支持 HTTP 基本认证，可以借助 nginx 这类反向代理工具实现。

本地学习

本地环境信息

  • 操作系统：Windows 10
  • 终端工具：Windows Terminal (Preview) Version: 0.6.2951.0

Prometheus

监控本机的配置

配置文件：prometheus.yml

global:
  scrape_interval:     15s # By default, scrape targets every 15 seconds.

  # Attach these labels to any time series or alerts when communicating with
  # external systems (federation, remote storage, Alertmanager).
  external_labels:
    monitor: 'codelab-monitor'

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # Override the global default and scrape targets from this job every 5 seconds.
    scrape_interval: 5s

    static_configs:
      - targets: ['localhost:9090']

启动 Prometheus

PS C:\prometheus> .\prometheus.exe --config.file=prometheus.yml
:: http://localhost:9090/graph

启动样本目标

:: 安装 random 命令
PS C:\Users\feilong\go\src\github.com> go env
set GOARCH=amd64
set GOBIN=
set GOCACHE=C:\Users\feilong\AppData\Local\go-build
set GOEXE=.exe
set GOFLAGS=
set GOHOSTARCH=amd64
set GOHOSTOS=windows
set GOOS=windows
set GOPATH=C:\Users\feilong\go
set GOPROXY=
set GORACE=
set GOROOT=C:\Go
set GOTMPDIR=
set GOTOOLDIR=C:\Go\pkg\tool\windows_amd64
set GCCGO=gccgo
set CC=gcc
set CXX=g++
set CGO_ENABLED=1
set GOMOD=
set CGO_CFLAGS=-g -O2
set CGO_CPPFLAGS=
set CGO_CXXFLAGS=-g -O2
set CGO_FFLAGS=-g -O2
set CGO_LDFLAGS=-g -O2
set PKG_CONFIG=pkg-config
set GOGCCFLAGS=-m64 -mthreads -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=C:\Users\feilong\AppData\Local\Temp\go-build367024130=/tmp/go-build -gno-record-gcc-switches

PS C:\Users\feilong\go\src\github.com> git clone https://github.com/prometheus/client_golang.git

PS C:\Users\feilong\go\src\github.com> cd client_golang/examples/random
PS C:\Users\feilong\go\src\github.com\client_golang\examples\random> go get -d
PS C:\Users\feilong\go\src\github.com\client_golang\examples\random> go build

:: 在三个终端分别执行
PS C:\Users\feilong\go\src\github.com\client_golang\examples\random> .\random.exe -listen-address=:8080
PS C:\Users\feilong\go\src\github.com\client_golang\examples\random> .\random.exe -listen-address=:8081
PS C:\Users\feilong\go\src\github.com\client_golang\examples\random> .\random.exe -listen-address=:8082

配置 Prometheus 监控样本目标

scrape_configs:
  - job_name:       'example-random'

    # Override the global default and scrape targets from this job every 5 seconds.
    scrape_interval: 5s

    static_configs:
      - targets: ['localhost:8080', 'localhost:8081']
        labels:
          group: 'production'

      - targets: ['localhost:8082']
        labels:
          group: 'canary'

可视化

表达式浏览器

点击

Grafana

PS C:\grafana> .\bin\grafana-server.exe

点击

添加监控图形
  • Metrics：rate(prometheus_http_request_duration_seconds_count{job=”prometheus”}[5m])
  • Legend： {{handler}}
导入仪表盘模板

控制台模板

学习曲线陡峭，一般使用 Grafana。

点击

告警