pprof 安装及使用

golang pprof 用于对线上运行程序 性能监控与分析

工具安装

1

go get -u github.com/google/pprof

代码注入

1

import _ "net/http/pprof"

启动服务(6060端口为例)

1

go run ...

获取监控文件(heap为例)

1

curl http://localhost:6060/debug/pprof/heap > heap.profile

pprof web监控示例

1

pprof -http=: ./heap.profile

more

pprof tools

pprof doc

xxjwxc doc

手动安装

golang内存泄露工具检查

  • 安装工具

  • brew install graphviz （生成图片时候要用到dot）

  1. 使用pprof工具实现

  • 简单使用场景

     1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42

    package main

import (
	"fmt"
	"net/http"
	"runtime/pprof"
	"time"
)

var quit chan struct{} = make(chan struct{})

func ffff() {
	<-quit
}

func handler(w http.ResponseWriter, r *http.Request) {
	w.Header().Set("Content-Type", "text/plain")

	p := pprof.Lookup("goroutine")
	//p.WriteTo(w, 0)
	p.WriteTo(w, 1)
	//p.WriteTo(w, 2)

}

func main() {
	timer := time.NewTimer(3 * time.Second)

	go func() {
		<-timer.C
		fmt.Println("Timer has expired.")
	}()

	timer.Stop()

	for i := 0; i < 100; i++ {
		go ffff()
	}

	http.HandleFunc("/", handler)
	http.ListenAndServe(":11181", nil)
}

  • 直接访问 http://localhost:11181/ 即可查看信息

1

具体详细分析数据

  • demo 依然是上边的程序 改造一下

     1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74

    package main

import (
	"fmt"
	"net/http"
	"os"
	"runtime"
	"runtime/pprof"
	"strings"
	"time"
)

var (
	pid      int
	progname string
)

var quit chan struct{} = make(chan struct{})

func init() {
	pid = os.Getpid()
	paths := strings.Split(os.Args[0], "/")
	paths = strings.Split(paths[len(paths)-1], string(os.PathSeparator))
	progname = paths[len(paths)-1]
	runtime.MemProfileRate = 1
}

func ffff() {
	<-quit
}

func handler(w http.ResponseWriter, r *http.Request) {
	w.Header().Set("Content-Type", "text/plain")

	p := pprof.Lookup("goroutine")
	//p.WriteTo(w, 0)
	p.WriteTo(w, 1)
	//p.WriteTo(w, 2)

}

func saveHeapProfile() {
	runtime.GC()
	f, err := os.Create(fmt.Sprintf("./heap_%s_%d_%s.prof", progname, pid, time.Now().Format("2006_01_02_03_04_05")))
	if err != nil {
		return
	}
	defer f.Close()
	pprof.Lookup("heap").WriteTo(f, 1)
}

func main() {
	timer := time.NewTimer(3 * time.Second)

	go func() {
		<-timer.C
		fmt.Println("Timer has expired.")
	}()

	timer.Stop()

	for i := 0; i < 100; i++ {
		go ffff()
	}

	go func() {

		time.Sleep(3 * time.Second)
		saveHeapProfile()
	}()

	http.HandleFunc("/", handler)
	http.ListenAndServe(":11181", nil)
}

记得：

1
2

go build 
go run
  • 3秒后当前目录生成一个文件： heap_main_13712_2019_06_07_02_50_56.prof

命令工具

  1. 1

    进入pprof 内部 可以使用 top 10等命令来查看过滤信息，exit退出

$ go tool pprof ./main ./heap_main_13712_2019_06_07_02_50_56.prof File: main Type: inuse_space Entering interactive mode (type “help” for commands, “o” for options) (pprof)

1
2
3
4

2. ```go tool pprof --text ./main ./heap_main_13712_2019_06_07_02_50_56.prof```

查看各个函数/方法的内存消耗排名
------

$ go tool pprof –text ./main ./heap_main_13712_2019_06_07_02_50_56.prof File: main Type: inuse_space Showing nodes accounting for 54.55kB, 98.55% of 55.35kB total Dropped 18 nodes (cum <= 0.28kB) flat flat% sum% cum cum% 40.88kB 73.85% 73.85% 40.88kB 73.85% runtime.malg 9.28kB 16.77% 90.61% 9.28kB 16.77% main.ffff 1kB 1.81% 92.42% 1kB 1.81% runtime.allgadd 1kB 1.81% 94.23% 2kB 3.61% runtime.allocm 0.73kB 1.33% 95.55% 0.74kB 1.34% net/http.http2ConfigureServer 0.62kB 1.13% 96.68% 43.75kB 79.04% runtime.systemstack 0.45kB 0.82% 97.50% 0.48kB 0.88% net/http.(*ServeMux).Handle 0.25kB 0.45% 97.95% 0.62kB 1.13% runtime.mcommoninit 0.20kB 0.37% 98.32% 2.10kB 3.80% main.main 0.06kB 0.11% 98.43% 1.04kB 1.88% net/http.(*Server).Serve 0.06kB 0.11% 98.55% 0.80kB 1.45% net/http.(*Server).onceSetNextProtoDefaults 0 0% 98.55% 1.28kB 2.31% net/http.(*Server).ListenAndServe 0 0% 98.55% 0.80kB 1.45% net/http.(*Server).onceSetNextProtoDefaults_Serve 0 0% 98.55% 0.80kB 1.45% net/http.(*Server).setupHTTP2_Serve 0 0% 98.55% 2kB 3.61% runtime.entersyscallblock_handoff 0 0% 98.55% 11.60kB 20.96% runtime.goexit 0 0% 98.55% 2kB 3.61% runtime.handoffp 0 0% 98.55% 2.10kB 3.80% runtime.main 0 0% 98.55% 2kB 3.61% runtime.newm 0 0% 98.55% 41.12kB 74.30% runtime.newproc.func1 0 0% 98.55% 41.12kB 74.30% runtime.newproc1 0 0% 98.55% 43.75kB 79.04% runtime.startTheWorldWithSema 0 0% 98.55% 2kB 3.61% runtime.startm 0 0% 98.55% 0.80kB 1.45% sync.(*Once).Do

1
2
3
4
5
6
7
8

3. ```go tool pprof --dot ./main ./heap_main_13712_2019_06_07_02_50_56.prof > heap.gv```


生成可以在graphviz里面看的gv文件

------

4. 通过3的gv文件直接生成图片

dot -T png heap.gv>heap.png```

  • 打开图片查看信息

2