万亿级流量转发：BFE核心技术与实现

定　　价：89 元

• 作者：章淼 等
• 出版时间：2021/7/1
• ISBN：9787121415654
• 出 版 社：电子工业出版社

• 中图法分类：TP391.3 
• 页码：280
• 版次：01
• 开本：16开

内容简介

本书围绕BFE 开源项目，介绍网络前端接入和网络负载均衡的相关技术原理，说明BFE开源软件的设计思想和实现机制，讲解如何基于BFE开源软件搭建网络接入平台。本书共17 章，分为四个部分。第一部分为原理篇，介绍BFE 开源项目的概貌，并对网络前端接入技术和网络负载均衡技术做简要介绍；第二部分为设计篇，介绍BFE 开源项目的设计细节，包括BFE 的设计思想、BFE 的转发模型、BFE 的关键机制和HTTPS 的优化等；第三部分为操作篇，说明如何安装和部署BFE、如何在各种使用场景下配置BFE；第四部分为实现篇，从处理流程、插件机制、协议实现等方面说明BFE的实现机制。

作者介绍

章淼，百度智能云智能负载均衡架构师、百度代码规范委员会主席（兼）

目 录

原 理 篇
第1 章 BFE 简介·····························································································3
1.1 什么是BFE·························································································3
1.2 BFE平台介绍·····················································································4
1.2.1 为什么需要构建BFE 平台·····················································4
1.2.2 BFE平台的主要功能·····························································6
1.3 BFE开源项目介绍·············································································7
1.3.1 BFE平台的模块组成·····························································7
1.3.2 BFE开源项目中的内容··························································9
第2 章 网络前端接入技术简介·····································································10
2.1 什么是网络前端接入········································································10
2.2 网络前端接入面临的挑战································································11
2.3 百度的网络前端接入方案································································13
2.4 网络前端接入技术的发展趋势························································15
第3 章 网络负载均衡技术简介·····································································24
3.1 负载均衡的概念···············································································24
3.2 网络负载均衡功能的实现································································25
深入理解BFE
·VI·
3.2.1 机制说明···············································································25
3.2.2 两种方式对比········································································27
3.3 四层负载均衡和七层负载均衡························································28
设 计 篇
第4 章 BFE 的设计思想················································································33
4.1 BFE转发引擎重构的缘起································································33
4.2 BFE为什么要基于Go 语言·····························································34
4.3 BFE转发引擎的主要设计思想························································37
4.4 BFE和相关开源项目的对比····························································38
第5 章 BFE 的转发模型················································································42
5.1 转发模型概述···················································································42
5.1.1 基本概念···············································································42
5.1.2 转发过程···············································································43
5.1.3 对多租户实现机制的讨论····················································46
5.2 BFE的路由转发机制·······································································47
5.3 条件表达式·······················································································49
5.3.1 设计思想···············································································49
5.3.2 基本概念···············································································50
5.3.3 语法介绍···············································································51
5.3.4 条件原语匹配的内容····························································52
5.3.5 条件原语名称的规范····························································54
5.4 内网流量调度机制············································································55
5.4.1 内网流量调度背景介绍························································55
5.4.2 内网流量调度工作机制························································60
目 录
·VII·
5.4.3 内网转发的其他机制····························································65
第6 章 与转发相关的关键机制·····································································68
6.1 健康检查机制···················································································68
6.1.1 健康检查的原理····································································69
6.1.2 主动健康检查和被动健康检查············································69
6.1.3 分布式健康检查和集中式健康检查····································73
6.1.4 BFE的健康检查···································································77
6.2 超时设置···························································································77
6.2.1 BFE和客户端间通信的超时················································78
6.2.2 BFE和后端实例间通信的超时············································81
6.3 BFE信息透传···················································································84
6.3.1 客户端IP地址的透传··························································84
6.3.2 其他信息的透传····································································85
6.4 限流机制···························································································89
6.4.1 限流的概念···········································································89
6.4.2 限流的配置···········································································91
6.4.3 分布式限流···········································································91
6.4.4 入口限流和目的限流····························································94
6.4.5 限流和内网流量调度····························································95
第7 章 运维相关机制····················································································97
7.1 监控机制···························································································97
7.1.1 日志监控及其问题································································98
7.1.2 BFE的内部状态输出···························································99
7.1.3 统计状态和日志的配合使用··············································101
深入理解BFE
·VIII·
7.2 Web Monitor基础库·······································································101
7.2.1 Web Monitor概述·······························································102
7.2.2 状态变量维护······································································102
7.2.3 延迟统计变量维护······························································104
7.2.4 建立专用的Web服务器·····················································106
7.2.5 注册回调函数······································································107
7.3 日志机制·························································································108
7.3.1 日志类型·············································································108
7.3.2 日志打印的注意事项··························································109
7.3.3 BFE的访问日志·································································110
7.4 配置管理························································································.111
7.4.1 BFE配置文件的分布·························································.111
7.4.2 常规配置和动态配置··························································112
7.4.3 动态配置的实现机制··························································113
第8 章 HTTPS 的优化················································································116
8.1 HTTPS优化背景及必要性·····························································116
8.2 HTTPS优化的挑战········································································117
8.3 HTTPS中的优化机制·····································································118
8.4 BFE中HTTPS 相关增强机制························································120
操 作 篇
第9 章 BFE 服务的安装部署······································································129
9.1 软件安装包下载安装······································································129
9.2 源代码编译方式安装······································································132
9.3 Docker方式安装·············································································133
目 录
·IX·
9.4 BFE命令行参数·············································································134
9.5 查看BFE 服务的运行状态·····························································135
第10 章 BFE 服务的基础配置····································································136
10.1 场景说明·······················································································136
10.2 修改基础配置文件········································································137
10.3 转发的配置···················································································138
10.3.1 转发配置流程····································································138
10.3.2 具体案例···········································································139
10.3.3 服务访问验证····································································146
10.3.4 配置的重新加载································································146
第11 章 配置负载均衡算法及会话保持·····················································147
11.1 子集群间的负载均衡····································································147
11.2 子集群级别的会话保持································································149
11.2.1 配置实例···········································································149
11.2.2 参数的具体含义································································150
11.3 实例间的负载均衡········································································151
11.3.1 加权轮询配置示例····························································151
11.3.2 最小连接数的配置示例····················································153
11.4 实例级别的会话保持····································································154
第12 章 配置HTTPS 和更多协议·····························································155
12.1 设置HTTPS 基础配置··································································155
12.1.1 配置HTTPS 端口·····························································156
12.1.2 配置加密套件····································································156
12.1.3 配置服务端证书································································156
深入理解BFE
·X·
12.1.4 配置TLS 规则···································································157
12.2 配置TLS 会话重用·······································································158
12.2.1 配置会话缓存····································································159
12.2.2 配置会话票证····································································160
12.3 配置TLS 双向认证·······································································161
12.4 对不同安全等级的区分································································163
12.5 支持更多协议···············································································164
12.5.1 HTTP/2配置·····································································165
12.5.2 SPDY 配置········································································166
12.5.3 WebSocket配置·································································167
12.5.4 连接后端服务的协议························································169
第13 章 其他常用配置················································································171
13.1 配置重写·······················································································171
13.1.1 开启重写···········································································171
13.1.2 模块配置···········································································171
13.1.3 重写动作详细描述····························································173
13.2 配置重定向···················································································177
13.2.1 开启重定向········································································177
13.2.2 模块配置···········································································177
13.2.3 重定向动作详细描述························································178
13.3 配置限流功能···············································································180
13.3.1 开启限流模块····································································180
13.3.2 模块配置···········································································181
13.3.3 限制特定维度的流量························································182
13.3.4 设置限流门限····································································183
13.3.5 设置限流动作····································································184
目 录
·XI·
实 现 篇
第14 章 其他常用配置················································································187
14.1 BFE的代码组织···········································································187
14.2 BFE的进程模型···········································································190
14.2.1 协程的分类·······································································190
14.2.2 并发模型···········································································191
14.2.3 并发能力···········································································192
14.2.4 异常恢复机制····································································192
14.3 请求处理流程···············································································193
14.3.1 连接的建立·······································································193
14.3.2 连接的处理·······································································194
14.3.3 请求的处理·······································································196
14.3.4 请求的结束·······································································198
14.3.5 连接的结束·······································································199
14.4 请求路由实现···············································································199
14.4.1 关键数据结构····································································200
14.4.2 目的租户路由····································································203
14.4.3 目的集群路由····································································204
14.5 负载均衡实现···············································································206
14.5.1 全局负载均衡····································································207
14.5.2 分布式负载均衡································································210
第15 章 模块插件机制················································································214
15.1 BFE的回调点设置·······································································214
15.2 BFE内置的扩展模块···································································216
15.3 模块框架的实现机制····································································217
深入理解BFE
·XII·
15.3.1 模块基础类型····································································217
15.3.2 连接/请求处理及回调函数的调用···································223
15.4 如何开发BFE扩展模块·······························································224
15.4.1 配置加载···········································································225
15.4.2 回调函数的编写和注册····················································226
15.4.3 模块状态的展示································································228
第16 章 核心协议实现················································································231
16.1 HTTP的实现················································································231
16.1.1 HTTP 代码的组织·····························································231
16.1.2 从用户读取HTTP 请求····················································233
16.1.3 向后端转发请求并获取响应············································236
16.1.4 向用户回复HTTP 响应····················································239
16.2 HTTP2的实现··············································································240
16.2.1 HTTP2 代码的组织···························································240
16.2.2 HTTP2 连接处理模块·······················································241
16.2.3 HTTP2 连接相关协程及关系···········································243
第17 章 BFE 的多进程GC 机制································································249
17.1 模型设计·······················································································249
17.1.1 多进程轮转机制································································250
17.1.2 子进程状态定义································································252
17.2 相关参数的确定············································································253
17.2.1 切换时间参数的选择························································253
17.2.2 子进程数量的计算····························································255
17.2.3 内存消耗的计算································································256