一、下载镜像

---

Docker Hub是不是都是访问失败，所以使用的时候需要注意，我这里直接使用的ES官方给的地址

docker pull docker.elastic.co/elasticsearch/elasticsearch:7.10.0

二、部署

2.1 创建目录

mkdir -p /opt/elasticsearch/{config,data,plugins}

2.2 创建配置文件

/opt/elasticsearch/config/elasticsearch.yml

http.host: 0.0.0.0
http.port: 9200
# 启用密码 如果不需要密码 注释即可
xpack.security.enabled: true

2.3 启动

docker run --name elasticsearch --net=host \
 -e "discovery.type=single-node" \
 -e ES_JAVA_OPTS="-Xms512m -Xmx1024m" \
 -v /opt/elasticsearch/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
 -v /opt/elasticsearch/data:/usr/share/elasticsearch/data \
 -v /opt/elasticsearch/plugins:/usr/share/elasticsearch/plugins \
 -d docker.elastic.co/elasticsearch/elasticsearch:7.10.0

• --net=host 使用宿主机网络命名空间
• -e discovery.type=single-node 单点模式启动
• -e ES_JAVA_OPTS="-Xms512m -Xmx1024m"：设置启动占用的内存范围

2.4 配置密码

如果不需要认证，则忽略本步骤，涉及elastic, kibana, logstash_system,beats_system几个系统

# docker进入容器
docker exec -it elasticsearch /bin/bash
# 设置密码
./bin/elasticsearch-setup-passwords interactive
Initiating the setup of passwords for reserved users elastic,kibana,logstash_system,beats_system.
You will be prompted to enter passwords as the process progresses.
Please confirm that you would like to continue [y/N]y
Enter password for [elastic]: 
passwords must be at least [6] characters long
Try again.
Enter password for [elastic]: 
Reenter password for [elastic]: 
Passwords do not match.
Try again.
Enter password for [elastic]: 
Reenter password for [elastic]: 
Enter password for [kibana]: 
Reenter password for [kibana]: 
Enter password for [logstash_system]: 
Reenter password for [logstash_system]: 
Enter password for [beats_system]: 
Reenter password for [beats_system]: 
Changed password for user [kibana]
Changed password for user [logstash_system]
Changed password for user [beats_system]
Changed password for user [Initiating the setup of passwords for reserved users elastic,kibana,logstash_system,beats_system.
You will be prompted to enter passwords as the process progresses.
Please confirm that you would like to continue [y/N]y
Enter password for [elastic]: 
passwords must be at least [6] characters long
Try again.
Enter password for [elastic]: 
Reenter password for [elastic]: 
Passwords do not match.
Try again.
Enter password for [elastic]: 
Reenter password for [elastic]: 
Enter password for [kibana]: 
Reenter password for [kibana]: 
Enter password for [logstash_system]: 
Reenter password for [logstash_system]: 
Enter password for [beats_system]: 
Reenter password for [beats_system]: 
Changed password for user [kibana]
Changed password for user [logstash_system]
Changed password for user [beats_system]
Changed password for user [elastic]

2.5 查看启动状态

浏览器输入，如果有密码，则输入上面的密码，默认用户名为elastic

三、数据迁移

---

数据迁移主要有以下几种方式,我这里采用的是elasticsearch-dump工具方式，更多细节还请查看官方文档或者其它文章详细介绍

迁移方式	使用场景
snapshot	数据量大的场景（GB、TB、PB 级别）对迁移速度要求较高的场景
logstash	迁移全量或增量数据，且对实时性要求不高的场景需要对迁移的数据通过 es query 进行简单的过滤的场景需要对迁移的数据进行复杂的过滤或处理的场景版本跨度较大的数据迁移场景，如 5.x 版本迁移到 6.x 版本或 7.x 版本
elasticsearch-dump	数据量较小的场景

3.1 安装工具

• 安装node.js

# 下载
wget https://nodejs.org/dist/v16.18.0/node-v16.18.0-linux-x64.tar.xz
# 解压
tar -xf node-v16.18.0-linux-x64.tar.xz

• 配置环境变量

# 临时生效
export PATH=$PATH:/root/node-v16.18.0-linux-x64/bin/

# 永久生效
vim ~/.bash_profile
export PATH=$PATH:/root/node-v16.18.0-linux-x64/bin/
source ~/.bash_profile

• 安装elasticsearch-dump

npm install elasticdump -g

3.2 执行数据迁移

目标集群无需创建索引，会自动同步过去

• 迁移指定索引settings

elasticdump --input=http://"<UserName>:<YourPassword>"@<YourEsHost>/<YourEsIndex> --output=http://"<OtherName>:<OtherPassword>"@<OtherEsHost>/<OtherEsIndex> --type=settings

• 迁移指定索引mapping

elasticdump --input=http://"<UserName>:<YourPassword>"@<YourEsHost>/<YourEsIndex> --output=http://"<OtherName>:<OtherPassword>"@<OtherEsHost>/<OtherEsIndex> --type=mapping

• 迁移指定索引data

elasticdump --input=http://"<UserName>:<YourPassword>"@<YourEsHost>/<YourEsIndex> --output=http://"<OtherName>:<OtherPassword>"@<OtherEsHost>/<OtherEsIndex> --type=data

注意

这里如果你的源es集群与目标es集群都没有密码，那么只需要把<UserName>:<YourPassword>相关去除即可，例如:

elasticdump --input=http://<YourEsHost>/<YourEsIndex> --output=http://<OtherEsHost>/<OtherEsIndex> --type=settings
elasticdump --input=http://<YourEsHost>/<YourEsIndex> --output=http://<OtherEsHost>/<OtherEsIndex> --type=mapping
elasticdump --input=http://<YourEsHost>/<YourEsIndex> --output=http://<OtherEsHost>/<OtherEsIndex> --type=data

另外，这里迁移不仅可以往集群中，也可以往单机版es中迁移。

3.3 迁移脚本

脚本是把上面命令行集合下，每次迁移输入指定索引即可

cat index.sh
#!/bin/bash	
INDEX_NAME="$1"
SRC_ES_HOST="<YourEsHost>:9200"
DEST_ES_HOST="<OtherEsHost>:9200"

echo "开始迁移索引-${index} $(date +%Y%m%d-%H:%M:%S)"
# 迁移指定索引的settings
elasticdump --input=${SRC_ES_HOST}/${INDEX_NAME} --output=${DEST_ES_HOST}/${INDEX_NAME} --type=settings
# 迁移指定索引的mapping
elasticdump --input=${SRC_ES_HOST}/${INDEX_NAME} --output=${DEST_ES_HOST}/${INDEX_NAME} --type=mapping
# 迁移指定索引的data
elasticdump --input=${SRC_ES_HOST}/${INDEX_NAME} --output=${DEST_ES_HOST}/${INDEX_NAME} --type=data
echo "结束迁移索引-${index} $(date +%Y%m%d-%H:%M:%S)"
echo "---------------------------------------------"

• 使用

sh index.sh my_index