问题描述

Alive: false表示节点未存活

查看BE状态显示 ErrMsg: java.net.ConnectException: 拒绝连接 (Connection refused)


mysql> show backends\G
*************************** 1. row ***************************
              BackendId: 10231
                   Host: 172.19.122.201
          HeartbeatPort: 9050
                 BePort: 9060
               HttpPort: 8040
               BrpcPort: 8060
     ArrowFlightSqlPort: -1
          LastStartTime: 2024-12-25 14:31:29
          LastHeartbeat: 2025-01-04 00:45:09
                  Alive: false
   SystemDecommissioned: false
              TabletNum: 116
       DataUsedCapacity: 436.499 MB
      TrashUsedCapacity: 0.000 
          AvailCapacity: 966.156 GB
          TotalCapacity: 999.508 GB
                UsedPct: 3.34 %
         MaxDiskUsedPct: 3.34 %
     RemoteUsedCapacity: 0.000 
                    Tag: {"location" : "default"}
                 ErrMsg: java.net.ConnectException: 拒绝连接 (Connection refused)
                Version: doris-2.1.6-rc04-653e315ba5
                 Status: {"lastSuccessReportTabletsTime":"2025-01-04 00:44:28","lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false}
HeartbeatFailureCounter: 31216
               NodeRole: 
1 row in set (0.01 sec)

分析过程

查看防火墙是否开启

防火墙未开启,也未设置策略

[root@HKSZF-ZW-172-19-122-201 ~]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
   Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
   Active: inactive (dead)

12月 20 13:20:28 HKSZF-ZW-172-19-122-201 systemd[1]: Stopping firewalld - dynamic firewall daemon...
12月 20 13:20:29 HKSZF-ZW-172-19-122-201 systemd[1]: Stopped firewalld - dynamic firewall daemon.

[root@HKSZF-ZW-172-19-122-201 ~]# firewall-cmd  --list-port
FirewallD is not running

查看配置文件中端口

vi /data/apache-doris-2.1.6/be/conf/be.conf

/data/apache-doris-2.1.6/be

查看服务器配置

官方文档建议的配置

内存

[root@HKSZF-ZW-172-19-122-201 be]# free -g
              total        used        free      shared  buff/cache   available
Mem:             31          13           1           1          16          15
Swap:             0           0           0

cpu

[root@HKSZF-ZW-172-19-122-201 conf]# lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                16
On-line CPU(s) list:   0-15
Thread(s) per core:    1
Core(s) per socket:    16
座:                 1
NUMA 节点:         1
厂商 ID:           GenuineIntel
CPU 系列:          15
型号:              6
型号名称:        Intel(R) Xeon(R) Gold 5218R CPU @ 2.10GHz
步进:              3
CPU MHz:             2095.114
BogoMIPS:            4190.22
超管理器厂商:  KVM

查询fe节点

alive=true则成功

mysql> SHOW PROC '/frontends'\G
*************************** 1. row ***************************
              Name: fe_57c36c6c_23a0_4eb3_9e10_bd23a6c5fc1e
              Host: 172.19.122.201
       EditLogPort: 9010
          HttpPort: 8030
         QueryPort: 9030
           RpcPort: 9020
ArrowFlightSqlPort: -1
              Role: FOLLOWER
          IsMaster: true
         ClusterId: 1141347507
              Join: true
             Alive: true
 ReplayedJournalId: 9952026
     LastStartTime: 2024-12-20 14:41:27
     LastHeartbeat: 2025-01-07 16:11:53
          IsHelper: true
            ErrMsg: 
           Version: doris-2.1.6-rc04-653e315ba5
  CurrentConnected: Yes
1 row in set (0.04 sec)

查下be状态

如果alive=true,则启动成功

SHOW PROC '/backends'\G

查看be日志

be日志文件位置:/data/apache-doris-2.1.6/be/logs/be.WARNING日志

......
W20250104 00:45:11.027704 18365 mem_tracker_limiter.cpp:431] 
Process Memory Summary:
    os physical memory 31.25 GB. process memory used 14.34 GB(= 15.83 GB[vm/rss] - 1.49 GB[tc/jemalloc_cache] + 0[reserved] + 0B[waiting_refresh]), limit 28.12 GB, soft limit 25.31 GB. sys available memory 3.03 GB(= 3.03 GB[proc/available] - 0[reserved] - 0B[waiting_refresh]), low water mark 1.56 GB, warning water mark 3.12 GB.
Memory Tracker Summary:
......

其中以下报错忽略,影响运行:

W20250103 17:17:25.832850 17707 task_worker_pool.cpp:1599] trigger compaction failed, tablet_id=11034, published=3083560 : [ALREADY_EXIST]compaction task has already been submitted, tablet_id=11034, compaction_type=2.
W20250103 17:17:27.018606 17706 task_worker_pool.cpp:1599] trigger compaction failed, tablet_id=11034, published=3083580 : [ALREADY_EXIST]compaction task has already been submitted, tablet_id=11034, compaction_type=2.
W20250103 17:17:28.000267 17710 task_worker_pool.cpp:1599] trigger compaction failed, tablet_id=11034, published=3083600 : [ALREADY_EXIST]compaction task has already been submitted, tablet_id=11034, compaction_type=2.

查看be配置

be配置文件位置:/data/apache-doris-2.1.6/be/conf

解决办法

最终解决办法:内存按照官网建议配置,内存扩一倍

临时解决办法:重启be服务

--停止be服务
cd /data/apache-doris-2.1.6/be
bin/stop_be.sh --daemon

--启动be服务
cd /data/apache-doris-2.1.6/be
bin/start_be.sh --daemon

--mysql客户端登录
mysql -uroot -P 9030 -h 172.19.122.201 -p

--查看be状态 要等一定的时间后查看
mysql>  show backends\G

更多推荐