昨天有一个节点突然登录不上了,本以为是节点压力太大,后来发现root倒是能登。
居然是user limitation了…
之前没遇过,呵呵
1 2 3 4 5 |
[bee@db01 tmp]# ssh db04 Read from remote host db04: Connection reset by peer Connection to db04 closed. [root@db04 ~]# su - bee su: cannot set user id: Resource temporarily unavailable |
于是查一下子看到了问题,资源上限了~~难得
1 2 3 4 |
[root@db04 ~]# ps -U bee | wc -l 2433 [root@db04 ~]# lsof| grep bee | wc -l 61138 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
[root@db04 ~]# w -f 23:53:54 up 23 days, 6:16, 17 users, load average: 795.44, 794.94, 794.84 USER TTY LOGIN@ IDLE JCPU PCPU WHAT bee pts/0 17Nov10 5days 4.94s 0.01s sshd: bee [priv] bee pts/1 01Nov10 6days 2:53 2:53 sh bee pts/2 18Nov10 50:48 0.68s 0.68s -bash bee pts/3 01Nov10 6days 17.60s 0.01s sshd: bee [priv] bee pts/4 01Nov10 23days 2.70s 2.68s vmstat 2 bee pts/5 01Nov10 23days 3:13m 3:13m top bee pts/6 01Nov10 21days 0.37s 0.01s sshd: bee [priv] bee pts/7 01Nov10 21days 0.33s 0.01s sshd: bee [priv] bee pts/8 01Nov10 21days 0.34s 0.01s sshd: bee [priv] bee pts/9 01Nov10 21days 0.04s 0.04s -bash bee pts/10 01Nov10 21days 0.06s 0.06s -bash bee pts/11 01Nov10 22days 0.01s 0.01s -bash bee pts/13 Mon08 2days 2.50s 0.01s sshd: bee [priv] bee pts/14 03Nov10 21days 0.02s 0.02s -bash bee pts/15 02Nov10 22days 0.02s 0.02s -bash bee pts/16 02Nov10 21days 0.03s 0.03s -bash root pts/18 23:21 0.00s 0.07s 0.03s -bash |
1 2 3 4 5 6 7 |
[root@db04 ~]# cat /etc/security/limits.conf ####### Oracle ############## bee soft nproc 2047 bee hard nproc 16384 bee soft nofile 1024 bee hard nofile 65536 |