Archive for category Linux_D

Hive Issue: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

2015-06-25 11:16:52,554 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(623)) – 0: get_table : db=lntest tbl=tmp_download
2015-06-25 11:16:52,554 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(305)) – ugi=abcuser ip=unknown-ip-addr cmd=get_table : db=lntest tbl=
tmp_download
2015-06-25 11:16:52,555 ERROR [main]: bonecp.ConnectionHandle (ConnectionHandle.java:markPossiblyBroken(388)) – Database access problem. Killing off this connection and all r
emaining connections in the connection pool. SQL State = 08S01
2015-06-25 11:16:52,557 ERROR [main]: bonecp.BoneCP (BoneCP.java:destroyConnection(221)) – Error in attempting to close connection
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during rollback(). Transaction resolution unknown.
at sun.reflect.GeneratedConstructorAccessor114.newInstance(Unknown Source)

Problem related with MySQL for Hive settings:
mysql> show global variables like ‘%time%’ ;
Read the rest of this entry »

No Comments

Quick guide: How to change Vcenter IP

Simple way, update before you move it away.
Admininstrate -> vCenter Server setting -> Advanced Settings.

I installed Vcenter on a VM. so I did clone. but the IP need to be updated.

because the SSO still try to find the old IP. updated many configuration files, still stucks.
Read the rest of this entry »

No Comments

(Fixed) Oracle RAC Issue – cssd

Issue 1: cssd can’t start up during reboot. GC startup block cssd startup. disable GC auto start fixed the issue.

root@host_name# /ora/product/11.1.0.6a/bin/crsctl check crs
Failure 1 contacting Cluster Synchronization Services daemon
Cannot communicate with Cluster Ready Services
Cannot communicate with Event Manager

root@host_name# /ora/product/11.1.0.6a/bin/crsctl start crs
Read the rest of this entry »

,

1 Comment

Rundeck, operate batch hosts at the same time

Rundeck, a web-accessible console for dispatching commands and scripts to your nodes. Dispatch shell commands and scripts across all your physical or virtual nodes from a web-based or command-line interface. Automate ad-hoc and routine procedures. Use the API and plugins to integrate with other services. Use your LDAP/AD for authentication, and configure extensive access control.

Install Steps:

rpm -Uvh http://rundeck.org/latest.rpm
yum install rundesk
/etc/init.d/rundeckd start
http://your_host:4440
Default account: admin/admin

No Comments

Some tips: Vsftpd configuration

Vsftpd tips:

All following update /etc/vsftpd/vsftpd.conf

How to change the default public root ?
anon_root=/the/path/you/want

I don’t want let my firewall too open. then define the min/max port.
pasv_min_port=60000
pasv_max_port=65000

iptable setting. 20 is for data
# for FTP
-A INPUT -m state –state NEW -m tcp -p tcp –dport 20 -j ACCEPT
-A INPUT -m state –state NEW -m tcp -p tcp –dport 21 -j ACCEPT
-A INPUT -m state –state NEW -m tcp -p tcp –dport 60000:65000 -j ACCEPT

Vsftp default turn Passive on, How to disable it ?
pasv_enable=NO

,

No Comments

vxprint volume enabled sync

v oravol – ENABLED SYNC 109297664 SELECT – fsgen
pl oravol-01 oravol ENABLED ACTIVE 109297664 CONCAT – RW
sd rootdisk01-09 oravol-01 rootdisk01 33554432 26214400 0 c2t1d0 ENA
sd rootdisk01-11 oravol-01 rootdisk01 60280832 83083264 26214400 c2t1d0 ENA
pl oravol-02 oravol ENABLED ACTIVE 109297664 CONCAT – RW
sd rootdisk02-10 oravol-02 rootdisk02 34066432 109297664 0 c3t0d0 ENA

ENABLED SYNC could happened when you do the vxassist and then ctrl+c incidently.

Solution:
vxvol -g rootdg -f resync oravol

this need wait a while.

no verbose progress shows up. you can check with following.
vxprint -g rootdg -l|grep -i sync
state: state=SYNC kernel=ENABLED cdsrecovery=2/2 (syncing)

Another tips:
df -h can’t find the change for vxresize. but vxprint shows up.
you can use fsadm -b to extend the fs.

No Comments

How to enable apache modules in Debian/Ubuntu-likes

Simple:
sudo a2enmode rewrite

, ,

No Comments

Install Duplicity on Linux(CentOS)

Duplicity backs directories by producing encrypted tar-format volumes
and uploading them to a remote or local file server.

Firstly, enable two important repo
http://www.linuxdict.com/2009-06-enable-two-important-repo-for-centos-5

Secondly, install Duplicity
$sudo yum install -y duplicity

Finally, Use it.
$duplicity –help

Following is a short tutorial
Read the rest of this entry »

No Comments

Show the Bash History with date

echo 'export HISTTIMEFORMAT="%d/%m/%y %T "' >> ~/.bash_profile

Finished 🙂
run history command, the output should looks like the following.
1014 12/03/10 01:13:44 who -r
1015 12/03/10 01:13:45 history

No Comments

mount: you must specify the filesystem type

I have one raw file contains system:
$file my.raw
my.raw: x86 boot sector; partition 1: ID=0x83, active, starthead 1, startsector 63, 64259937 sectors; partition 2: ID=0x5, starthead 254, startsector 64260000, 2843505 sectors
try
$mount -o loop my.raw /mnt
mount: you must specify the filesystem type

Solution:
$mount -o loop,offset=32256 my.raw /mnt

Root:
The number too big for calculations, so set offset here.

No Comments