April 2018
M T W T F S S
« Mar    
 1
2345678
9101112131415
16171819202122
23242526272829
30  

Categories

WordPress Quotes

There is no passion to be found playing small - in settling for a life that is less than the one you are capable of living.
Nelson Mandela

Recent Comments

April 2018
M T W T F S S
« Mar    
 1
2345678
9101112131415
16171819202122
23242526272829
30  

Short Cuts

2012 SERVER (64)
2016 windows (9)
AIX (13)
Amazon (10)
Ansibile (17)
Apache (122)
Asterisk (2)
cassandra (2)
Centos (207)
Centos RHEL 7 (242)
chef (3)
cloud (2)
cluster (3)
Coherence (1)
DB2 (5)
DISK (25)
DNS (9)
Docker (21)
Eassy (11)
EXCHANGE (3)
Fedora (6)
ftp (4)
GOD (2)
Grub (1)
Hacking (10)
Hadoop (6)
Hyper-V (10)
IIS (15)
IPTABLES (15)
JAVA (6)
JBOSS (31)
jenkins (1)
Kubernetes (1)
Ldap (4)
Linux (186)
Linux Commands (167)
Load balancer (5)
mariadb (13)
Mongodb (3)
MQ Server (21)
MYSQL (73)
Nagios (4)
NaturalOil (13)
Nginx (23)
Ngix (1)
Openstack (6)
Oracle (29)
Perl (3)
Postfix (19)
PowerShell (2)
Python (3)
qmail (36)
Redis (9)
RHCE (28)
SCALEIO (1)
Security on Centos (29)
SFTP (1)
Shell (64)
Solaris (58)
Sql Server 2012 (4)
squid (3)
SSH (10)
SSL (14)
Storage (1)
swap (3)
TIPS on Linux (28)
tomcat (58)
Uncategorized (29)
Veritas (2)
vfabric (1)
VMware (28)
Weblogic (38)
Websphere (71)
Windows (19)
Windows Software (2)
wordpress (1)
ZIMBRA (17)

WP Cumulus Flash tag cloud by Roy Tanck requires Flash Player 9 or better.

Who's Online

23 visitors online now
3 guests, 20 bots, 0 members

Hit Counter provided by dental implants orange county

Useful commands for Hadoop HDFS troubleshooting

[hadoop@master ~]$ hdfs dfsadmin -report 17/04/13 00:06:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable Configured Capacity: 37576769536 (35.00 GB) Present Capacity: 33829806080 (31.51 GB) DFS Remaining: 33829789696 (31.51 GB) DFS Used: 16384 (16 KB) DFS Used%: 0.00% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing […]

CentOS 7.3 under the Hadoop 2.7.2 cluster

CentOS 7.3 under the Hadoop 2.7.2 cluster

how to setup a Hadoop cluster on CentOS linux system. Before you read this article, I assume you already have all basic conceptions about Hadoop and Linux operating system.

mv ifcfg-eno16777736 ifcfg-eth0 vi /etc/udev/rules.d/90-eno-fix.rules # This file was automatically generated on systemd update SUBSYSTEM==”net”, ACTION==”add”, DRIVERS==”?*”, ATTR{address}==”00:0c:29:9e:8f:95″, NAME=”eno16777736″

[…]

HDFS Command Syntax

HDFS Command Syntax Overview: hadoop fs : Ex.: hadoop fs -ls  hadoop version : check hadoop installed properly

HELP: help [cmd]: hopefully this is self-describing 

Inspect files: ls/lsr : list all files in cat : print on stdout tail [-f] : output the last part of the test : return attributes of file and […]

Hadoop vs Spark

Hadoop is to solve big data (up to a computer cannot be stored, a computer cannot be processed within the required time) of reliable storage and processing.

HDFS, the cluster composed by the ordinary PC to provide highly reliable file storage, block by saving multiple copies of the solution to the problem server or hard […]

Apache Spark

Apache Spark 1.5.2 release, this version is a maintenance release that includes fixes Spark stability in some areas, mainly: DataFrame API, Spark Streaming, PySpark, R, Spark SQL and MLlib

 

Apache Spark is one of the hadoop open source cluster computing environments similar, but there are some differences between the two, these useful differences make […]

Centos and Rhel 6.5 Hadoop 2.4 3 Node Server Cluster

Centos and Rhel 6.5 Hadoop 2.4 3 Node Server

hadoop word has been popular for many years, the mention of big data will think hadoop, hadoop then what role is it? Official definition: hadoop is a developing and running large-scale data processing software platform. Core Words is a platform, which means we have a […]