Showing posts with label bigdata. Show all posts
Showing posts with label bigdata. Show all posts

Thursday, June 25, 2015

how to shuffle sort mapreduce

Shuffling is the process by which intermediate data from mappers are transferred to 0,1 or more reducers. Each reducer receives 1 or more keys and its associated values depending on the number of reducers (for a balanced load). Further the values associated with each key are locally sorted.

http://stackoverflow.com/questions/22141631/what-is-the-purpose-of-shuffling-and-sorting-phase-in-the-reducer-in-map-reduce

















Tuesday, April 21, 2015

how to install hadoop ubuntu

determine hadoop version if exists on ubuntu

how to mongodb win7

configure port
mongod --dbpath C:\Users\eyup\Downloads\mongodata --port 27017

configure log file for database
mongod --dbpath C:\Users\eyup\Downloads\mongodata --port 27017 --logpath C:\Users\eyup\Downloads\mongodata\logs\mongodb.log


run mongodb with configuration file.syntax problems with command prompt experienced

mongod -f C:\Users\eyup\Downloads\mongodata\config\mongodb.cfg

mongod -f "C:\Users\eyup\Downloads\mongodata\config\mongodb.cfg"

mongod --config "C:\Users\eyup\Downloads\mongodata\config\mongodb.cfg"


mongod --config C:\Users\eyup\Downloads\mongodata\config

mongod.exe --config C:\Users\eyup\Downloads\mongodata\config\mongodb.conf

mongod.exe -f C:\Users\eyup\Downloads\mongodata\config\mongodb.conf

how to install mongodb ubuntu

First import public key of 10gen repository in our system
 sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 7F0CEB10
 

For Ubuntu:
echo 'deb http://downloads-distro.mongodb.org/repo/ubuntu-upstart dist 10gen' | sudo tee /etc/apt/sources.list.d/mongodb.list

sudo apt-get update
sudo apt-get install mongodb-org

install robomongo app

sudo apt-get install robomongo-0.8.4-i386$
tar xvfz robomongo-0.8.4-i386.tar.gz
 robomongo-0.8.4-i386/bin$ ./robomongo

ubuntu@ubuntu:~$ sudo service mongod stop
mongod stop/waiting
ubuntu@ubuntu:~$ sudo service mongod start
mongod start/running, process 19201
ubuntu@ubuntu:~$ mongo --version
MongoDB shell version: 2.6.4





 

how to install mongodb windows8

platform
Windows Server 2008 R2 Standart 64 bit

download
mongodb-win32-x86_64-2008plus-2.6.4
extract




run mongod          
connect test
run with config file?
Run as service?

Mongodb gui for windows
Robomongo-0.8.4-i386