Nosql databases why,what & when ???

I found this interesting..

NoSQL databases get a lot of press coverage, but there seems to be a lot of confusion surrounding them, as in which situations they work better than a Relational Database, and how to choose one over another. This talk will give an overview of the NoSQL landscape and a classification for the different architectural categories, clarifying the base concepts and the terminology, and will provide a comparison of the features, the strengths and the drawbacks of the most popular projects (CouchDB, MongoDB, Riak, Redis, Membase, Neo4j, Cassandra, HBase, Hypertable)

NoSQL Databases: Why, what and when from Lorenzo Alberton

ArchBang nov 2012:KISS

ArchBang nov 2012:KISS(Keep it Simple Stupid)!

Latest archbang(released on november) more user-friendly,simple,fast and stable..after small config…

For simple installation this link will help you: http://archvortex.blogspot.in/2011/09/simple-archbang-installation-guide.html

Arch Linux defines simplicity as without unnecessary additions, modifications, or complications, and provides a lightweight UNIX-like base structure that allows an individual user to shape the system according to their own needs. In short: an elegant, minimalist approach.

Complexity without complication.

Simplicity of implementation, code-elegance, and minimalism shall always remain the reigning priorities of Arch development.

Arch Linux targets and accommodates competent GNU/Linux users by giving them complete control and responsibility over the system.

Arch Linux uses simple tools, that are selected or built with openness of the sources and their output in mind.

By keeping the system simple, Arch Linux provides the freedom to make any choice about the system.

Some changes for this release:

- QDarkStudio4 default GTK theme

- Shotwell picture viewer

- Improved Conky

- Epdfview replaces zathura

- simple clean tint2 panel

- Broadcom wireless added

- virtualbox-archlinux-additions

- Mobile Broadband modem capability added to Network Manager

You can embed the lxterminal in desktop using this link

http://bbs.archbang.org/viewtopic.php?pid=1714
you can change your conky like above using this script:

//SCRIPT BEGINS

background yes
use_xft yes
xftfont monospace:size=9
xftalpha 1
update_interval 1.0
total_run_times 0
own_window yes
own_window_transparent yes
own_window_type desktop
own_window_hints undecorated,below,sticky,skip_taskbar,skip_pager
own_window_colour black
double_buffer yes
minimum_size 1 1
maximum_width 240
draw_shades no
draw_outline no
draw_borders no
draw_graph_borders no
default_color gray
default_shade_color 000000
default_outline_color d9d7d6
alignment tr
gap_x 12
gap_y 12
no_buffers yes
uppercase no
cpu_avg_samples 2
override_utf8_locale no
color1 red
color2 gray
##############################################
#  Output
##############################################
TEXT
${image $HOME/archlinux2inverted.png -p 9,10 -s 250×200}

${font Comfortaa:bold:size=13}${offset 200}${time %A}
${color #66cd00}${font Comfortaa:bold:size=36}${time %H}${font}${color #7fff00}${font Comfortaa:bold:size=28}${voffset -27}${time :%M:%S}${font}
${font Comfortaa:bold:size=8}${offset 100}${time %d %b %Y}
${color #ffd700}CPU: $alignr${cpu cpu0}%
${cpubar cpu0}
RAM: $alignr$mem/$memmax
$membar
${color #008b00}
${font sans-serif:bold:size=8}SYSTEM ${hr 2}
Hostname: $alignr${color1}$nodename${color #008b00}
Kernel: $alignr${color1}$kernel${color #008b00}
Arch:${alignr}${color1}$machine${color #008b00}
Processes: ${alignr}${color1}$processes ($running_processes running)${color #008b00}
Uptime: ${alignr}${color1}$uptime${color #008b00}
Load: ${alignr}${color1}$loadavg${color #008b00}

${color #008b00}${font sans-serif:bold:size=8}TOP PROCESSES ${hr 2}
${font sans-serif:normal:size=8}${top_mem name 1}${alignr}${top mem 1} %
${top_mem name 2}${alignr}${top mem 2} %
$font${top_mem name 3}${alignr}${top mem 3} %
$font${top_mem name 4}${alignr}${top mem 4} %

${color #008b00}${font sans-serif:bold:size=8}SHORTCUT KEYS ${hr 2}
${font sans-serif:normal:size=8}Alt+F2$alignr Run Dialog
Alt+F3$alignr Dmenu
Super+space$alignr Main Menu
Super+t$alignr Terminal
Super+f$alignr File Manager
Super+e$alignr Editor
Super+m$alignr Media Player
Super+w$alignr Web Browser
Super+q$alignr Force Quit
Super+g$alignr Character Map
Super+l$alignr Lock
Super+r$alignr Read the DOC
Super+x$alignr Tiling Keybinds

${image ~/alogo.png -p 0,0 -s 190×45}
${color}ACPI Battery: ${color DeepSkyBlue}$battery
${battery_bar 11,0}
//END OF THE SCRIPT

Note:The image you are going to use should be in Home directory.
Fore more information go to :http://wiki.archbang.org/index.php?title=Main_Page

Big Data=Big opportunity!!!

It’s all about Big data technologies. What is it? Well I also think like that when I heard before. This write-up is just an inspired one after attending first class of online course. Let’s have a look!

Even we find difficult to recognize a machine and a human only through conversation. Which is human?  which is a machine?  Difficult right? For example, While submission of many forums online we need to type the same letters on-screen (captchers) , so that machines can recognize we are humans not any malware. Web intelligence is that the machine needs to find out which is man? which is a machine?

We can see many examples of web intelligence, machine translation between human languages (Google translation), The software recognizes places in the photos, recognition of faces (IE, in Picasa and Facebook albums), more over machine defeated the champions in a quiz conducted by IBM.

Big Data?

See there are lots and lots of web pages…for example , a billion of Facebook users, twitter accounts, hundreds of million tweets per day, billion Facebook pages, billion of google queries per day, millions of servers and of course petabytes of data.

There are many large enterprises,contain 5000-50,000 servers,terabytes of data,millions of transaction per day.

Traditional ‘business intelligence’ using data bases,

data bases–>data warehouse—>more data bases —>statistics

Google ,Facebook,Linkedin,eBay,Amazon didn’t use traditional data bases for big data.

why?

what else?

There comes other terms one is massive parallelism and map-reduce paradigm.What does data have to do with intelligence? There are two kind of intelligence ,one is Reactive intelligence and other is predictive intelligence,and we always using second one.

Do you think why?

“any fool can know….the point to understand”-Albert Einstein.Now got it ,right?

How it is possible?

Using Look,Listen,Learn,Correct,Predict,Correct.

AI techniques at web scale for predictive intelligence;the best example is the online advertising-which predicting intent and interest,gauging consumer sentiment and predicting behaviour,detecting adverse events and predicting their impact,categorising and recognising places,faces of people,personalised genomic medicine for future:DNA samples shared in web to get the solution for genetic diseases,to know ancestors,so medication become better.

The elements used to predict the future using AI and Big Data,Look-Search:finding a stuff,Listen-machine learning:Figuring out what is important and what is not or classify & clustering,Learn-Information Extraction:which is extracting facts from data,Correct-reasoning:putting different facts together and find out a conclusion,Predict-data mining:mining rules from data,Correct-optimization:figuring out the right thing to do.

These all are the things I got from first class,but it is enough for me to embed myself in it,if you have some interest in Web Intelligence and Big data,go & have a dive through it!!!

An idea on IPv6 addressing..

IPv6 addressing.

We have all heard about  IPv6…Let’s go through some basic information regarding this,

IPv6 brings larger address space than IPv4. IPv4=32 bits —-> IPv6=128 bits
x : x : x : x : x : x : x : x  represents this 128 bit long address where, x is 16 bit hex field.In which the last 64 bit used as Interface ID.
for example,consider one IPv6

2001 : 0DB8 : C003 : 0001 : 0000 : 0000 : 0000 : F00D

here,the leading zeros can be avoided and it becomes

2001 : 0DB8 : C0D3 : 1 : 0 : 0 : 0 : F00D

here we can replace consecutive zeros by double colon  ’::‘ (only used once) and it becomes

2001 : 0DB8 : C0D3 : 1 :: F00D

                 |/12  |/32    |/48    |/64

2001  :  0DB8  :       :        :  Interface ID

Registry —>|      |          |         |
ISP Prefix —->    |          |        |
Site Prefix —->              |        |
Subnet Prefix  —–>                |
The address allocation follows a generally accepted assignment policy.

Address types are many: Unicast(ont-to-one),Anycast(one-to -nearest),Multicast(ont-to many).(you can google more about it).

We can see the interface id  above and this single interface may be assigned multiple addresses of any type.
Every IPv6 enabled interface must contain at least one loop back* and one -link local address.

IPv6 host address can be assigned in multiple ways:
static configuration
stateless auto-configuration
DHCPv6

When IPv6 is used over Ethernet Networks,the ethernet MAC address can be used to generate 64 bit interface ID for host,called EUI-64 address.
MAC address use 48 bits (check ‘ifconfig‘ command in terminal to get MAC address of your machine) additional bits must be inserted to fill 64 bits required.
* Loopback address is a special IP number (127.0.0.1) that is designated for the software loopback interface of a machine. The loopback interface has no hardware associated with it, and it is not physically connected to a network.

GENERAL LVM CONCEPTS

(Topic based on red hat linux)

Logical Volume Management provides a more flexible way to manage disk space than physical disk partotions.Raw disk space in physical disk partitions can be pooled together or divided up into virtual partitions called logical volumes.This allows a number of powerful features,such as the ability to create file systems larger than any one disk,the ability to divide up asingle disk into more than fourteen file systems,and the ability to easily extend an existing file system with more space without the need to reformat it.

Implementation of LVM storage with command -Line Tools

Prepare Physical Volume

1.fdisk is used to create a new partition for use with LVM.Always set the type to 0X8e Linux LVM on partition to be used with LVM.

Alternatively you can use a whole disk,a RAID array,or a SAN disk.

2.pvcreate  /dev/vdaN is used to initialize the parttion for use with LVM as a Physical Volume.

Creating a Volume Group

1.vgcreate vgname /dev/vdaN  will create a volume group named vgname made up of the physical volume /dev/vdaN

you can add new physical volume later with vgextend.

Create and Use a New Logical Volume

1.lvcreate  -n lvname  -L  2G  vgname  creates a new 2GB logical volume named lvname from the available physical extends on vgname.

2.mkfs -t ext4 /dev/vgname/lvname will create an ext4 file system on the new logical volume.

3.mkdir /data makes directory needed as a mount point.

4.Add an entry to the .etc/fstab file:

/dev/mapper/vgname-lvname   /data  ext4   defaults  1  2

5.Run mount  -a to mount all the file systems in /etc/fstab , including the entry you just added.

images

Hello world!

GET INTO OPENSOURCE SOFTWARES

Spend your little time for knowing the open source softwares.Before get into the topic I am asking you ,do you ever think that what an open source software really means!! Open source software is a computer software that is available in sourcecode form.The source code and certain other rights normally reserved for copyright holders are provided under a software license that permits users to study,change and improve at times also to distribute the software .We are all familiar with many open source softwares like Mozilla firefox ,google chrome ,linux distros , the latest popular example is the android mobile operating system.

Open sourcesoftware is non proprietry- means nobody owns the code,it also means that anybody owns…..“Imagine a million monkeys on a million typewriter…eventually you might get shakesphere” OSS capitalize on this concept.Million of people nowadays work in this field so we can assure that we will definetly get what we want from opensource field. Studies about OSS reveals that they are improving.There is no doubt that OSS are proving more popular both inside and outside the computer industry.

When I searched about this topic I came to know from one article that by 2014, 223 million smartphones with opensource are reaching.As many of you might already know,symbian has started its move towards becoming opensource,which makes an important shift in the mobile operating system market. OSS are free to use,free to distribute and free to modify.To the general public this means that they do not have to pay anything for the product whereas a closed source alternative could set them back hundreds of pounds.Moreover there are so many advantages,just consider the OSS such as linux , we all are well know about the linux distros and some of the main advantages are stability,free software,run on old hardware,security etc.The list of advantages are beyond this artice since it is a huge list….

Stability,when an application crashes in windows,we couldn’t continue working.Linux can crash also,but it is much harder to do.If an application crashes in linux,it will usually not harm the kernel or other processes. Most software can be obtained without cost for linux.For example,one thing that has kept people from linux is that the lack of office software.That has changed with open office and now you can edit documents and presentations from the popular Microsoft software.The conversion isn’t 100 % perfect , but it has worked remarkably well.

Linux can run on old hardware . for example,running linux just fine on a Pentium 100 with a 1 GB disk drive,and 16 MB of memory.Linux has the advantage of code being in the public domain. I have been very impressed with the security of linux and the programs run on it.I think having the code out in the open,and the ability to fix things yourself if necessary is a big plus.Who likes to work blind???With some distributions on installation the computer will you ask what levels of security you would like for your system.You can be very trusting.Linux gives you this flexibility.

Like advantage everything have their own disadvantages,but when comparing with advantages,disadvantages are very easy to recover.Learning curve is one of the disadvantages.i won’t lie to you,linux is going to take some time to learn.I know that our society likes to be instantly gratified.Learning linux is definitely worth your time,but to really master it,you will need to spend some good time infront of your machine tinkering with things.Don’t expect to be an expert after reading something like “Linux for Dummies”

You will want to think carefully when you switch to linux about what programs you currently use,and if they have linux support for them.There are still application that do not exist in linux.Thankfully,this list become much more narrow in recent months.A good linux administrator needs to be on hand, if you are at beginning.You may spend overtime at the beginning stages.Some of the latest and greatest hardware that is being produced is not compatible with linux.Atleast , not yet.The people that contribute the program code and drivers to the linux kernel are great at including support fairly quickly.Until that time,everything you buy for hardware in your system may not work.One thing you can do is before purchase ,ask if the hardware vendor has support for linux.

There are tons of distros available ,so its quite confusing to opt a best one.You won’t find the CD’s of linux in all shops,most of the users get confused at first time to configure desktop and settings.It’s tricky for finding the alternatives of softwares which are not available in linux,Software installation is totally different from windows.And these are the small problems faced by the non-techies,but it is very easy to recover by spending time with it.

Nowadays ubuntu and many other linux distros are popular..lots of people has quit the use of windows and switches to linux.The best part of linux is it is an open source and it may become the future platform.Many companies uses linux distros nowadays and mastering it will be an advantage for you.I’m sure that we all would get the benefits from open source as it grows.So try it,try to work on it,contribute to it…

HAPPY OPENSOURCING!!!!